-- Logs begin at Tue 2022-06-14 16:44:53 UTC, end at Tue 2022-06-14 18:16:54 UTC. -- Jun 14 17:35:45.294720 dv-cinder-826350-5-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jun 14 17:35:45.306423 dv-cinder-826350-5-iscsi devstack@keystone.service[87005]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 14 17:35:45.309831 dv-cinder-826350-5-iscsi devstack@keystone.service[87005]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jun 14 17:35:45 2022] *** Jun 14 17:35:45.309831 dv-cinder-826350-5-iscsi devstack@keystone.service[87005]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 14 17:35:45.309831 dv-cinder-826350-5-iscsi devstack@keystone.service[87005]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 14 17:35:45.309831 dv-cinder-826350-5-iscsi devstack@keystone.service[87005]: nodename: dv-cinder-826350-5-iscsi Jun 14 17:35:45.309831 dv-cinder-826350-5-iscsi devstack@keystone.service[87005]: machine: x86_64 Jun 14 17:35:45.309831 dv-cinder-826350-5-iscsi devstack@keystone.service[87005]: clock source: unix Jun 14 17:35:45.309831 dv-cinder-826350-5-iscsi devstack@keystone.service[87005]: pcre jit disabled Jun 14 17:35:45.309831 dv-cinder-826350-5-iscsi devstack@keystone.service[87005]: detected number of CPU cores: 4 Jun 14 17:35:45.309831 dv-cinder-826350-5-iscsi devstack@keystone.service[87005]: current working directory: / Jun 14 17:35:45.309831 dv-cinder-826350-5-iscsi devstack@keystone.service[87005]: detected binary path: /usr/bin/uwsgi-core Jun 14 17:35:45.309831 dv-cinder-826350-5-iscsi devstack@keystone.service[87005]: your processes number limit is 47680 Jun 14 17:35:45.309831 dv-cinder-826350-5-iscsi devstack@keystone.service[87005]: your memory page size is 4096 bytes Jun 14 17:35:45.309831 dv-cinder-826350-5-iscsi devstack@keystone.service[87005]: detected max file descriptor number: 2048 Jun 14 17:35:45.309831 dv-cinder-826350-5-iscsi devstack@keystone.service[87005]: lock engine: pthread robust mutexes Jun 14 17:35:45.310618 dv-cinder-826350-5-iscsi devstack@keystone.service[87005]: thunder lock: enabled Jun 14 17:35:45.310618 dv-cinder-826350-5-iscsi devstack@keystone.service[87005]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 14 17:35:45.310618 dv-cinder-826350-5-iscsi devstack@keystone.service[87005]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 14 17:35:45.358690 dv-cinder-826350-5-iscsi devstack@keystone.service[87005]: Python main interpreter initialized at 0x55916b0589c0 Jun 14 17:35:45.358690 dv-cinder-826350-5-iscsi devstack@keystone.service[87005]: python threads support enabled Jun 14 17:35:45.358690 dv-cinder-826350-5-iscsi devstack@keystone.service[87005]: your server socket listen backlog is limited to 100 connections Jun 14 17:35:45.358690 dv-cinder-826350-5-iscsi devstack@keystone.service[87005]: your mercy for graceful operations on workers is 90 seconds Jun 14 17:35:45.359164 dv-cinder-826350-5-iscsi devstack@keystone.service[87005]: mapped 403077 bytes (393 KB) for 2 cores Jun 14 17:35:45.359234 dv-cinder-826350-5-iscsi devstack@keystone.service[87005]: *** Operational MODE: preforking *** Jun 14 17:35:45.359564 dv-cinder-826350-5-iscsi devstack@keystone.service[87005]: *** uWSGI is running in multiple interpreter mode *** Jun 14 17:35:45.359564 dv-cinder-826350-5-iscsi devstack@keystone.service[87005]: spawned uWSGI master process (pid: 87005) Jun 14 17:35:45.359822 dv-cinder-826350-5-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jun 14 17:35:45.361229 dv-cinder-826350-5-iscsi devstack@keystone.service[87005]: spawned uWSGI worker 1 (pid: 87018, cores: 1) Jun 14 17:35:45.361229 dv-cinder-826350-5-iscsi devstack@keystone.service[87005]: spawned uWSGI worker 2 (pid: 87019, cores: 1) Jun 14 17:35:45.364278 dv-cinder-826350-5-iscsi devstack@keystone.service[87005]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 14 17:35:51.175914 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 14 17:35:51.175914 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: from cryptography.utils import int_from_bytes Jun 14 17:35:51.176711 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 14 17:35:51.176711 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: from cryptography.utils import int_from_bytes Jun 14 17:35:51.177124 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 14 17:35:51.177124 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: from cryptography.utils import int_from_bytes Jun 14 17:35:51.177241 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 14 17:35:51.177241 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: from cryptography.utils import int_from_bytes Jun 14 17:35:51.226977 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 14 17:35:51.227223 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 14 17:35:51.227406 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] command line args: [] {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 14 17:35:51.227565 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 14 17:35:51.227696 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 14 17:35:51.227823 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 14 17:35:51.227942 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] ================================================================================ {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 14 17:35:51.228072 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] command line args: [] {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 14 17:35:51.228245 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] admin_token = **** {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:35:51.228375 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 14 17:35:51.228375 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] ================================================================================ {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 14 17:35:51.228596 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] config_dir = [] {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:35:51.228596 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:35:51.228837 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] admin_token = **** {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:35:51.228952 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] config_source = [] {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:35:51.229087 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] config_dir = [] {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:35:51.229249 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] debug = True {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:35:51.229399 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:35:51.229590 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:35:51.229938 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] config_source = [] {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:35:51.229938 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] debug = True {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:35:51.231454 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:35:51.231636 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:35:51.231791 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] insecure_debug = False {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:35:51.231974 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:35:51.232115 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:35:51.232244 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] insecure_debug = False {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:35:51.232379 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:35:51.232510 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:35:51.232630 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] list_limit = None {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:35:51.232764 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:35:51.232903 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] log_config_append = None {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:35:51.232903 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:35:51.233179 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] list_limit = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:35:51.233290 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] log_dir = None {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:35:51.233460 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] log_config_append = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:35:51.233569 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] log_file = None {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:35:51.233704 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:35:51.233704 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] log_dir = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:35:51.233969 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:35:51.234088 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] log_file = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:35:51.234211 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:35:51.234333 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:35:51.234467 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:35:51.234588 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:35:51.234719 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:35:51.234851 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:35:51.235024 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:35:51.235024 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:35:51.235313 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:35:51.235313 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:35:51.235578 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:35:51.235696 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:35:51.235829 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:35:51.236014 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:35:51.236133 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:35:51.236299 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:35:51.236417 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:35:51.236594 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:35:51.236763 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:35:51.236888 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:35:51.237017 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:35:51.237186 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:35:51.237304 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:35:51.237435 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:35:51.237558 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] notification_format = cadf {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:35:51.237682 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:35:51.237804 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:35:51.237916 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] notification_format = cadf {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:35:51.237916 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:35:51.238143 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.36/identity {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:35:51.238143 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] publish_errors = False {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:35:51.238143 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:35:51.238551 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.36/identity {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:35:51.238551 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] publish_errors = False {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:35:51.238781 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:35:51.238781 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:35:51.238995 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:35:51.239113 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:35:51.239224 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:35:51.239224 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:35:51.239493 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:35:51.239493 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] standard_threads = False {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:35:51.239709 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:35:51.239841 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] strict_password_check = False {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:35:51.239952 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:35:51.240081 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:35:51.240200 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] standard_threads = False {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:35:51.240319 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] use_eventlog = False {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:35:51.240438 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] strict_password_check = False {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:35:51.240567 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] use_journal = False {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:35:51.241311 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:35:51.241441 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] use_json = False {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:35:51.241632 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] use_eventlog = False {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:35:51.241797 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] use_stderr = False {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:35:51.241924 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] use_journal = False {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:35:51.242172 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] use_syslog = False {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:35:51.242301 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] use_json = False {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:35:51.242434 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] watch_log_file = False {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:35:51.242602 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] use_stderr = False {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:35:51.242712 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.242827 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] use_syslog = False {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:35:51.242957 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.243077 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] watch_log_file = False {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:35:51.243197 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.243334 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.243469 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.243589 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.243711 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.243822 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.243936 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.244049 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.244164 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.244284 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.244412 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.244524 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.244637 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.244751 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.244863 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.244975 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.245142 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.245262 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.245377 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.245489 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.245605 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.245605 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.245835 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.245954 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.246077 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.246202 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.246313 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.246425 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.246550 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.246550 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.246765 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.246875 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.247256 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.247412 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.247533 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.247656 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.247779 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.247890 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.248003 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.248204 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.248316 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.248429 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.248549 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.248660 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.248781 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.248909 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.249028 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.249139 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.249260 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.249376 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.249494 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.249623 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.249734 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.249848 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.249959 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.250072 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.250196 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.250316 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.250436 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.250436 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.250654 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.250765 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.250877 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.250877 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.251172 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.251371 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.251527 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.251687 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.251840 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.251840 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.252149 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.252309 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.252458 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.252665 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.252857 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.253068 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.253192 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.253356 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.253481 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.253615 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.253784 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.253913 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.254081 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.254196 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.254366 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.254478 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.254653 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.254775 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.254946 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.255454 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.255569 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.255743 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.255882 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.256057 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.256229 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.256498 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.257110 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.257269 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.257396 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.257520 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.257662 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.257830 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.258001 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.258111 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.258273 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.258387 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.258523 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.258645 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.258802 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.258910 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.259038 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.259150 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.259280 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.259427 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.259558 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.259671 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.259799 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.259914 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.260040 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.260162 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.260278 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.260403 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.260515 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.260630 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.260756 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.260878 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.260989 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.261114 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.261226 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.261349 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.261488 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.261610 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.261724 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.261847 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.261958 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.262082 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.262282 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.262397 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.262513 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.262627 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.262741 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.262854 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.262980 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.263154 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.263276 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.263276 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.263603 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] cache.enabled = True {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.263716 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.263850 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.263979 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.264103 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.264230 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] cache.enabled = True {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.264342 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.264466 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.264586 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.264709 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.264823 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.264943 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.265058 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.265172 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.265286 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.265415 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.265527 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.265642 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.265642 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.265855 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.265969 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.266095 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.266095 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.266303 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.266424 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.266540 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.266653 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.266777 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.266890 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.267005 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.267118 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.267231 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.267365 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.267504 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.267617 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.267731 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.267845 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.267960 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.268084 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.268219 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.268329 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.268451 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.268563 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.268677 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.268790 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.268919 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.268919 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.268919 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.268919 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.269324 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.269324 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.269324 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.269654 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.269772 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.269887 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.270002 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.270116 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.270240 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.270240 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] auth.external = None {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.270449 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.270611 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] auth.mapped = None {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.270723 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.270848 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.270973 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] auth.external = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.271083 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.271238 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] auth.mapped = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.271406 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] auth.password = None {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.271521 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.271638 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] auth.token = None {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.271762 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.271874 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.272173 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] auth.password = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.272288 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] catalog.caching = True {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.272407 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] auth.token = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.272524 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.272638 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.272753 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.272880 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] catalog.caching = True {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.273166 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.273282 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.273403 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.273518 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.273634 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.273761 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.273873 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] credential.caching = True {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.273990 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.274105 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] credential.driver = sql {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.274220 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.274338 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.274465 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] credential.caching = True {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.274593 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.274707 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] credential.driver = sql {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.274823 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.274943 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.275073 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.275197 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.275345 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.275474 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.275594 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.275718 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.275841 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.275984 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.276103 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.276226 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.276348 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.276471 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.276604 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.276822 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.277013 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.277125 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.277252 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.277375 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.277510 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.277631 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.277754 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.277876 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.277999 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] federation.caching = True {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.278120 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.278255 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.278375 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.278503 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] federation.driver = sql {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.278625 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] federation.caching = True {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.278748 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.278870 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.279004 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.279132 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] federation.driver = sql {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.279252 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.279252 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.279507 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.279507 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.279739 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.279865 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.279986 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.280108 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.280235 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.280235 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.280475 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.280589 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.280713 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.280844 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] identity.caching = True {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.280964 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.281087 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.281220 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.281348 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.281471 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.281596 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.281718 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] identity.caching = True {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.281844 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.281977 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.282097 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] identity.driver = sql {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.282219 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.282343 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.282465 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.282587 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.282721 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.282840 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.282962 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] identity.driver = sql {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.283094 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.283214 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.283409 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.283541 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.283661 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.283781 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.283899 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.284019 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.284139 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.284272 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.284386 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.284505 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.284624 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.284753 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.284867 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.285004 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.285117 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.285245 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.285361 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.285489 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.285604 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.285735 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.285852 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.285972 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.286101 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.286217 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.286347 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.286463 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.286581 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.286700 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.286818 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.286940 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.287067 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.287183 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.287320 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.287447 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.287640 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.287755 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.287896 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.288112 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.288311 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.288435 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.288558 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.288680 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.288819 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.288937 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.289060 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.289180 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.289302 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.289424 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.289565 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.289681 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.289804 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.289931 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.290052 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] ldap.password = **** {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.290174 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.290308 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.290426 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.290561 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.290692 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.290819 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.290939 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] ldap.password = **** {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.291072 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.291193 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.291342 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.291466 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.291585 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.291705 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.291845 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.291963 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.292072 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.292183 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.292297 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.292408 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.292532 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.292649 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.292772 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.292894 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.293015 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.293137 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.293269 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.293387 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.293509 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.293630 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.293752 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] ldap.user = None {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.293878 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.294011 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.294131 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.294131 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.294358 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.294480 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] ldap.user = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.294600 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.294733 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.294852 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.294973 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.295095 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.295225 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.295445 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.295576 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.295700 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.295867 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.295979 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.296101 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.296223 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.296358 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.296478 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.296599 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.296720 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.296841 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.296962 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.297095 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.297216 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.297344 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.297466 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.297589 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.297711 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.297845 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.297964 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.298085 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.298214 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.298333 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.298455 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.298455 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.298692 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.298813 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.298935 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.299061 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.299181 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.299333 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.299458 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.299581 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.299701 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.299822 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.299949 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.300087 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.300203 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.300324 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.300445 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.300567 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] policy.driver = sql {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.300688 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.300904 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.301017 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.301140 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.301261 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.301383 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.301506 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] policy.driver = sql {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.301641 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] receipt.caching = True {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.301759 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.301882 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.302004 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.302127 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.302250 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.302383 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.302502 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] receipt.caching = True {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.302630 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.302753 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.302873 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.303008 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.303126 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] resource.caching = True {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.303865 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.303978 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.304104 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.304225 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] resource.driver = sql {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.304365 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.304481 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.304603 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] resource.caching = True {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.304726 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.304853 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.304975 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.305108 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] resource.driver = sql {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.305227 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] revoke.caching = True {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.305350 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.305471 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.305593 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.305714 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.305847 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.305967 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] role.cache_time = None {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.306089 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] revoke.caching = True {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.306211 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] role.caching = True {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.306331 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.306453 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] role.driver = sql {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.306591 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.306710 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] role.list_limit = None {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.306831 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] role.cache_time = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.306954 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.307078 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] role.caching = True {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.307200 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.307359 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] role.driver = sql {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.307482 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.307606 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] role.list_limit = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.307726 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.307847 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.307970 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.308104 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.308222 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.308348 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.308467 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.308590 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.308710 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.308845 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.308963 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.309085 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.309206 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.309329 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.309450 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.309584 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.309702 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.309827 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.309955 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.310076 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.310076 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.310314 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.310436 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.310558 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.310681 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.310803 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.310803 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.311046 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.311167 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.311289 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.311492 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.311691 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.311824 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.311824 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.312098 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.312219 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.312340 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.312463 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.312598 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.312718 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.312841 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.312963 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.313086 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.313208 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.313346 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.313467 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.313590 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.313722 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.313842 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.313964 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.314098 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.314218 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.314340 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.314462 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.314606 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.314724 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] token.cache_time = None {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.314859 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.314991 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] token.caching = True {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.314991 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.315208 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.315348 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] token.provider = fernet {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.315474 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.315615 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.315733 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.315733 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] token.cache_time = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.315959 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.316080 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] token.caching = True {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.316202 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.316336 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.316456 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.316579 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] token.provider = fernet {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.316705 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.316828 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.316951 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.317084 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.317202 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] trust.driver = sql {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.317202 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.317430 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.317551 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.317671 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.317804 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.317922 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.318239 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.318367 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.318490 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.318618 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] trust.driver = sql {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.318759 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.319002 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.319675 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.319800 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.319800 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.320019 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.320155 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.320272 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] database.connection = **** {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.320406 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.320543 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.320659 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.320781 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.320904 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.321043 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.321164 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.321288 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.321288 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.321517 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] database.connection = **** {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.321653 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.321784 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.321903 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.322129 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.322246 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.322369 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.322501 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.322622 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.322751 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.322885 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.323005 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.323131 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.323253 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.323406 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.323521 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.323665 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.323782 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.323906 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.324027 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.324150 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.324275 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.324409 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.324535 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.324659 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.324790 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.324916 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.325037 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 14 17:35:51.325174 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.325174 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.325174 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.325174 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.325174 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:35:51.325174 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 14 17:35:51.438189 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=87019) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 17:35:51.438367 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=87019) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 17:35:51.438554 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=87019) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 17:35:51.439072 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=87018) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 17:35:51.439328 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=87018) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 17:35:51.439569 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=87018) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 17:35:51.448171 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=87019) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 17:35:51.449137 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=87018) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 17:35:51.477261 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=87019) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 17:35:51.477526 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=87019) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 17:35:51.477878 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=87018) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 17:35:51.478118 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=87018) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 17:35:51.533439 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=87018) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 17:35:51.534211 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=87019) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 17:35:51.583889 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=87018) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 17:35:51.584246 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=87018) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 17:35:51.585492 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=87019) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 17:35:51.585729 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=87019) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 17:35:51.653693 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87018) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 17:35:51.653966 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87019) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 17:35:51.654134 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=87018) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 17:35:51.654274 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=87019) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 17:35:51.654420 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=87018) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 17:35:51.654552 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=87019) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 17:35:51.654680 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=87018) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 17:35:51.654812 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=87019) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 17:35:51.654991 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=87018) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 17:35:51.655120 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=87019) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 17:35:51.655252 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=87018) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 17:35:51.655448 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=87019) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 17:35:51.679999 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87019) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 17:35:51.680325 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87018) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 17:35:51.680509 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=87019) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 17:35:51.680673 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=87018) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 17:35:51.680835 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=87019) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 17:35:51.680995 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=87018) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 17:35:51.681165 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=87019) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 17:35:51.681322 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=87018) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 17:35:51.681477 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=87019) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 17:35:51.681631 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=87018) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 17:35:51.681783 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=87019) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 17:35:51.681946 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=87018) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 17:35:51.682100 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87019) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 17:35:51.682285 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87018) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 17:35:51.693193 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=87019) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 17:35:51.693485 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=87018) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 17:35:51.706988 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87019) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 17:35:51.707267 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87018) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 17:35:51.707434 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=87019) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 17:35:51.707589 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=87018) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 17:35:51.707727 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=87019) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 17:35:51.707855 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=87018) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 17:35:51.707996 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=87019) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 17:35:51.707996 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=87019) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 17:35:51.708253 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=87018) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 17:35:51.708384 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=87019) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 17:35:51.708510 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=87018) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 17:35:51.708648 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87019) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 17:35:51.708773 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=87018) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 17:35:51.708897 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87018) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 17:35:51.726751 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.727012 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 14 17:35:51.727325 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.727537 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 14 17:35:51.727696 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=87018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.727895 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=87018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 14 17:35:51.728026 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.728277 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.728416 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=87018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.728542 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.728668 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=87018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 14 17:35:51.728796 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.729130 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=87018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.729439 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=87018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.729744 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=87018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.730047 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=87018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.739727 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.740012 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.740284 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.740567 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.741539 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=87018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.741872 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=87018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.742191 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=87018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.742541 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=87018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.748798 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=87019) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 14 17:35:51.750919 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=87018) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 14 17:35:51.752260 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=87019) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 14 17:35:51.752544 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.752830 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.753114 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.753402 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.753668 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.753937 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.754210 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.754479 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.754752 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.754881 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=87018) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 14 17:35:51.755019 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.755511 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=87018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.755840 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=87018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.756170 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=87018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.757078 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=87018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.757346 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=87018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.757664 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=87018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.757986 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=87018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.758307 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=87018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.758631 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=87018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.758950 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=87018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.783799 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.785066 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=87019) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 14 17:35:51.785402 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.786373 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=87018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.788108 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=87018) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 14 17:35:51.788396 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=87018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.790517 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=87019) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 14 17:35:51.790802 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.791086 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.793678 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=87018) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 14 17:35:51.793959 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=87018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.794239 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=87018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.798584 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=87019) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 14 17:35:51.798876 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.801672 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=87018) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 14 17:35:51.801987 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=87018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.803451 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=87019) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 14 17:35:51.803791 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.804260 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.804551 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.804835 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.805117 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.805396 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.805672 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.806984 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=87018) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 14 17:35:51.807355 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=87018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.807692 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=87018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.808017 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=87018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.808337 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=87018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.808652 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=87018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.808964 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=87018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.809274 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=87018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.825136 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.825427 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.829304 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=87018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.829637 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=87018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.829983 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=87019) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 14 17:35:51.833635 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.833936 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.834575 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=87018) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 14 17:35:51.838877 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=87018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.839218 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=87018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.840349 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=87019) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 14 17:35:51.844101 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=87019) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 14 17:35:51.844545 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=87018) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 14 17:35:51.847797 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.848102 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.848390 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.848602 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=87018) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 14 17:35:51.848687 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.848949 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.849239 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.852452 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=87018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.852805 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=87018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.853135 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=87018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.853468 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=87018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.853794 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=87018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.854132 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=87018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.869570 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=87019) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 14 17:35:51.869869 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.870144 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.870416 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.874616 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=87018) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 14 17:35:51.874969 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=87018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.875291 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=87018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.875644 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=87018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.878475 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.880518 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.880806 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.884548 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=87019) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 14 17:35:51.884715 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=87018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.884842 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.886338 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=87018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.886612 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.886780 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=87018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.886910 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.887200 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.889775 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=87018) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 14 17:35:51.890064 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=87018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.891888 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=87018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.892187 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=87018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.892471 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=87018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.901650 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=87019) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 14 17:35:51.901941 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.902222 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.902506 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.902790 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.903070 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.903372 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.906529 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=87018) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 14 17:35:51.906951 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=87018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.907266 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=87018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.907682 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=87018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.907870 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=87018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.908120 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=87018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.908410 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=87018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.922069 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=87019) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 14 17:35:51.925396 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=87019) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 14 17:35:51.927101 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=87018) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 14 17:35:51.928768 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.930465 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=87018) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 14 17:35:51.930612 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.932363 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=87019) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 14 17:35:51.932647 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.932933 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.933816 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=87018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.935468 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=87018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.937250 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=87018) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 14 17:35:51.937530 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=87018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.937811 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=87018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.940266 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.941901 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=87019) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 14 17:35:51.945299 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=87018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.945472 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.945769 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.946057 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.946338 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.947168 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=87018) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 14 17:35:51.950541 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=87018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.950893 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=87018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.951237 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=87018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.951598 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=87018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.955786 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=87019) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 14 17:35:51.956095 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.956381 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.961907 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=87018) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 14 17:35:51.962291 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=87018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.962634 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=87018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.965255 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=87019) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 14 17:35:51.965544 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.965832 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.966113 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.966401 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.966688 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.966966 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.967249 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.967558 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.967939 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.968217 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.968498 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.968773 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.969036 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.971557 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=87018) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 14 17:35:51.971843 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=87018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.972129 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=87018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.972418 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=87018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.972706 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=87018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.972990 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=87018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.973263 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=87018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.973543 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=87018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.973823 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=87018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.974199 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=87018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.974476 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=87018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.974751 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=87018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.975024 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=87018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:51.976013 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=87018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:35:52.007990 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55916b0589c0 pid: 87019 (default app) Jun 14 17:35:52.011576 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86084d1-a191-4c6a-895b-4529e400226d None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:35:52.011881 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86084d1-a191-4c6a-895b-4529e400226d None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:35:52.012169 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86084d1-a191-4c6a-895b-4529e400226d None None] PATH_INFO: `/v3` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:35:52.014697 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55916b0589c0 pid: 87018 (default app) Jun 14 17:35:52.016453 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1/1] 10.222.0.36 () {50 vars in 791 bytes} [Tue Jun 14 17:35:52 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:36:00.908330 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019f7e9c-8c77-4c4c-b5f9-86c88b7a186d None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:00.908772 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019f7e9c-8c77-4c4c-b5f9-86c88b7a186d None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:00.908903 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019f7e9c-8c77-4c4c-b5f9-86c88b7a186d None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:00.913862 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1/2] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:36:00 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 14 17:36:00.919397 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a373197-492f-4393-908b-3a1c05ca8e06 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:00.919840 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a373197-492f-4393-908b-3a1c05ca8e06 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:00.919972 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a373197-492f-4393-908b-3a1c05ca8e06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:00.990566 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: INFO dbcounter [None req-1a373197-492f-4393-908b-3a1c05ca8e06 None None] Registered counter for database keystone Jun 14 17:36:01.012363 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG oslo_db.sqlalchemy.engines [None req-1a373197-492f-4393-908b-3a1c05ca8e06 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87019) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 14 17:36:01.018767 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writer thread running {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 14 17:36:01.200881 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG passlib.handlers.bcrypt [None req-1a373197-492f-4393-908b-3a1c05ca8e06 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=87019) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 14 17:36:01.201307 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG passlib.handlers.bcrypt [None req-1a373197-492f-4393-908b-3a1c05ca8e06 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=87019) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 14 17:36:01.256605 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-1a373197-492f-4393-908b-3a1c05ca8e06 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:36:01.258426 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-1a373197-492f-4393-908b-3a1c05ca8e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:36:01.382635 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 2/3] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:36:00 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 464 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 14 17:36:01.531021 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019f7e9c-8c77-4c4c-b5f9-86c88b7a186d None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:01.603021 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: INFO dbcounter [None req-019f7e9c-8c77-4c4c-b5f9-86c88b7a186d None None] Registered counter for database keystone Jun 14 17:36:01.623087 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG oslo_db.sqlalchemy.engines [None req-019f7e9c-8c77-4c4c-b5f9-86c88b7a186d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87018) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 14 17:36:01.629350 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writer thread running {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 14 17:36:01.752789 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019f7e9c-8c77-4c4c-b5f9-86c88b7a186d None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:01.758293 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05a922f-707d-45ac-b06b-ee53aaf8d5ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:01.758976 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05a922f-707d-45ac-b06b-ee53aaf8d5ca admin admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:01.759271 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05a922f-707d-45ac-b06b-ee53aaf8d5ca admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:01.759591 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05a922f-707d-45ac-b06b-ee53aaf8d5ca admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:01.768028 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05a922f-707d-45ac-b06b-ee53aaf8d5ca admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:01.820741 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: WARNING keystone.common.rbac_enforcer.enforcer [None req-f05a922f-707d-45ac-b06b-ee53aaf8d5ca admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 14 17:36:01.821014 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05a922f-707d-45ac-b06b-ee53aaf8d5ca admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:01.831478 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 2/4] 10.222.0.36 () {58 vars in 1324 bytes} [Tue Jun 14 17:36:01 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 14 17:36:01.837863 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a373197-492f-4393-908b-3a1c05ca8e06 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:01.855143 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a373197-492f-4393-908b-3a1c05ca8e06 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:01.859542 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75519e7a-f7e3-4df8-bc1a-2eb3a4e7b706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:01.860656 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75519e7a-f7e3-4df8-bc1a-2eb3a4e7b706 admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:01.860947 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75519e7a-f7e3-4df8-bc1a-2eb3a4e7b706 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:01.861228 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75519e7a-f7e3-4df8-bc1a-2eb3a4e7b706 admin admin] PATH_INFO: `/v3/projects/f37a5c2ee2664dafb5a29dda0a1fc6e2` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:01.862728 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75519e7a-f7e3-4df8-bc1a-2eb3a4e7b706 admin admin] RBAC: Authorizing `identity:get_project(project_id=f37a5c2ee2664dafb5a29dda0a1fc6e2)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:01.915726 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: WARNING keystone.common.rbac_enforcer.enforcer [None req-75519e7a-f7e3-4df8-bc1a-2eb3a4e7b706 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 14 17:36:01.916078 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75519e7a-f7e3-4df8-bc1a-2eb3a4e7b706 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:01.920869 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 3/5] 10.222.0.36 () {56 vars in 1207 bytes} [Tue Jun 14 17:36:01 2022] GET /identity/v3/projects/f37a5c2ee2664dafb5a29dda0a1fc6e2 => generated 344 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:36:04.045504 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561937b4-245e-4706-9add-8a5a156d463b None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:04.046085 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561937b4-245e-4706-9add-8a5a156d463b None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:04.046085 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561937b4-245e-4706-9add-8a5a156d463b None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:04.050243 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 3/6] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:36:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 14 17:36:04.055991 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31f24a6-2c84-413a-9d99-20a0791f5611 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:04.056449 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31f24a6-2c84-413a-9d99-20a0791f5611 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:04.056552 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31f24a6-2c84-413a-9d99-20a0791f5611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:04.075340 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-e31f24a6-2c84-413a-9d99-20a0791f5611 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:36:04.076886 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-e31f24a6-2c84-413a-9d99-20a0791f5611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:36:04.085726 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 4/7] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:36:04 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jun 14 17:36:04.109048 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561937b4-245e-4706-9add-8a5a156d463b None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:04.121420 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561937b4-245e-4706-9add-8a5a156d463b None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:04.125674 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d617e7-7494-4c28-be87-f4892cfb1646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:04.126320 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d617e7-7494-4c28-be87-f4892cfb1646 admin admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:04.126612 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d617e7-7494-4c28-be87-f4892cfb1646 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:04.126895 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d617e7-7494-4c28-be87-f4892cfb1646 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:04.135661 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d617e7-7494-4c28-be87-f4892cfb1646 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:04.137443 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d617e7-7494-4c28-be87-f4892cfb1646 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:04.146450 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 4/8] 10.222.0.36 () {58 vars in 1324 bytes} [Tue Jun 14 17:36:04 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 14 17:36:04.152829 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31f24a6-2c84-413a-9d99-20a0791f5611 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:04.161898 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31f24a6-2c84-413a-9d99-20a0791f5611 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:04.167080 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e93e78-c3db-465b-a6af-6b50c4c4b38b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:04.167995 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e93e78-c3db-465b-a6af-6b50c4c4b38b admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:04.168283 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e93e78-c3db-465b-a6af-6b50c4c4b38b admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:04.168564 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e93e78-c3db-465b-a6af-6b50c4c4b38b admin admin] PATH_INFO: `/v3/users/bdaeb72186c0489e804154d6d26ae21b` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:04.169963 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e93e78-c3db-465b-a6af-6b50c4c4b38b admin admin] RBAC: Authorizing `identity:get_user(user_id=bdaeb72186c0489e804154d6d26ae21b)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:04.171817 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e93e78-c3db-465b-a6af-6b50c4c4b38b admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:04.173396 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 5/9] 10.222.0.36 () {56 vars in 1198 bytes} [Tue Jun 14 17:36:04 2022] GET /identity/v3/users/bdaeb72186c0489e804154d6d26ae21b => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:36:06.387647 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221a40d4-eab8-465b-a9d0-c2eac137ee5d None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:06.388175 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221a40d4-eab8-465b-a9d0-c2eac137ee5d None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:06.388286 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221a40d4-eab8-465b-a9d0-c2eac137ee5d None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:06.389571 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 5/10] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:36:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:36:06.394944 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81ad333-edc3-4355-833d-36c78207e066 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:06.395393 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81ad333-edc3-4355-833d-36c78207e066 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:06.395555 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81ad333-edc3-4355-833d-36c78207e066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:06.412359 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-d81ad333-edc3-4355-833d-36c78207e066 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:36:06.413642 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-d81ad333-edc3-4355-833d-36c78207e066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:36:06.423536 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2cdb93-6543-40f1-8b48-5835c65da9d9 None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:06.423830 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2cdb93-6543-40f1-8b48-5835c65da9d9 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:06.424124 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2cdb93-6543-40f1-8b48-5835c65da9d9 None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:06.425469 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 6/11] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:36:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 14 17:36:06.431522 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da704a5a-07db-4d50-a357-10a68c025f9a None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:06.431814 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da704a5a-07db-4d50-a357-10a68c025f9a None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:06.432099 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da704a5a-07db-4d50-a357-10a68c025f9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:06.472208 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG passlib.handlers.bcrypt [None req-da704a5a-07db-4d50-a357-10a68c025f9a None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=87018) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 14 17:36:06.472654 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG passlib.handlers.bcrypt [None req-da704a5a-07db-4d50-a357-10a68c025f9a None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=87018) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 14 17:36:06.497170 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 6/12] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:36:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:36:06.519249 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-da704a5a-07db-4d50-a357-10a68c025f9a None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:36:06.520622 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81ad333-edc3-4355-833d-36c78207e066 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:06.520901 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-da704a5a-07db-4d50-a357-10a68c025f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:36:06.544991 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:06.625011 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 7/13] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:36:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 14 17:36:06.629414 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81ad333-edc3-4355-833d-36c78207e066 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:06.651618 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da704a5a-07db-4d50-a357-10a68c025f9a None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:06.664274 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff48eb67-2861-402b-a9f3-8473cf8bef20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:06.665110 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff48eb67-2861-402b-a9f3-8473cf8bef20 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:06.665385 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff48eb67-2861-402b-a9f3-8473cf8bef20 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:06.665670 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff48eb67-2861-402b-a9f3-8473cf8bef20 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:06.677450 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff48eb67-2861-402b-a9f3-8473cf8bef20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:36:06.690508 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-ff48eb67-2861-402b-a9f3-8473cf8bef20 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 17:36:06.690508 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:36:06.690508 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:36:06.690508 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:36:06.690508 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:36:06.690508 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:36:06.690508 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:36:06.690508 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:36:06.690508 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:36:06.690508 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:36:06.690508 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:36:06.690508 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:36:06.690508 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:36:06.690508 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:36:06.690508 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:36:06.690508 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:36:06.691508 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:36:06.691508 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:36:06.691508 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:36:06.691508 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:36:06.691508 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:36:06.691508 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:36:06.691508 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:36:06.691508 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:36:06.691508 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:36:06.691508 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:36:06.691508 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:36:06.691508 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:36:06.691508 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:36:06.691508 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:36:06.691508 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:36:06.691508 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:36:06.692382 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:36:06.692382 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:36:06.692382 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:36:06.692382 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:36:06.692382 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:36:06.692382 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:36:06.692382 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:36:06.692382 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:36:06.692382 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:36:06.692382 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:36:06.692382 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 17:36:06.692382 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:36:06.692382 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 7/14] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jun 14 17:36:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 17:36:06.700273 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff48eb67-2861-402b-a9f3-8473cf8bef20 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:06.763731 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da704a5a-07db-4d50-a357-10a68c025f9a None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:06.766385 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:06.793370 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:06.809033 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f1312a-2627-4fae-8a21-1b0cf6e7cd2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:06.809963 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f1312a-2627-4fae-8a21-1b0cf6e7cd2f None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:06.811382 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f1312a-2627-4fae-8a21-1b0cf6e7cd2f None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:06.811675 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f1312a-2627-4fae-8a21-1b0cf6e7cd2f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:06.818702 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff48eb67-2861-402b-a9f3-8473cf8bef20 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:06.856622 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae922c3-d0ff-4e6a-9404-8f16ac8a8dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:06.857314 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae922c3-d0ff-4e6a-9404-8f16ac8a8dbb None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:06.857600 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae922c3-d0ff-4e6a-9404-8f16ac8a8dbb None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:06.861778 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae922c3-d0ff-4e6a-9404-8f16ac8a8dbb None admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:06.861778 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae922c3-d0ff-4e6a-9404-8f16ac8a8dbb None admin] RBAC: Adding query filter params (name=admin) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:36:06.861778 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae922c3-d0ff-4e6a-9404-8f16ac8a8dbb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:06.861778 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae922c3-d0ff-4e6a-9404-8f16ac8a8dbb None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:06.873484 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 8/15] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 14 17:36:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:36:06.879342 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae922c3-d0ff-4e6a-9404-8f16ac8a8dbb None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:06.897125 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f1312a-2627-4fae-8a21-1b0cf6e7cd2f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:06.898790 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f1312a-2627-4fae-8a21-1b0cf6e7cd2f None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:06.992940 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae922c3-d0ff-4e6a-9404-8f16ac8a8dbb None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:07.025115 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 8/16] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 14 17:36:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 14 17:36:07.030818 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f1312a-2627-4fae-8a21-1b0cf6e7cd2f None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:07.032120 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785b15bd-a831-4aa1-8981-d2dc7679dc6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:07.033102 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785b15bd-a831-4aa1-8981-d2dc7679dc6e None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:07.033390 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785b15bd-a831-4aa1-8981-d2dc7679dc6e None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:07.033672 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785b15bd-a831-4aa1-8981-d2dc7679dc6e None admin] PATH_INFO: `/v3/users/bdaeb72186c0489e804154d6d26ae21b` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:07.034369 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:07.035166 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785b15bd-a831-4aa1-8981-d2dc7679dc6e None admin] RBAC: Authorizing `identity:get_user(user_id=bdaeb72186c0489e804154d6d26ae21b)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:07.036771 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785b15bd-a831-4aa1-8981-d2dc7679dc6e None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:07.039108 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 9/17] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 14 17:36:06 2022] GET /identity/v3/users/bdaeb72186c0489e804154d6d26ae21b => generated 247 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:36:07.046025 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785b15bd-a831-4aa1-8981-d2dc7679dc6e None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:07.064904 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:07.148573 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f1312a-2627-4fae-8a21-1b0cf6e7cd2f None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:07.158168 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785b15bd-a831-4aa1-8981-d2dc7679dc6e None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:07.190453 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcf9943-37dd-4657-8398-0a60545e75a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:07.191310 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf9943-37dd-4657-8398-0a60545e75a8 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:07.191639 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf9943-37dd-4657-8398-0a60545e75a8 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:07.191923 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf9943-37dd-4657-8398-0a60545e75a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:07.197116 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d003eb2-aa4b-4b79-988c-92b86f5d736b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:07.197933 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d003eb2-aa4b-4b79-988c-92b86f5d736b None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:07.198226 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d003eb2-aa4b-4b79-988c-92b86f5d736b None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:07.198511 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d003eb2-aa4b-4b79-988c-92b86f5d736b None admin] PATH_INFO: `/v3/domains/default` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:07.199772 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d003eb2-aa4b-4b79-988c-92b86f5d736b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:07.201478 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d003eb2-aa4b-4b79-988c-92b86f5d736b None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:07.203165 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 10/18] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 14 17:36:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:36:07.209938 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d003eb2-aa4b-4b79-988c-92b86f5d736b None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:07.215702 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcf9943-37dd-4657-8398-0a60545e75a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:07.217258 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcf9943-37dd-4657-8398-0a60545e75a8 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:07.239643 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-fbcf9943-37dd-4657-8398-0a60545e75a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:36:07.239643 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:36:07.239643 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:36:07.239643 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:36:07.239643 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:36:07.239643 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:36:07.239643 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:36:07.239643 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:36:07.239643 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:36:07.239643 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:36:07.239643 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:36:07.239643 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:36:07.239643 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:36:07.239643 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:36:07.239643 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:36:07.240650 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:36:07.240650 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:36:07.240650 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:36:07.240650 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:36:07.240650 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:36:07.240650 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:36:07.240650 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:36:07.240650 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:36:07.240650 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:36:07.240650 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:36:07.240650 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:36:07.240650 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:36:07.240650 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:36:07.240650 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:36:07.240650 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:36:07.240650 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:36:07.240650 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:36:07.241622 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:36:07.241622 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:36:07.241622 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:36:07.241622 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:36:07.241622 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 9/19] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 14 17:36:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 17:36:07.247636 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcf9943-37dd-4657-8398-0a60545e75a8 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:07.298418 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:07.317816 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:07.320741 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d003eb2-aa4b-4b79-988c-92b86f5d736b None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:07.360992 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8879a8-f7ba-43db-9fa3-8861d676031e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:07.361759 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8879a8-f7ba-43db-9fa3-8861d676031e None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:07.362051 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8879a8-f7ba-43db-9fa3-8861d676031e None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:07.362332 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8879a8-f7ba-43db-9fa3-8861d676031e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:07.363194 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8879a8-f7ba-43db-9fa3-8861d676031e None admin] RBAC: Adding query filter params (role.id=1348580877d04014bfdec4d866b98a74, scope.domain.id=default, user.id=bdaeb72186c0489e804154d6d26ae21b) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:36:07.363551 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8879a8-f7ba-43db-9fa3-8861d676031e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:07.365013 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8879a8-f7ba-43db-9fa3-8861d676031e None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:07.370857 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcf9943-37dd-4657-8398-0a60545e75a8 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:07.372943 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 11/20] 10.222.0.36 () {56 vars in 1322 bytes} [Tue Jun 14 17:36:07 2022] GET /identity/v3/role_assignments?user.id=bdaeb72186c0489e804154d6d26ae21b&scope.domain.id=default&role.id=1348580877d04014bfdec4d866b98a74 => generated 233 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:36:07.414838 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e029d80-e001-4336-a6a6-b2e006678fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:07.415615 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e029d80-e001-4336-a6a6-b2e006678fe4 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:07.415910 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e029d80-e001-4336-a6a6-b2e006678fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:07.416200 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e029d80-e001-4336-a6a6-b2e006678fe4 None admin] PATH_INFO: `/v3/domains` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:07.416972 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e029d80-e001-4336-a6a6-b2e006678fe4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:36:07.417290 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e029d80-e001-4336-a6a6-b2e006678fe4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:07.418868 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e029d80-e001-4336-a6a6-b2e006678fe4 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:07.441522 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 10/21] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 14 17:36:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:36:09.854532 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c44b4-edf9-434f-8a39-0dbd1dae5ba5 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:09.855036 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c44b4-edf9-434f-8a39-0dbd1dae5ba5 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:09.855143 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c44b4-edf9-434f-8a39-0dbd1dae5ba5 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:09.856828 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 12/22] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:36:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:36:09.862028 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd86704b-9843-4aae-82de-847139ccdc20 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:09.862479 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd86704b-9843-4aae-82de-847139ccdc20 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:09.862580 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd86704b-9843-4aae-82de-847139ccdc20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:09.884405 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-cd86704b-9843-4aae-82de-847139ccdc20 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:36:09.885626 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-cd86704b-9843-4aae-82de-847139ccdc20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:36:10.042663 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 11/23] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:36:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:36:10.097290 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948c44b4-edf9-434f-8a39-0dbd1dae5ba5 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:10.245544 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4076d187-2f90-4183-89f3-a852188fb76c None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:10.246199 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4076d187-2f90-4183-89f3-a852188fb76c None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:10.246638 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4076d187-2f90-4183-89f3-a852188fb76c None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:10.248195 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 12/24] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:36:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:36:10.265089 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d704926f-2fee-4d3a-93e2-42bf698c8e84 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:10.265618 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d704926f-2fee-4d3a-93e2-42bf698c8e84 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:10.266028 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d704926f-2fee-4d3a-93e2-42bf698c8e84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:10.300566 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-d704926f-2fee-4d3a-93e2-42bf698c8e84 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:36:10.304512 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-d704926f-2fee-4d3a-93e2-42bf698c8e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:36:10.319679 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948c44b4-edf9-434f-8a39-0dbd1dae5ba5 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:10.429350 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:10.453450 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 13/25] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:36:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 14 17:36:10.456798 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aab8ac1-af39-4a4b-85d8-b11b748ba0dd None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:10.458126 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b909d614-e30e-4a3b-a3e2-2593aba21f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:10.459236 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b909d614-e30e-4a3b-a3e2-2593aba21f12 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:10.460548 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aab8ac1-af39-4a4b-85d8-b11b748ba0dd None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:10.460984 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aab8ac1-af39-4a4b-85d8-b11b748ba0dd None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:10.461412 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b909d614-e30e-4a3b-a3e2-2593aba21f12 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:10.463481 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b909d614-e30e-4a3b-a3e2-2593aba21f12 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:10.467705 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 14/26] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:36:10 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:36:10.469574 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f9eabd-3501-4d61-acb3-4a282154b5e4 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:10.471548 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f9eabd-3501-4d61-acb3-4a282154b5e4 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:10.472060 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f9eabd-3501-4d61-acb3-4a282154b5e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:10.504035 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b909d614-e30e-4a3b-a3e2-2593aba21f12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:36:10.512811 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-b909d614-e30e-4a3b-a3e2-2593aba21f12 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 17:36:10.512811 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:36:10.512811 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:36:10.512811 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:36:10.512811 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:36:10.512811 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:36:10.512811 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:36:10.512811 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:36:10.512811 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:36:10.512811 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:36:10.512811 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:36:10.512811 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:36:10.512811 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:36:10.512811 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:36:10.512811 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:36:10.512811 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:36:10.513661 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:36:10.513661 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:36:10.513661 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:36:10.513661 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:36:10.513661 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:36:10.513661 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:36:10.513661 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:36:10.513661 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:36:10.513661 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:36:10.513661 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:36:10.513661 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:36:10.513661 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:36:10.513661 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:36:10.513661 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:36:10.513661 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:36:10.513661 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:36:10.514425 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:36:10.514425 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:36:10.514425 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:36:10.514425 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:36:10.514425 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:36:10.514425 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:36:10.514425 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:36:10.514425 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:36:10.514425 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:36:10.514425 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:36:10.514425 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 17:36:10.514425 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:36:10.516768 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-16f9eabd-3501-4d61-acb3-4a282154b5e4 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:36:10.517535 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 13/27] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jun 14 17:36:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 421 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:36:10.518100 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-16f9eabd-3501-4d61-acb3-4a282154b5e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:36:10.518812 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b909d614-e30e-4a3b-a3e2-2593aba21f12 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:10.535368 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:10.789287 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b909d614-e30e-4a3b-a3e2-2593aba21f12 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:10.789843 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 15/28] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:36:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:36:10.790941 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f9eabd-3501-4d61-acb3-4a282154b5e4 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:10.854897 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0d8ed4-a2ed-4244-9a22-d72c53f435d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:10.856231 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0d8ed4-a2ed-4244-9a22-d72c53f435d0 None admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:10.856818 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0d8ed4-a2ed-4244-9a22-d72c53f435d0 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:10.857327 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0d8ed4-a2ed-4244-9a22-d72c53f435d0 None admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:10.859059 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0d8ed4-a2ed-4244-9a22-d72c53f435d0 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:10.861411 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0d8ed4-a2ed-4244-9a22-d72c53f435d0 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:10.907882 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f9eabd-3501-4d61-acb3-4a282154b5e4 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:10.918041 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:10.946168 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db51696f-71e5-4fa7-81c5-3741d39c5079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:10.946897 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db51696f-71e5-4fa7-81c5-3741d39c5079 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:10.947189 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db51696f-71e5-4fa7-81c5-3741d39c5079 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:10.947507 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db51696f-71e5-4fa7-81c5-3741d39c5079 None admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:10.948267 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db51696f-71e5-4fa7-81c5-3741d39c5079 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:36:10.948580 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db51696f-71e5-4fa7-81c5-3741d39c5079 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:10.949982 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db51696f-71e5-4fa7-81c5-3741d39c5079 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:10.962944 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 16/29] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 14 17:36:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:36:10.967692 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1cc2c3-608d-4d81-b5c2-f426a1bb4b5d None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:10.967692 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1cc2c3-608d-4d81-b5c2-f426a1bb4b5d None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:10.967692 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1cc2c3-608d-4d81-b5c2-f426a1bb4b5d None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:10.967692 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 17/30] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:36:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:36:10.967692 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1cc2c3-608d-4d81-b5c2-f426a1bb4b5d None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:11.090849 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1cc2c3-608d-4d81-b5c2-f426a1bb4b5d None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:11.099919 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 14/31] 10.222.0.36 () {60 vars in 1131 bytes} [Tue Jun 14 17:36:10 2022] POST /identity/v3/roles => generated 219 bytes in 575 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:36:11.101349 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0d8ed4-a2ed-4244-9a22-d72c53f435d0 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:11.134693 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f5e938-200d-4e78-822d-deaf852e89f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:11.135955 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f5e938-200d-4e78-822d-deaf852e89f2 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:11.136444 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f5e938-200d-4e78-822d-deaf852e89f2 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:11.136969 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f5e938-200d-4e78-822d-deaf852e89f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:11.151859 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f5e938-200d-4e78-822d-deaf852e89f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:11.153727 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f5e938-200d-4e78-822d-deaf852e89f2 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:11.175034 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-96f5e938-200d-4e78-822d-deaf852e89f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:36:11.175034 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:36:11.175034 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:36:11.175034 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:36:11.175034 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:36:11.175034 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:36:11.175034 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:36:11.175034 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:36:11.175034 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:36:11.175034 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:36:11.175034 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:36:11.175034 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:36:11.175034 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:36:11.175034 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:36:11.175034 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:36:11.175959 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:36:11.175959 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:36:11.175959 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:36:11.175959 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:36:11.175959 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:36:11.175959 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:36:11.175959 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:36:11.175959 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:36:11.175959 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:36:11.175959 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:36:11.175959 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:36:11.175959 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:36:11.175959 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:36:11.175959 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:36:11.175959 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:36:11.175959 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:36:11.175959 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:36:11.176753 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:36:11.176753 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:36:11.176753 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:36:11.176753 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:36:11.179511 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 18/32] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 14 17:36:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:36:11.181207 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d3d5e3-4adc-4e33-a9fc-ad8dc7f043a6 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:11.181727 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d3d5e3-4adc-4e33-a9fc-ad8dc7f043a6 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:11.182194 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d3d5e3-4adc-4e33-a9fc-ad8dc7f043a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:11.202672 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-d5d3d5e3-4adc-4e33-a9fc-ad8dc7f043a6 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:36:11.204362 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-d5d3d5e3-4adc-4e33-a9fc-ad8dc7f043a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:36:11.223320 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:11.294853 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 19/33] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:36:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:36:11.296194 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d3d5e3-4adc-4e33-a9fc-ad8dc7f043a6 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:11.456964 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d3d5e3-4adc-4e33-a9fc-ad8dc7f043a6 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:11.475824 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:11.498642 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0d8ed4-a2ed-4244-9a22-d72c53f435d0 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:11.509488 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720e9a63-3db0-4de6-bcaa-4e693906a23e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:11.510559 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720e9a63-3db0-4de6-bcaa-4e693906a23e None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:11.510852 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720e9a63-3db0-4de6-bcaa-4e693906a23e None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:11.511476 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720e9a63-3db0-4de6-bcaa-4e693906a23e None admin] PATH_INFO: `/v3/domains` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:11.512507 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720e9a63-3db0-4de6-bcaa-4e693906a23e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:36:11.512828 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720e9a63-3db0-4de6-bcaa-4e693906a23e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:11.515083 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720e9a63-3db0-4de6-bcaa-4e693906a23e None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:11.531576 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 20/34] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 14 17:36:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:36:11.532446 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720e9a63-3db0-4de6-bcaa-4e693906a23e None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:11.545003 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05eebd0-8fba-4236-aea6-e03341efa6ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:11.545915 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05eebd0-8fba-4236-aea6-e03341efa6ba None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:11.546208 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05eebd0-8fba-4236-aea6-e03341efa6ba None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:11.546496 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05eebd0-8fba-4236-aea6-e03341efa6ba None admin] PATH_INFO: `/v3/users/bdaeb72186c0489e804154d6d26ae21b` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:11.548002 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05eebd0-8fba-4236-aea6-e03341efa6ba None admin] RBAC: Authorizing `identity:get_user(user_id=bdaeb72186c0489e804154d6d26ae21b)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:11.549664 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05eebd0-8fba-4236-aea6-e03341efa6ba None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:11.552144 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:11.552941 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 15/35] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 14 17:36:11 2022] GET /identity/v3/users/bdaeb72186c0489e804154d6d26ae21b => generated 247 bytes in 452 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:36:11.554040 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05eebd0-8fba-4236-aea6-e03341efa6ba None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:11.677852 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720e9a63-3db0-4de6-bcaa-4e693906a23e None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:11.697127 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05eebd0-8fba-4236-aea6-e03341efa6ba None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:11.733440 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cac8de-32f5-4f58-9eb2-df3c08c70422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:11.734697 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cac8de-32f5-4f58-9eb2-df3c08c70422 None admin] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:11.735050 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cac8de-32f5-4f58-9eb2-df3c08c70422 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:11.735439 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cac8de-32f5-4f58-9eb2-df3c08c70422 None admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:11.736367 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cac8de-32f5-4f58-9eb2-df3c08c70422 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:11.738015 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cac8de-32f5-4f58-9eb2-df3c08c70422 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:11.743055 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:11.749648 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe77a99-e20f-436e-8298-ba968f77dae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:11.750598 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe77a99-e20f-436e-8298-ba968f77dae6 None admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:11.751049 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe77a99-e20f-436e-8298-ba968f77dae6 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:11.751572 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe77a99-e20f-436e-8298-ba968f77dae6 None admin] PATH_INFO: `/v3/projects` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:11.758084 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe77a99-e20f-436e-8298-ba968f77dae6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:11.758084 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe77a99-e20f-436e-8298-ba968f77dae6 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:11.854066 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 16/36] 10.222.0.36 () {60 vars in 1141 bytes} [Tue Jun 14 17:36:11 2022] POST /identity/v3/projects => generated 301 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:36:11.854910 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe77a99-e20f-436e-8298-ba968f77dae6 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:11.992900 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe77a99-e20f-436e-8298-ba968f77dae6 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:12.033383 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb01abc1-90f8-48dd-9bfa-9a0ecae67f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:12.034277 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb01abc1-90f8-48dd-9bfa-9a0ecae67f19 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:12.034550 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb01abc1-90f8-48dd-9bfa-9a0ecae67f19 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:12.034833 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb01abc1-90f8-48dd-9bfa-9a0ecae67f19 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:12.036106 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb01abc1-90f8-48dd-9bfa-9a0ecae67f19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:12.036741 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 21/37] 10.222.0.36 () {60 vars in 1131 bytes} [Tue Jun 14 17:36:11 2022] POST /identity/v3/roles => generated 225 bytes in 505 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:36:12.038444 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb01abc1-90f8-48dd-9bfa-9a0ecae67f19 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:12.038840 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd2744d-deed-415e-aaf1-05815c182ceb None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:12.039139 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd2744d-deed-415e-aaf1-05815c182ceb None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:12.039456 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd2744d-deed-415e-aaf1-05815c182ceb None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:12.040223 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 17/38] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 14 17:36:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:36:12.040994 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 22/39] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:36:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:36:12.041635 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e12c0-1f18-41be-8e54-a0e06f9a7b81 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:12.045465 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e12c0-1f18-41be-8e54-a0e06f9a7b81 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:12.045465 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e12c0-1f18-41be-8e54-a0e06f9a7b81 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:12.045465 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 18/40] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:36:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:36:12.048887 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8e12c0-1f18-41be-8e54-a0e06f9a7b81 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:12.049115 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee4a8ad-da31-4867-b70b-e685c0c68690 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:12.049534 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee4a8ad-da31-4867-b70b-e685c0c68690 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:12.049945 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee4a8ad-da31-4867-b70b-e685c0c68690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:12.075350 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-4ee4a8ad-da31-4867-b70b-e685c0c68690 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:36:12.077143 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-4ee4a8ad-da31-4867-b70b-e685c0c68690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:36:12.127721 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:12.168788 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:12.179347 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 23/41] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:36:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 14 17:36:12.180643 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d165af-283b-4b05-94e5-d39479657f8b None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:12.180940 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d165af-283b-4b05-94e5-d39479657f8b None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:12.181224 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d165af-283b-4b05-94e5-d39479657f8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:12.192104 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8e12c0-1f18-41be-8e54-a0e06f9a7b81 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:12.202018 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-86d165af-283b-4b05-94e5-d39479657f8b None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:36:12.205904 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-86d165af-283b-4b05-94e5-d39479657f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:36:12.241373 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b699bb7c-c4b1-474f-9897-5150b8e6e290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:12.242282 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b699bb7c-c4b1-474f-9897-5150b8e6e290 None admin] REQUEST_METHOD: `PUT` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:12.242571 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b699bb7c-c4b1-474f-9897-5150b8e6e290 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:12.242855 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b699bb7c-c4b1-474f-9897-5150b8e6e290 None admin] PATH_INFO: `/v3/domains/default/users/bdaeb72186c0489e804154d6d26ae21b/roles/1348580877d04014bfdec4d866b98a74` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:12.245295 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b699bb7c-c4b1-474f-9897-5150b8e6e290 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=bdaeb72186c0489e804154d6d26ae21b, role_id=1348580877d04014bfdec4d866b98a74)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:12.246839 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b699bb7c-c4b1-474f-9897-5150b8e6e290 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:12.292136 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 24/42] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:36:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:36:12.293134 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d165af-283b-4b05-94e5-d39479657f8b None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:12.398634 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d165af-283b-4b05-94e5-d39479657f8b None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:12.418394 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 19/43] 10.222.0.36 () {58 vars in 1361 bytes} [Tue Jun 14 17:36:12 2022] PUT /identity/v3/domains/default/users/bdaeb72186c0489e804154d6d26ae21b/roles/1348580877d04014bfdec4d866b98a74 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 17:36:12.419244 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b699bb7c-c4b1-474f-9897-5150b8e6e290 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:12.432446 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:12.440150 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a53f44d-17c2-4f9b-819a-c89d6d5100bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:12.440918 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a53f44d-17c2-4f9b-819a-c89d6d5100bb None admin] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:12.441216 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a53f44d-17c2-4f9b-819a-c89d6d5100bb None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:12.441505 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a53f44d-17c2-4f9b-819a-c89d6d5100bb None admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:12.442300 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a53f44d-17c2-4f9b-819a-c89d6d5100bb None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:12.444744 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a53f44d-17c2-4f9b-819a-c89d6d5100bb None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:12.541743 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 25/44] 10.222.0.36 () {60 vars in 1131 bytes} [Tue Jun 14 17:36:12 2022] POST /identity/v3/roles => generated 223 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:36:12.545688 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b699bb7c-c4b1-474f-9897-5150b8e6e290 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:12.566106 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:12.612216 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131c3f68-7b04-4eaa-839a-972fbf85abb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:12.613684 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131c3f68-7b04-4eaa-839a-972fbf85abb9 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:12.614207 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131c3f68-7b04-4eaa-839a-972fbf85abb9 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:12.614772 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131c3f68-7b04-4eaa-839a-972fbf85abb9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:12.618190 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131c3f68-7b04-4eaa-839a-972fbf85abb9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:12.621157 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131c3f68-7b04-4eaa-839a-972fbf85abb9 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:12.624547 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 20/45] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 14 17:36:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:36:12.633347 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a53f44d-17c2-4f9b-819a-c89d6d5100bb None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:12.787067 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a53f44d-17c2-4f9b-819a-c89d6d5100bb None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:12.823082 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd35dc6-dc25-415f-add9-4852cecb1e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:12.823726 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd35dc6-dc25-415f-add9-4852cecb1e52 None admin] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:12.824020 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd35dc6-dc25-415f-add9-4852cecb1e52 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:12.824309 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd35dc6-dc25-415f-add9-4852cecb1e52 None admin] PATH_INFO: `/v3/projects` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:12.825332 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd35dc6-dc25-415f-add9-4852cecb1e52 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:12.826850 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd35dc6-dc25-415f-add9-4852cecb1e52 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:12.951669 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 26/46] 10.222.0.36 () {60 vars in 1141 bytes} [Tue Jun 14 17:36:12 2022] POST /identity/v3/projects => generated 312 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:36:14.635192 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1154740-dcab-497c-b4db-d399074b43c2 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:14.635790 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1154740-dcab-497c-b4db-d399074b43c2 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:14.635927 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1154740-dcab-497c-b4db-d399074b43c2 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:14.637569 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 21/47] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:36:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:36:14.643620 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe0b689-0fac-45e9-8f11-1ffe34a43fc8 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:14.644105 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe0b689-0fac-45e9-8f11-1ffe34a43fc8 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:14.644231 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe0b689-0fac-45e9-8f11-1ffe34a43fc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:14.661423 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-5fe0b689-0fac-45e9-8f11-1ffe34a43fc8 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:36:14.663267 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-5fe0b689-0fac-45e9-8f11-1ffe34a43fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:36:14.699464 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:14.732890 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 27/48] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:36:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:36:14.756177 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1154740-dcab-497c-b4db-d399074b43c2 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:14.866881 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1154740-dcab-497c-b4db-d399074b43c2 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:14.913500 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48475393-66b8-4f67-8906-1f9417bca963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:14.914435 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48475393-66b8-4f67-8906-1f9417bca963 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:14.914905 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48475393-66b8-4f67-8906-1f9417bca963 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:14.915280 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48475393-66b8-4f67-8906-1f9417bca963 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:14.928234 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48475393-66b8-4f67-8906-1f9417bca963 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:36:14.936480 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-48475393-66b8-4f67-8906-1f9417bca963 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 17:36:14.936480 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:36:14.936480 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:36:14.936480 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:36:14.936480 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:36:14.936480 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:36:14.936480 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:36:14.936480 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:36:14.936480 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:36:14.936480 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:36:14.936480 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:36:14.936480 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:36:14.936480 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:36:14.936480 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:36:14.936480 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:36:14.936480 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:36:14.937416 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:36:14.937416 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:36:14.937416 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:36:14.937416 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:36:14.937416 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:36:14.937416 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:36:14.937416 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:36:14.937416 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:36:14.937416 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:36:14.937416 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:36:14.937416 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:36:14.937416 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:36:14.937416 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:36:14.937416 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:36:14.937416 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:36:14.937416 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:36:14.938172 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:36:14.938172 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:36:14.938172 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:36:14.938172 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:36:14.938172 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:36:14.938172 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:36:14.938172 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:36:14.938172 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:36:14.938172 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:36:14.938172 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:36:14.938172 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 17:36:14.938172 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:36:14.938172 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 22/49] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jun 14 17:36:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:36:14.944280 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe0b689-0fac-45e9-8f11-1ffe34a43fc8 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:15.053743 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe0b689-0fac-45e9-8f11-1ffe34a43fc8 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:15.092332 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58acdd32-5d19-4492-9176-2076c242e7e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:15.093044 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58acdd32-5d19-4492-9176-2076c242e7e2 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:15.093337 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58acdd32-5d19-4492-9176-2076c242e7e2 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:15.093626 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58acdd32-5d19-4492-9176-2076c242e7e2 None admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:15.094407 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58acdd32-5d19-4492-9176-2076c242e7e2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:36:15.094727 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58acdd32-5d19-4492-9176-2076c242e7e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:15.096284 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58acdd32-5d19-4492-9176-2076c242e7e2 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:15.106740 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 28/50] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 14 17:36:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:36:15.112778 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48475393-66b8-4f67-8906-1f9417bca963 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:15.136070 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42206509-f06a-4094-ab25-3c3ca355c162 None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:15.136499 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42206509-f06a-4094-ab25-3c3ca355c162 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:15.136652 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42206509-f06a-4094-ab25-3c3ca355c162 None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:15.138050 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 29/51] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:36:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 14 17:36:15.143738 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5aa10b-4e7a-44c8-a217-5724d98f0321 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:15.143998 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5aa10b-4e7a-44c8-a217-5724d98f0321 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:15.144291 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5aa10b-4e7a-44c8-a217-5724d98f0321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:15.162248 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:15.164107 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-ff5aa10b-4e7a-44c8-a217-5724d98f0321 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:36:15.165363 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-ff5aa10b-4e7a-44c8-a217-5724d98f0321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:36:15.195119 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:15.237759 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48475393-66b8-4f67-8906-1f9417bca963 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:15.243058 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 30/52] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:36:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 14 17:36:15.266434 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5aa10b-4e7a-44c8-a217-5724d98f0321 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:15.276589 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f73931-f821-4990-ae18-f75c9d106d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:15.277496 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f73931-f821-4990-ae18-f75c9d106d8e None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:15.277781 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f73931-f821-4990-ae18-f75c9d106d8e None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:15.278068 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f73931-f821-4990-ae18-f75c9d106d8e None admin] PATH_INFO: `/v3/users/bdaeb72186c0489e804154d6d26ae21b` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:15.279345 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f73931-f821-4990-ae18-f75c9d106d8e None admin] RBAC: Authorizing `identity:get_user(user_id=bdaeb72186c0489e804154d6d26ae21b)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:15.280918 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f73931-f821-4990-ae18-f75c9d106d8e None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:15.282633 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 23/53] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 14 17:36:15 2022] GET /identity/v3/users/bdaeb72186c0489e804154d6d26ae21b => generated 247 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:36:15.290025 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f73931-f821-4990-ae18-f75c9d106d8e None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:15.373301 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5aa10b-4e7a-44c8-a217-5724d98f0321 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:15.411123 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4595f7dd-229b-4c3c-a9c2-9dcd24673d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:15.411971 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4595f7dd-229b-4c3c-a9c2-9dcd24673d22 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:15.413037 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4595f7dd-229b-4c3c-a9c2-9dcd24673d22 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:15.413263 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4595f7dd-229b-4c3c-a9c2-9dcd24673d22 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:15.414490 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4595f7dd-229b-4c3c-a9c2-9dcd24673d22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:15.416014 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4595f7dd-229b-4c3c-a9c2-9dcd24673d22 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:15.417654 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 31/54] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 14 17:36:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:36:15.423233 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4595f7dd-229b-4c3c-a9c2-9dcd24673d22 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:15.431204 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f73931-f821-4990-ae18-f75c9d106d8e None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:15.440369 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:15.456741 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:15.465648 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341761bc-a9ee-4703-9b1c-a42581af2ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:15.467167 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341761bc-a9ee-4703-9b1c-a42581af2ff3 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:15.467167 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341761bc-a9ee-4703-9b1c-a42581af2ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:15.467167 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341761bc-a9ee-4703-9b1c-a42581af2ff3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:15.468366 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341761bc-a9ee-4703-9b1c-a42581af2ff3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:15.469929 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341761bc-a9ee-4703-9b1c-a42581af2ff3 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:15.471598 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 24/55] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 14 17:36:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:36:15.477475 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341761bc-a9ee-4703-9b1c-a42581af2ff3 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:15.531967 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4595f7dd-229b-4c3c-a9c2-9dcd24673d22 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:15.582052 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b70b8c7-1f57-4818-9ecf-71b60246bc84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:15.582279 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341761bc-a9ee-4703-9b1c-a42581af2ff3 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:15.582819 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b70b8c7-1f57-4818-9ecf-71b60246bc84 None admin] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:15.583104 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b70b8c7-1f57-4818-9ecf-71b60246bc84 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:15.583483 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b70b8c7-1f57-4818-9ecf-71b60246bc84 None admin] PATH_INFO: `/v3/projects` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:15.588349 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b70b8c7-1f57-4818-9ecf-71b60246bc84 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:15.589939 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b70b8c7-1f57-4818-9ecf-71b60246bc84 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:15.618823 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01507b32-85da-421c-a461-b54b06519445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:15.619495 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01507b32-85da-421c-a461-b54b06519445 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:15.619785 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01507b32-85da-421c-a461-b54b06519445 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:15.620065 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01507b32-85da-421c-a461-b54b06519445 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:15.620907 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01507b32-85da-421c-a461-b54b06519445 None admin] RBAC: Adding query filter params (role.id=1348580877d04014bfdec4d866b98a74, scope.domain.id=default, user.id=bdaeb72186c0489e804154d6d26ae21b) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:36:15.621223 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01507b32-85da-421c-a461-b54b06519445 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:15.622727 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01507b32-85da-421c-a461-b54b06519445 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:15.628635 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 25/56] 10.222.0.36 () {56 vars in 1322 bytes} [Tue Jun 14 17:36:15 2022] GET /identity/v3/role_assignments?user.id=bdaeb72186c0489e804154d6d26ae21b&scope.domain.id=default&role.id=1348580877d04014bfdec4d866b98a74 => generated 530 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:36:15.718181 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 32/57] 10.222.0.36 () {60 vars in 1140 bytes} [Tue Jun 14 17:36:15 2022] POST /identity/v3/projects => generated 298 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 17:36:17.922911 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531064c2-442b-4e37-bb06-dc2b59f7fc8c None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:17.923411 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531064c2-442b-4e37-bb06-dc2b59f7fc8c None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:17.923520 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531064c2-442b-4e37-bb06-dc2b59f7fc8c None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:17.924938 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 26/58] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:36:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:36:17.930619 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bb9352-55da-49d5-8b95-95f42cb3d022 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:17.931031 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bb9352-55da-49d5-8b95-95f42cb3d022 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:17.931186 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bb9352-55da-49d5-8b95-95f42cb3d022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:17.948562 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-e5bb9352-55da-49d5-8b95-95f42cb3d022 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:36:17.949803 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-e5bb9352-55da-49d5-8b95-95f42cb3d022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:36:18.021918 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 33/59] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:36:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:36:18.047711 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531064c2-442b-4e37-bb06-dc2b59f7fc8c None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:18.096227 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:18.158701 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531064c2-442b-4e37-bb06-dc2b59f7fc8c None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:18.196927 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f59a0f-66d1-4ec7-95f6-265f0b9c6071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:18.197740 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f59a0f-66d1-4ec7-95f6-265f0b9c6071 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:18.198034 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f59a0f-66d1-4ec7-95f6-265f0b9c6071 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:18.198321 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f59a0f-66d1-4ec7-95f6-265f0b9c6071 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:18.199597 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f59a0f-66d1-4ec7-95f6-265f0b9c6071 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:18.201067 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f59a0f-66d1-4ec7-95f6-265f0b9c6071 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:18.202759 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 27/60] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 14 17:36:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:36:18.208359 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bb9352-55da-49d5-8b95-95f42cb3d022 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:18.226944 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:18.317081 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bb9352-55da-49d5-8b95-95f42cb3d022 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:18.359882 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce5d608-7df0-42fd-be67-4d5fc07f2dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:18.360556 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce5d608-7df0-42fd-be67-4d5fc07f2dd0 None admin] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:18.360843 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce5d608-7df0-42fd-be67-4d5fc07f2dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:18.361122 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce5d608-7df0-42fd-be67-4d5fc07f2dd0 None admin] PATH_INFO: `/v3/users` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:18.361843 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce5d608-7df0-42fd-be67-4d5fc07f2dd0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:18.363323 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce5d608-7df0-42fd-be67-4d5fc07f2dd0 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:18.464921 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 34/61] 10.222.0.36 () {60 vars in 1132 bytes} [Tue Jun 14 17:36:18 2022] POST /identity/v3/users => generated 275 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 17:36:21.795265 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d594370c-6b92-4065-b59b-0a35255e72eb None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:21.796304 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d594370c-6b92-4065-b59b-0a35255e72eb None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:21.796815 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d594370c-6b92-4065-b59b-0a35255e72eb None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:21.798483 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 28/62] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:36:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:36:21.804260 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284bd343-2a00-4fff-91be-a5c296c5266b None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:21.804697 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284bd343-2a00-4fff-91be-a5c296c5266b None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:21.804835 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284bd343-2a00-4fff-91be-a5c296c5266b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:21.832397 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-284bd343-2a00-4fff-91be-a5c296c5266b None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:36:21.834507 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-284bd343-2a00-4fff-91be-a5c296c5266b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:36:21.929060 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:21.934363 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 35/63] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:36:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:36:21.970022 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d594370c-6b92-4065-b59b-0a35255e72eb None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:22.104022 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184d82a5-521a-4d3f-8140-fb24badc1b65 None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:22.104693 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184d82a5-521a-4d3f-8140-fb24badc1b65 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:22.105217 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184d82a5-521a-4d3f-8140-fb24badc1b65 None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:22.106876 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 36/64] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:36:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 14 17:36:22.113686 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d594370c-6b92-4065-b59b-0a35255e72eb None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:22.116018 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2d5126-a5d0-42d3-bc3b-f48c3b77d886 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:22.116561 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2d5126-a5d0-42d3-bc3b-f48c3b77d886 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:22.117041 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2d5126-a5d0-42d3-bc3b-f48c3b77d886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:22.125035 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:22.152132 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-7e2d5126-a5d0-42d3-bc3b-f48c3b77d886 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:36:22.155144 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-7e2d5126-a5d0-42d3-bc3b-f48c3b77d886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:36:22.183629 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d777ec3f-b5be-4471-9efe-5c01ac2edca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:22.184861 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d777ec3f-b5be-4471-9efe-5c01ac2edca7 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:22.185366 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d777ec3f-b5be-4471-9efe-5c01ac2edca7 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:22.185840 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d777ec3f-b5be-4471-9efe-5c01ac2edca7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:22.213335 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d777ec3f-b5be-4471-9efe-5c01ac2edca7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:36:22.221273 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-d777ec3f-b5be-4471-9efe-5c01ac2edca7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 17:36:22.221273 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:36:22.221273 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:36:22.221273 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:36:22.221273 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:36:22.221273 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:36:22.221273 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:36:22.221273 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:36:22.221273 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:36:22.221273 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:36:22.221273 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:36:22.221273 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:36:22.221273 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:36:22.221273 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:36:22.221273 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:36:22.221273 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:36:22.222116 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:36:22.222116 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:36:22.222116 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:36:22.222116 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:36:22.222116 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:36:22.222116 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:36:22.222116 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:36:22.222116 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:36:22.222116 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:36:22.222116 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:36:22.222116 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:36:22.222116 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:36:22.222116 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:36:22.222116 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:36:22.222116 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:36:22.222116 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:36:22.222861 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:36:22.222861 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:36:22.222861 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:36:22.222861 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:36:22.222861 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:36:22.222861 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:36:22.222861 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:36:22.222861 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:36:22.222861 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:36:22.222861 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:36:22.222861 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 17:36:22.222861 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:36:22.222861 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 29/65] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jun 14 17:36:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:36:22.236904 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d777ec3f-b5be-4471-9efe-5c01ac2edca7 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:22.280142 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 37/66] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:36:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:36:22.305660 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2d5126-a5d0-42d3-bc3b-f48c3b77d886 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:22.434181 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d777ec3f-b5be-4471-9efe-5c01ac2edca7 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:22.467335 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2d5126-a5d0-42d3-bc3b-f48c3b77d886 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:22.515656 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:22.522092 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d093d9-170b-4c04-a376-84ec5d22a23d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:22.531872 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d093d9-170b-4c04-a376-84ec5d22a23d None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:22.531872 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d093d9-170b-4c04-a376-84ec5d22a23d None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:22.531872 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d093d9-170b-4c04-a376-84ec5d22a23d None admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:22.531872 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d093d9-170b-4c04-a376-84ec5d22a23d None admin] RBAC: Adding query filter params (name=admin) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:36:22.531872 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d093d9-170b-4c04-a376-84ec5d22a23d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:22.531872 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d093d9-170b-4c04-a376-84ec5d22a23d None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:22.532364 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e962750b-5d40-4a85-8bc8-d5007edee7d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:22.532364 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e962750b-5d40-4a85-8bc8-d5007edee7d6 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:22.532364 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e962750b-5d40-4a85-8bc8-d5007edee7d6 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:22.532651 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e962750b-5d40-4a85-8bc8-d5007edee7d6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:22.553994 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 30/67] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 14 17:36:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:36:22.558744 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e962750b-5d40-4a85-8bc8-d5007edee7d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:36:22.560555 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13536308-c19c-40e7-9f46-6c523bcebe0e None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:22.561084 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13536308-c19c-40e7-9f46-6c523bcebe0e None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:22.561515 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13536308-c19c-40e7-9f46-6c523bcebe0e None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:22.563485 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 31/68] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:36:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 14 17:36:22.569822 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13536308-c19c-40e7-9f46-6c523bcebe0e None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:22.570423 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-e962750b-5d40-4a85-8bc8-d5007edee7d6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 14 17:36:22.570423 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:36:22.570423 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:36:22.570423 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:36:22.570423 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:36:22.570423 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:36:22.570423 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:36:22.570423 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:36:22.570423 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:36:22.570423 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:36:22.570423 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:36:22.570423 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:36:22.570423 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:36:22.570423 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:36:22.570423 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:36:22.570423 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:36:22.571514 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:36:22.571514 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:36:22.571514 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:36:22.571514 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:36:22.571514 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:36:22.571514 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:36:22.571514 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:36:22.571514 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:36:22.571514 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:36:22.571514 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:36:22.571514 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:36:22.571514 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:36:22.571514 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:36:22.571514 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:36:22.571514 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:36:22.571514 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:36:22.572402 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:36:22.572402 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:36:22.572402 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:36:22.572402 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:36:22.572402 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:36:22.572402 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:36:22.572402 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:36:22.572402 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:36:22.572402 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:36:22.572402 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:36:22.572402 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 14 17:36:22.572402 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:36:22.572402 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 38/69] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 14 17:36:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 17:36:22.576443 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec48bc97-6ada-4aa5-a0a7-6088973c33ea None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:22.576983 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec48bc97-6ada-4aa5-a0a7-6088973c33ea None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:22.577408 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec48bc97-6ada-4aa5-a0a7-6088973c33ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:22.605085 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-ec48bc97-6ada-4aa5-a0a7-6088973c33ea None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:36:22.607675 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-ec48bc97-6ada-4aa5-a0a7-6088973c33ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:36:22.624619 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:22.711807 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 39/70] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:36:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:36:22.712675 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec48bc97-6ada-4aa5-a0a7-6088973c33ea None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:22.726531 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13536308-c19c-40e7-9f46-6c523bcebe0e None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:22.770527 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c586b9-8383-411c-bc9f-3170e1fc9f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:22.772239 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c586b9-8383-411c-bc9f-3170e1fc9f4e None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:22.772810 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c586b9-8383-411c-bc9f-3170e1fc9f4e None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:22.773309 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c586b9-8383-411c-bc9f-3170e1fc9f4e None admin] PATH_INFO: `/v3/users/bdaeb72186c0489e804154d6d26ae21b` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:22.775165 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c586b9-8383-411c-bc9f-3170e1fc9f4e None admin] RBAC: Authorizing `identity:get_user(user_id=bdaeb72186c0489e804154d6d26ae21b)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:22.777997 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c586b9-8383-411c-bc9f-3170e1fc9f4e None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:22.780407 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 32/71] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 14 17:36:22 2022] GET /identity/v3/users/bdaeb72186c0489e804154d6d26ae21b => generated 247 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:36:22.784621 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84fec12-f3f8-4196-8006-901a52566606 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:22.785052 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84fec12-f3f8-4196-8006-901a52566606 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:22.785220 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84fec12-f3f8-4196-8006-901a52566606 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:22.786774 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 33/72] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:36:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:36:22.788226 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84fec12-f3f8-4196-8006-901a52566606 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:22.835907 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec48bc97-6ada-4aa5-a0a7-6088973c33ea None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:22.857204 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:22.871961 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9e4279-1a61-458e-8ff8-90785e39f8ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:22.879542 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9e4279-1a61-458e-8ff8-90785e39f8ec None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:22.879542 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9e4279-1a61-458e-8ff8-90785e39f8ec None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:22.879542 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9e4279-1a61-458e-8ff8-90785e39f8ec None admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:22.879542 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9e4279-1a61-458e-8ff8-90785e39f8ec None admin] RBAC: Adding query filter params (name=member) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:36:22.879542 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9e4279-1a61-458e-8ff8-90785e39f8ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:22.879542 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9e4279-1a61-458e-8ff8-90785e39f8ec None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:22.885434 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 40/73] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Jun 14 17:36:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:36:22.886290 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9e4279-1a61-458e-8ff8-90785e39f8ec None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:22.905094 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:22.910597 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84fec12-f3f8-4196-8006-901a52566606 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:22.948235 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a62fea1-ac82-42ca-9963-2386f05037b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:22.949496 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a62fea1-ac82-42ca-9963-2386f05037b1 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:22.949496 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a62fea1-ac82-42ca-9963-2386f05037b1 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:22.949652 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a62fea1-ac82-42ca-9963-2386f05037b1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:22.961281 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a62fea1-ac82-42ca-9963-2386f05037b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:36:22.969236 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-9a62fea1-ac82-42ca-9963-2386f05037b1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 14 17:36:22.969236 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:36:22.969236 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:36:22.969236 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:36:22.969236 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:36:22.969236 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:36:22.969236 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:36:22.969236 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:36:22.969236 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:36:22.969236 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:36:22.969236 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:36:22.969236 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:36:22.969236 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:36:22.969236 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:36:22.969236 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:36:22.969236 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:36:22.970250 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:36:22.970250 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:36:22.970250 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:36:22.970250 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:36:22.970250 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:36:22.970250 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:36:22.970250 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:36:22.970250 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:36:22.970250 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:36:22.970250 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:36:22.970250 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:36:22.970250 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:36:22.970250 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:36:22.970250 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:36:22.970250 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:36:22.970250 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:36:22.971122 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:36:22.971122 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:36:22.971122 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:36:22.971122 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:36:22.971122 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:36:22.971122 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:36:22.971122 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:36:22.971122 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:36:22.971122 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:36:22.971122 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:36:22.971122 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 14 17:36:22.971122 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:36:22.971122 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 34/74] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 14 17:36:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:36:22.972064 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3837715-ff49-4c03-bc38-829434df8636 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:22.972403 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3837715-ff49-4c03-bc38-829434df8636 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:22.972690 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3837715-ff49-4c03-bc38-829434df8636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:22.990317 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-a3837715-ff49-4c03-bc38-829434df8636 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:36:22.992075 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-a3837715-ff49-4c03-bc38-829434df8636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:36:22.998549 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9e4279-1a61-458e-8ff8-90785e39f8ec None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:23.033977 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b734cb50-d437-4cc5-8db3-3b68f2f9b828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:23.034640 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b734cb50-d437-4cc5-8db3-3b68f2f9b828 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:23.034931 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b734cb50-d437-4cc5-8db3-3b68f2f9b828 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:23.035212 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b734cb50-d437-4cc5-8db3-3b68f2f9b828 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:23.064069 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 35/75] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:36:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:36:23.065412 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9285ac82-c9cb-4dae-88d6-f6b65c515cdf None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:23.065709 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9285ac82-c9cb-4dae-88d6-f6b65c515cdf None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:23.065995 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9285ac82-c9cb-4dae-88d6-f6b65c515cdf None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:23.067278 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 36/76] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:36:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:36:23.068785 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9285ac82-c9cb-4dae-88d6-f6b65c515cdf None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:23.103065 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:23.121965 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b734cb50-d437-4cc5-8db3-3b68f2f9b828 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:23.123525 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b734cb50-d437-4cc5-8db3-3b68f2f9b828 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:23.163946 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:23.178453 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9285ac82-c9cb-4dae-88d6-f6b65c515cdf None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:23.222180 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88863437-7a47-4036-90e4-aa54ecb4fdfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:23.222998 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88863437-7a47-4036-90e4-aa54ecb4fdfa None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:23.223283 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88863437-7a47-4036-90e4-aa54ecb4fdfa None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:23.223603 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88863437-7a47-4036-90e4-aa54ecb4fdfa None admin] PATH_INFO: `/v3/users/48d36fad27cf4eff8510c2ec4719697c` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:23.229094 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 41/77] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 14 17:36:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 14 17:36:23.229955 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b734cb50-d437-4cc5-8db3-3b68f2f9b828 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:23.242292 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88863437-7a47-4036-90e4-aa54ecb4fdfa None admin] RBAC: Authorizing `identity:get_user(user_id=48d36fad27cf4eff8510c2ec4719697c)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:23.243819 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88863437-7a47-4036-90e4-aa54ecb4fdfa None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:23.245581 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 37/78] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 14 17:36:23 2022] GET /identity/v3/users/48d36fad27cf4eff8510c2ec4719697c => generated 275 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:36:23.246820 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5a268c-3447-4a7e-ae0f-568d307b1b33 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:23.247104 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5a268c-3447-4a7e-ae0f-568d307b1b33 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:23.247427 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5a268c-3447-4a7e-ae0f-568d307b1b33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:23.265396 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-8e5a268c-3447-4a7e-ae0f-568d307b1b33 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:36:23.266605 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-8e5a268c-3447-4a7e-ae0f-568d307b1b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:36:23.313960 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:23.332325 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b734cb50-d437-4cc5-8db3-3b68f2f9b828 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:23.338542 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 38/79] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:36:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:36:23.339428 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5a268c-3447-4a7e-ae0f-568d307b1b33 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:23.372172 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daab77f5-9a2d-4170-a72c-fb7b10e89ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:23.372853 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daab77f5-9a2d-4170-a72c-fb7b10e89ef2 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:23.373140 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daab77f5-9a2d-4170-a72c-fb7b10e89ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:23.373422 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daab77f5-9a2d-4170-a72c-fb7b10e89ef2 None admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:23.374174 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daab77f5-9a2d-4170-a72c-fb7b10e89ef2 None admin] RBAC: Adding query filter params (name=member) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:36:23.374488 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daab77f5-9a2d-4170-a72c-fb7b10e89ef2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:23.375901 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daab77f5-9a2d-4170-a72c-fb7b10e89ef2 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:23.385567 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 42/80] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Jun 14 17:36:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:36:23.386526 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daab77f5-9a2d-4170-a72c-fb7b10e89ef2 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:23.426522 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:23.450280 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5a268c-3447-4a7e-ae0f-568d307b1b33 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:23.485715 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86498e15-04f2-457d-bc0f-5d606f167540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:23.486500 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86498e15-04f2-457d-bc0f-5d606f167540 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:23.486797 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86498e15-04f2-457d-bc0f-5d606f167540 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:23.487084 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86498e15-04f2-457d-bc0f-5d606f167540 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:23.494351 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daab77f5-9a2d-4170-a72c-fb7b10e89ef2 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:23.498793 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86498e15-04f2-457d-bc0f-5d606f167540 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:36:23.508097 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-86498e15-04f2-457d-bc0f-5d606f167540 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 14 17:36:23.508097 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:36:23.508097 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:36:23.508097 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:36:23.508097 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:36:23.508097 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:36:23.508097 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:36:23.508097 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:36:23.508097 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:36:23.508097 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:36:23.508097 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:36:23.508097 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:36:23.508097 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:36:23.508097 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:36:23.508097 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:36:23.508097 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:36:23.509006 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:36:23.509006 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:36:23.509006 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:36:23.509006 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:36:23.509006 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:36:23.509006 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:36:23.509006 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:36:23.509006 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:36:23.509006 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:36:23.509006 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:36:23.509006 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:36:23.509006 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:36:23.509006 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:36:23.509006 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:36:23.509006 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:36:23.509006 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:36:23.509771 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:36:23.509771 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:36:23.509771 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:36:23.509771 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:36:23.509771 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:36:23.509771 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:36:23.509771 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:36:23.509771 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:36:23.509771 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:36:23.509771 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:36:23.509771 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 14 17:36:23.509771 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:36:23.509771 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 39/81] 10.222.0.36 () {56 vars in 1114 bytes} [Tue Jun 14 17:36:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:36:23.510400 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86498e15-04f2-457d-bc0f-5d606f167540 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:23.533758 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62872d3e-c975-4b70-9c23-2aa0776c901f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:23.534624 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62872d3e-c975-4b70-9c23-2aa0776c901f None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:23.534911 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62872d3e-c975-4b70-9c23-2aa0776c901f None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:23.535193 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62872d3e-c975-4b70-9c23-2aa0776c901f None admin] PATH_INFO: `/v3/projects/b2d7081316264626896ee5ec5050f5de` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:23.536425 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62872d3e-c975-4b70-9c23-2aa0776c901f None admin] RBAC: Authorizing `identity:get_project(project_id=b2d7081316264626896ee5ec5050f5de)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:23.537914 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62872d3e-c975-4b70-9c23-2aa0776c901f None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:23.539709 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 43/82] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 14 17:36:23 2022] GET /identity/v3/projects/b2d7081316264626896ee5ec5050f5de => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:36:23.540497 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62872d3e-c975-4b70-9c23-2aa0776c901f None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:23.557829 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:23.628605 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86498e15-04f2-457d-bc0f-5d606f167540 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:23.647288 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62872d3e-c975-4b70-9c23-2aa0776c901f None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:23.664189 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d35809-9a48-49e5-8c7e-0a1573fa3eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:23.664861 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d35809-9a48-49e5-8c7e-0a1573fa3eb4 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:23.665154 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d35809-9a48-49e5-8c7e-0a1573fa3eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:23.665448 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d35809-9a48-49e5-8c7e-0a1573fa3eb4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:23.669134 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:23.683234 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21766088-bc7c-4573-b5fe-ae0812216270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:23.684070 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21766088-bc7c-4573-b5fe-ae0812216270 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:23.684363 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21766088-bc7c-4573-b5fe-ae0812216270 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:23.684644 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21766088-bc7c-4573-b5fe-ae0812216270 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:23.685875 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21766088-bc7c-4573-b5fe-ae0812216270 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:23.689293 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21766088-bc7c-4573-b5fe-ae0812216270 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:23.691213 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 44/83] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 14 17:36:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:36:23.691879 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21766088-bc7c-4573-b5fe-ae0812216270 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:23.735643 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d35809-9a48-49e5-8c7e-0a1573fa3eb4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:23.737197 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d35809-9a48-49e5-8c7e-0a1573fa3eb4 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:23.777240 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:23.797429 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21766088-bc7c-4573-b5fe-ae0812216270 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:23.834071 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53f938c-0207-40e4-a472-f2cb47b742eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:23.834961 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53f938c-0207-40e4-a472-f2cb47b742eb None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:23.835257 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53f938c-0207-40e4-a472-f2cb47b742eb None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:23.835569 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53f938c-0207-40e4-a472-f2cb47b742eb None admin] PATH_INFO: `/v3/users/48d36fad27cf4eff8510c2ec4719697c` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:23.837037 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53f938c-0207-40e4-a472-f2cb47b742eb None admin] RBAC: Authorizing `identity:get_user(user_id=48d36fad27cf4eff8510c2ec4719697c)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:23.838515 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53f938c-0207-40e4-a472-f2cb47b742eb None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:23.840201 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 45/84] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 14 17:36:23 2022] GET /identity/v3/users/48d36fad27cf4eff8510c2ec4719697c => generated 275 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:36:23.840982 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53f938c-0207-40e4-a472-f2cb47b742eb None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:23.846620 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 40/85] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 14 17:36:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 14 17:36:23.846620 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d35809-9a48-49e5-8c7e-0a1573fa3eb4 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:23.880257 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:23.948367 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d35809-9a48-49e5-8c7e-0a1573fa3eb4 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:23.949731 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53f938c-0207-40e4-a472-f2cb47b742eb None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:23.983347 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e313a34f-91a6-40d7-998e-1cf37524a964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:23.983699 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe8f7a2-2ed4-44b1-b3c6-60366ac8710f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:23.984014 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e313a34f-91a6-40d7-998e-1cf37524a964 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:23.984299 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e313a34f-91a6-40d7-998e-1cf37524a964 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:23.984414 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe8f7a2-2ed4-44b1-b3c6-60366ac8710f None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:23.984582 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e313a34f-91a6-40d7-998e-1cf37524a964 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:23.984676 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe8f7a2-2ed4-44b1-b3c6-60366ac8710f None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:23.984961 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe8f7a2-2ed4-44b1-b3c6-60366ac8710f None admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:23.985421 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e313a34f-91a6-40d7-998e-1cf37524a964 None admin] RBAC: Adding query filter params (role.id=1348580877d04014bfdec4d866b98a74, scope.project.id=b2d7081316264626896ee5ec5050f5de, user.id=bdaeb72186c0489e804154d6d26ae21b) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:36:23.985718 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe8f7a2-2ed4-44b1-b3c6-60366ac8710f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:36:23.985812 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e313a34f-91a6-40d7-998e-1cf37524a964 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:23.986034 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe8f7a2-2ed4-44b1-b3c6-60366ac8710f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:23.987181 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e313a34f-91a6-40d7-998e-1cf37524a964 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:23.987473 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe8f7a2-2ed4-44b1-b3c6-60366ac8710f None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:23.993549 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 41/86] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 14 17:36:23 2022] GET /identity/v3/role_assignments?user.id=bdaeb72186c0489e804154d6d26ae21b&scope.project.id=b2d7081316264626896ee5ec5050f5de&role.id=1348580877d04014bfdec4d866b98a74 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:36:23.994345 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e313a34f-91a6-40d7-998e-1cf37524a964 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:24.001572 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 46/87] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 14 17:36:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:36:24.001572 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe8f7a2-2ed4-44b1-b3c6-60366ac8710f None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:24.012702 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:24.119311 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe8f7a2-2ed4-44b1-b3c6-60366ac8710f None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:24.124290 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:24.128477 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e313a34f-91a6-40d7-998e-1cf37524a964 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:24.158110 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd37a269-5ed8-49aa-9217-4cfab2230078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:24.158940 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd37a269-5ed8-49aa-9217-4cfab2230078 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:24.159239 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd37a269-5ed8-49aa-9217-4cfab2230078 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:24.159557 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd37a269-5ed8-49aa-9217-4cfab2230078 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:24.174774 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7620f405-ac6d-4efd-b0e7-7d97698b8a03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:24.176106 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7620f405-ac6d-4efd-b0e7-7d97698b8a03 None admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:24.176106 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7620f405-ac6d-4efd-b0e7-7d97698b8a03 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:24.176288 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7620f405-ac6d-4efd-b0e7-7d97698b8a03 None admin] PATH_INFO: `/v3/users` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:24.177054 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7620f405-ac6d-4efd-b0e7-7d97698b8a03 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:24.179068 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7620f405-ac6d-4efd-b0e7-7d97698b8a03 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:24.240639 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd37a269-5ed8-49aa-9217-4cfab2230078 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:24.242086 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd37a269-5ed8-49aa-9217-4cfab2230078 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:24.253616 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:24.283334 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 42/88] 10.222.0.36 () {60 vars in 1132 bytes} [Tue Jun 14 17:36:23 2022] POST /identity/v3/users => generated 289 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:36:24.283334 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7620f405-ac6d-4efd-b0e7-7d97698b8a03 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:24.376069 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 47/89] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 14 17:36:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 14 17:36:24.377187 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd37a269-5ed8-49aa-9217-4cfab2230078 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:24.442554 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7620f405-ac6d-4efd-b0e7-7d97698b8a03 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:24.488525 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86652d7d-fd4a-4b10-a8ce-0e9bcc8a7a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:24.490070 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86652d7d-fd4a-4b10-a8ce-0e9bcc8a7a63 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:24.490753 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86652d7d-fd4a-4b10-a8ce-0e9bcc8a7a63 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:24.491011 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86652d7d-fd4a-4b10-a8ce-0e9bcc8a7a63 None admin] PATH_INFO: `/v3/projects/b2d7081316264626896ee5ec5050f5de` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:24.492407 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86652d7d-fd4a-4b10-a8ce-0e9bcc8a7a63 None admin] RBAC: Authorizing `identity:get_project(project_id=b2d7081316264626896ee5ec5050f5de)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:24.493893 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86652d7d-fd4a-4b10-a8ce-0e9bcc8a7a63 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:24.495996 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 43/90] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 14 17:36:24 2022] GET /identity/v3/projects/b2d7081316264626896ee5ec5050f5de => generated 298 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:36:24.496807 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86652d7d-fd4a-4b10-a8ce-0e9bcc8a7a63 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:24.519213 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd37a269-5ed8-49aa-9217-4cfab2230078 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:24.534226 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:24.534982 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:24.566473 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66311bd7-a06a-4b52-be6c-8891282bf0c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:24.567395 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66311bd7-a06a-4b52-be6c-8891282bf0c2 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:24.568576 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66311bd7-a06a-4b52-be6c-8891282bf0c2 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:24.568870 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66311bd7-a06a-4b52-be6c-8891282bf0c2 None admin] PATH_INFO: `/v3/users/48d36fad27cf4eff8510c2ec4719697c` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:24.570178 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66311bd7-a06a-4b52-be6c-8891282bf0c2 None admin] RBAC: Authorizing `identity:get_user(user_id=48d36fad27cf4eff8510c2ec4719697c)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:24.571900 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66311bd7-a06a-4b52-be6c-8891282bf0c2 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:24.573762 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 48/91] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 14 17:36:24 2022] GET /identity/v3/users/48d36fad27cf4eff8510c2ec4719697c => generated 275 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:36:24.574372 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66311bd7-a06a-4b52-be6c-8891282bf0c2 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:24.644166 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86652d7d-fd4a-4b10-a8ce-0e9bcc8a7a63 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:24.715480 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66311bd7-a06a-4b52-be6c-8891282bf0c2 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:24.715773 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72857a5b-504d-42fd-a4cb-48f2aba7d07c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:24.717013 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72857a5b-504d-42fd-a4cb-48f2aba7d07c None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:24.717517 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72857a5b-504d-42fd-a4cb-48f2aba7d07c None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:24.718165 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72857a5b-504d-42fd-a4cb-48f2aba7d07c None admin] PATH_INFO: `/v3/projects/04b70fac2c57427fa08aa88ec925923b` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:24.721648 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72857a5b-504d-42fd-a4cb-48f2aba7d07c None admin] RBAC: Authorizing `identity:get_project(project_id=04b70fac2c57427fa08aa88ec925923b)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:24.725081 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72857a5b-504d-42fd-a4cb-48f2aba7d07c None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:24.728432 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 44/92] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 14 17:36:24 2022] GET /identity/v3/projects/04b70fac2c57427fa08aa88ec925923b => generated 312 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:36:24.730022 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72857a5b-504d-42fd-a4cb-48f2aba7d07c None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:24.770242 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23338bc-ecfa-4485-90c8-6667dc388f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:24.771136 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23338bc-ecfa-4485-90c8-6667dc388f1f None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:24.771569 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23338bc-ecfa-4485-90c8-6667dc388f1f None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:24.771965 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23338bc-ecfa-4485-90c8-6667dc388f1f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:24.772968 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23338bc-ecfa-4485-90c8-6667dc388f1f None admin] RBAC: Adding query filter params (role.id=9ee80134743f4c2b88525b04df2facba, scope.project.id=b2d7081316264626896ee5ec5050f5de, user.id=48d36fad27cf4eff8510c2ec4719697c) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:36:24.773395 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23338bc-ecfa-4485-90c8-6667dc388f1f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:24.775084 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23338bc-ecfa-4485-90c8-6667dc388f1f None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:24.784939 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 49/93] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 14 17:36:24 2022] GET /identity/v3/role_assignments?user.id=48d36fad27cf4eff8510c2ec4719697c&scope.project.id=b2d7081316264626896ee5ec5050f5de&role.id=9ee80134743f4c2b88525b04df2facba => generated 259 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:36:24.785797 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23338bc-ecfa-4485-90c8-6667dc388f1f None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:24.900373 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:24.936899 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:24.961971 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72857a5b-504d-42fd-a4cb-48f2aba7d07c None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:25.034816 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23338bc-ecfa-4485-90c8-6667dc388f1f None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:25.073267 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3d61a6-78f4-41cf-bfec-1f438461e108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:25.074020 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3d61a6-78f4-41cf-bfec-1f438461e108 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:25.074314 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3d61a6-78f4-41cf-bfec-1f438461e108 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:25.074604 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3d61a6-78f4-41cf-bfec-1f438461e108 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:25.107989 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010ac54d-8059-4fc3-976d-9850fd31c5e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:25.108557 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010ac54d-8059-4fc3-976d-9850fd31c5e3 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:25.108851 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010ac54d-8059-4fc3-976d-9850fd31c5e3 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:25.109135 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010ac54d-8059-4fc3-976d-9850fd31c5e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:25.109987 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010ac54d-8059-4fc3-976d-9850fd31c5e3 None admin] RBAC: Adding query filter params (role.id=9ee80134743f4c2b88525b04df2facba, scope.project.id=04b70fac2c57427fa08aa88ec925923b, user.id=48d36fad27cf4eff8510c2ec4719697c) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:36:25.110478 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010ac54d-8059-4fc3-976d-9850fd31c5e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:25.120101 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010ac54d-8059-4fc3-976d-9850fd31c5e3 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:25.129769 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 50/94] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 14 17:36:24 2022] GET /identity/v3/role_assignments?user.id=48d36fad27cf4eff8510c2ec4719697c&scope.project.id=04b70fac2c57427fa08aa88ec925923b&role.id=9ee80134743f4c2b88525b04df2facba => generated 259 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:36:25.235639 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3d61a6-78f4-41cf-bfec-1f438461e108 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:25.237178 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3d61a6-78f4-41cf-bfec-1f438461e108 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:25.370074 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:25.392840 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 45/95] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 14 17:36:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 664 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 14 17:36:25.400330 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010ac54d-8059-4fc3-976d-9850fd31c5e3 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:25.578990 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010ac54d-8059-4fc3-976d-9850fd31c5e3 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:25.598522 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:25.657500 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb56940-328a-4b64-9420-40e73ebd638a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:25.658962 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb56940-328a-4b64-9420-40e73ebd638a None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:25.659528 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb56940-328a-4b64-9420-40e73ebd638a None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:25.660053 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb56940-328a-4b64-9420-40e73ebd638a None admin] PATH_INFO: `/v3/projects/b2d7081316264626896ee5ec5050f5de` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:25.662273 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb56940-328a-4b64-9420-40e73ebd638a None admin] RBAC: Authorizing `identity:get_project(project_id=b2d7081316264626896ee5ec5050f5de)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:25.665151 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb56940-328a-4b64-9420-40e73ebd638a None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:25.668723 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 51/96] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 14 17:36:25 2022] GET /identity/v3/projects/b2d7081316264626896ee5ec5050f5de => generated 298 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:36:25.674798 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3d61a6-78f4-41cf-bfec-1f438461e108 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:25.810939 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3d61a6-78f4-41cf-bfec-1f438461e108 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:25.854511 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af80b19-18a1-4166-abd8-8077cb2a96e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:25.855183 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af80b19-18a1-4166-abd8-8077cb2a96e0 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:25.855498 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af80b19-18a1-4166-abd8-8077cb2a96e0 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:25.855782 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af80b19-18a1-4166-abd8-8077cb2a96e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:25.856626 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af80b19-18a1-4166-abd8-8077cb2a96e0 None admin] RBAC: Adding query filter params (role.id=e41c4e25dfdf4810aab2231cf98c98a9, scope.project.id=b2d7081316264626896ee5ec5050f5de, user.id=48d36fad27cf4eff8510c2ec4719697c) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:36:25.856946 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af80b19-18a1-4166-abd8-8077cb2a96e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:25.858399 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af80b19-18a1-4166-abd8-8077cb2a96e0 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:25.868708 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 46/97] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 14 17:36:25 2022] GET /identity/v3/role_assignments?user.id=48d36fad27cf4eff8510c2ec4719697c&scope.project.id=b2d7081316264626896ee5ec5050f5de&role.id=e41c4e25dfdf4810aab2231cf98c98a9 => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:36:26.734988 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0308c730-696f-46c1-8a0a-0ad199b72d93 None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:26.735619 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0308c730-696f-46c1-8a0a-0ad199b72d93 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:26.735619 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0308c730-696f-46c1-8a0a-0ad199b72d93 None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:26.736989 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 52/98] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:36:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:36:26.743286 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f30c6ac-a72d-4f25-82c7-78c8bc81023f None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:26.743760 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f30c6ac-a72d-4f25-82c7-78c8bc81023f None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:26.743958 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f30c6ac-a72d-4f25-82c7-78c8bc81023f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:26.768324 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-2f30c6ac-a72d-4f25-82c7-78c8bc81023f None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:36:26.769595 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-2f30c6ac-a72d-4f25-82c7-78c8bc81023f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:36:26.841256 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:26.862384 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 47/99] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:36:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:36:26.907765 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0308c730-696f-46c1-8a0a-0ad199b72d93 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:27.033970 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0308c730-696f-46c1-8a0a-0ad199b72d93 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:27.076426 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e37704-51bb-424c-9610-c89309c8dbe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:27.077237 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e37704-51bb-424c-9610-c89309c8dbe0 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:27.077574 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e37704-51bb-424c-9610-c89309c8dbe0 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:27.077863 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e37704-51bb-424c-9610-c89309c8dbe0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:27.089991 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e37704-51bb-424c-9610-c89309c8dbe0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:36:27.098287 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-f3e37704-51bb-424c-9610-c89309c8dbe0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 17:36:27.098287 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:36:27.098287 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:36:27.098287 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:36:27.098287 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:36:27.098287 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:36:27.098287 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:36:27.098287 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:36:27.098287 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:36:27.098287 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:36:27.098287 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:36:27.098287 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:36:27.098287 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:36:27.098287 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:36:27.098287 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:36:27.098287 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:36:27.099208 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:36:27.099208 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:36:27.099208 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:36:27.099208 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:36:27.099208 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:36:27.099208 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:36:27.099208 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:36:27.099208 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:36:27.099208 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:36:27.099208 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:36:27.099208 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:36:27.099208 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:36:27.099208 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:36:27.099208 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:36:27.099208 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:36:27.099208 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:36:27.100004 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:36:27.100004 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:36:27.100004 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:36:27.100004 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:36:27.100004 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:36:27.100004 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:36:27.100004 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:36:27.100004 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:36:27.100004 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:36:27.100004 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:36:27.100004 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 17:36:27.100004 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:36:27.101085 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 53/100] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jun 14 17:36:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:36:27.106264 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f30c6ac-a72d-4f25-82c7-78c8bc81023f None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:27.228821 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f30c6ac-a72d-4f25-82c7-78c8bc81023f None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:27.283159 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d653f36-babe-43d2-a786-f9b2b4fdfb58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:27.283932 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d653f36-babe-43d2-a786-f9b2b4fdfb58 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:27.284268 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d653f36-babe-43d2-a786-f9b2b4fdfb58 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:27.284500 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d653f36-babe-43d2-a786-f9b2b4fdfb58 None admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:27.285280 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d653f36-babe-43d2-a786-f9b2b4fdfb58 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:36:27.285593 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d653f36-babe-43d2-a786-f9b2b4fdfb58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:27.287247 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d653f36-babe-43d2-a786-f9b2b4fdfb58 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:27.299704 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 48/101] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 14 17:36:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:36:27.306136 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e37704-51bb-424c-9610-c89309c8dbe0 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:27.353745 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:27.439759 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e37704-51bb-424c-9610-c89309c8dbe0 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:27.487938 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85193482-c1fe-410c-8276-1c60c967ec3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:27.488835 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85193482-c1fe-410c-8276-1c60c967ec3e None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:27.489121 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85193482-c1fe-410c-8276-1c60c967ec3e None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:27.490257 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85193482-c1fe-410c-8276-1c60c967ec3e None admin] PATH_INFO: `/v3/users/bdaeb72186c0489e804154d6d26ae21b` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:27.491849 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85193482-c1fe-410c-8276-1c60c967ec3e None admin] RBAC: Authorizing `identity:get_user(user_id=bdaeb72186c0489e804154d6d26ae21b)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:27.493310 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85193482-c1fe-410c-8276-1c60c967ec3e None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:27.495276 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 54/102] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 14 17:36:27 2022] GET /identity/v3/users/bdaeb72186c0489e804154d6d26ae21b => generated 247 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:36:27.500674 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d653f36-babe-43d2-a786-f9b2b4fdfb58 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:27.589974 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:27.666273 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d653f36-babe-43d2-a786-f9b2b4fdfb58 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:27.717602 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ed38a4-efa9-41f6-b658-7a046a4190bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:27.718858 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ed38a4-efa9-41f6-b658-7a046a4190bc None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:27.720758 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ed38a4-efa9-41f6-b658-7a046a4190bc None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:27.721252 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ed38a4-efa9-41f6-b658-7a046a4190bc None admin] PATH_INFO: `/v3/projects/b2d7081316264626896ee5ec5050f5de` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:27.728161 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ed38a4-efa9-41f6-b658-7a046a4190bc None admin] RBAC: Authorizing `identity:get_project(project_id=b2d7081316264626896ee5ec5050f5de)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:27.729924 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ed38a4-efa9-41f6-b658-7a046a4190bc None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:27.732052 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 49/103] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 14 17:36:27 2022] GET /identity/v3/projects/b2d7081316264626896ee5ec5050f5de => generated 298 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:36:27.737917 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85193482-c1fe-410c-8276-1c60c967ec3e None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:27.894125 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85193482-c1fe-410c-8276-1c60c967ec3e None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:27.896346 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:27.952533 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5a76eb-f5c7-428b-b43e-68aa6c13d751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:27.953461 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5a76eb-f5c7-428b-b43e-68aa6c13d751 None admin] REQUEST_METHOD: `PUT` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:27.953756 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5a76eb-f5c7-428b-b43e-68aa6c13d751 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:27.954044 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5a76eb-f5c7-428b-b43e-68aa6c13d751 None admin] PATH_INFO: `/v3/projects/b2d7081316264626896ee5ec5050f5de/users/bdaeb72186c0489e804154d6d26ae21b/roles/1348580877d04014bfdec4d866b98a74` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:27.956770 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5a76eb-f5c7-428b-b43e-68aa6c13d751 None admin] RBAC: Authorizing `identity:create_grant(project_id=b2d7081316264626896ee5ec5050f5de, user_id=bdaeb72186c0489e804154d6d26ae21b, role_id=1348580877d04014bfdec4d866b98a74)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:27.958339 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5a76eb-f5c7-428b-b43e-68aa6c13d751 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:28.046823 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 55/104] 10.222.0.36 () {58 vars in 1439 bytes} [Tue Jun 14 17:36:27 2022] PUT /identity/v3/projects/b2d7081316264626896ee5ec5050f5de/users/bdaeb72186c0489e804154d6d26ae21b/roles/1348580877d04014bfdec4d866b98a74 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:36:28.081191 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2818d7-9af7-479f-930f-6fa0e39af5cf None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:28.081730 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2818d7-9af7-479f-930f-6fa0e39af5cf None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:28.081979 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2818d7-9af7-479f-930f-6fa0e39af5cf None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:28.084787 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 50/105] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:36:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:36:28.090828 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d08746-3531-41e6-9385-8eb98a5e15f1 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:28.091405 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d08746-3531-41e6-9385-8eb98a5e15f1 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:28.091840 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d08746-3531-41e6-9385-8eb98a5e15f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:28.113027 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-83d08746-3531-41e6-9385-8eb98a5e15f1 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:36:28.119840 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-83d08746-3531-41e6-9385-8eb98a5e15f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:36:28.194807 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23af6a8-a037-4765-8df1-a52032ef02bb None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:28.195373 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23af6a8-a037-4765-8df1-a52032ef02bb None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:28.196233 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23af6a8-a037-4765-8df1-a52032ef02bb None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:28.198346 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 51/106] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:36:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 14 17:36:28.218075 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 56/107] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:36:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:36:28.220103 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c76732a-7104-472d-8113-024d6a74dcb6 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:28.220437 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c76732a-7104-472d-8113-024d6a74dcb6 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:28.220921 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c76732a-7104-472d-8113-024d6a74dcb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:28.252527 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-2c76732a-7104-472d-8113-024d6a74dcb6 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:36:28.253757 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-2c76732a-7104-472d-8113-024d6a74dcb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:36:28.273657 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcf3813-7013-45d6-b305-4f8f2d52a25d None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:28.274273 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcf3813-7013-45d6-b305-4f8f2d52a25d None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:28.274558 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcf3813-7013-45d6-b305-4f8f2d52a25d None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:28.276166 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 57/108] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:36:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 14 17:36:28.282375 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38e813b-23c5-4cc2-a348-37e94d018fb5 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:28.282734 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38e813b-23c5-4cc2-a348-37e94d018fb5 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:28.282974 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38e813b-23c5-4cc2-a348-37e94d018fb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:28.305733 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-f38e813b-23c5-4cc2-a348-37e94d018fb5 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:36:28.308317 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-f38e813b-23c5-4cc2-a348-37e94d018fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:36:28.385556 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 52/109] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:36:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:36:28.386884 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c76732a-7104-472d-8113-024d6a74dcb6 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:28.403266 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 58/110] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:36:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:36:28.405389 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ad82aa-05fd-4b4f-b03e-2c3bbc72a588 None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:28.405818 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ad82aa-05fd-4b4f-b03e-2c3bbc72a588 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:28.406222 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ad82aa-05fd-4b4f-b03e-2c3bbc72a588 None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:28.412805 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 59/111] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:36:28 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:36:28.424074 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ad82aa-05fd-4b4f-b03e-2c3bbc72a588 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:28.452031 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:28.464092 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:28.525915 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c76732a-7104-472d-8113-024d6a74dcb6 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:28.553953 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ad82aa-05fd-4b4f-b03e-2c3bbc72a588 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:28.566666 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2553644-f899-4f91-b03c-158af0c42354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:28.567867 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2553644-f899-4f91-b03c-158af0c42354 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:28.568759 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2553644-f899-4f91-b03c-158af0c42354 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:28.569281 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2553644-f899-4f91-b03c-158af0c42354 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:28.570768 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2553644-f899-4f91-b03c-158af0c42354 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:28.572630 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2553644-f899-4f91-b03c-158af0c42354 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:28.574503 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 53/112] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 14 17:36:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:36:28.575965 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9763975f-c562-4037-8a1b-3e8cbbac4b0c None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:28.576437 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9763975f-c562-4037-8a1b-3e8cbbac4b0c None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:28.576891 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9763975f-c562-4037-8a1b-3e8cbbac4b0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:28.594218 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-9763975f-c562-4037-8a1b-3e8cbbac4b0c None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:36:28.595822 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-9763975f-c562-4037-8a1b-3e8cbbac4b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:36:28.596972 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2e0b6d-a530-4aea-aa68-3a8ddad8bafe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:28.597899 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2e0b6d-a530-4aea-aa68-3a8ddad8bafe None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:28.598191 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2e0b6d-a530-4aea-aa68-3a8ddad8bafe None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:28.598468 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2e0b6d-a530-4aea-aa68-3a8ddad8bafe None admin] PATH_INFO: `/v3/roles/member` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:28.610663 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2e0b6d-a530-4aea-aa68-3a8ddad8bafe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:36:28.619705 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-bf2e0b6d-a530-4aea-aa68-3a8ddad8bafe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 14 17:36:28.619705 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:36:28.619705 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:36:28.619705 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:36:28.619705 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:36:28.619705 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:36:28.619705 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:36:28.619705 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:36:28.619705 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:36:28.619705 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:36:28.619705 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:36:28.619705 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:36:28.619705 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:36:28.619705 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:36:28.619705 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:36:28.619705 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:36:28.621653 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:36:28.621653 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:36:28.621653 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:36:28.621653 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:36:28.621653 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:36:28.621653 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:36:28.621653 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:36:28.621653 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:36:28.621653 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:36:28.621653 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:36:28.621653 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:36:28.621653 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:36:28.621653 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:36:28.621653 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:36:28.621653 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:36:28.621653 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:36:28.622456 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:36:28.622456 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:36:28.622456 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:36:28.622456 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:36:28.622456 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:36:28.622456 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:36:28.622456 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:36:28.622456 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:36:28.622456 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:36:28.622456 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:36:28.622456 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 14 17:36:28.622456 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:36:28.622456 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 60/113] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 14 17:36:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 17:36:28.622456 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2e0b6d-a530-4aea-aa68-3a8ddad8bafe None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:28.677559 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 54/114] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:36:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:36:28.684046 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9763975f-c562-4037-8a1b-3e8cbbac4b0c None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:28.719811 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:28.744095 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2e0b6d-a530-4aea-aa68-3a8ddad8bafe None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:28.752211 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:28.783586 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84486e4f-c2f7-40f0-9e9f-26945e3ca635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:28.784832 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84486e4f-c2f7-40f0-9e9f-26945e3ca635 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:28.785277 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84486e4f-c2f7-40f0-9e9f-26945e3ca635 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:28.785813 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84486e4f-c2f7-40f0-9e9f-26945e3ca635 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:28.798969 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84486e4f-c2f7-40f0-9e9f-26945e3ca635 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:36:28.808721 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-84486e4f-c2f7-40f0-9e9f-26945e3ca635 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 14 17:36:28.808721 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:36:28.808721 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:36:28.808721 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:36:28.808721 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:36:28.808721 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:36:28.808721 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:36:28.808721 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:36:28.808721 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:36:28.808721 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:36:28.808721 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:36:28.808721 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:36:28.808721 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:36:28.808721 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:36:28.808721 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:36:28.808721 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:36:28.809787 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:36:28.809787 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:36:28.809787 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:36:28.809787 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:36:28.809787 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:36:28.809787 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:36:28.809787 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:36:28.809787 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:36:28.809787 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:36:28.809787 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:36:28.809787 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:36:28.809787 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:36:28.809787 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:36:28.809787 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:36:28.809787 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:36:28.809787 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:36:28.810538 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:36:28.810538 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:36:28.810538 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:36:28.810538 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:36:28.810538 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:36:28.810538 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:36:28.810538 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:36:28.810538 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:36:28.810538 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:36:28.810538 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:36:28.810538 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 14 17:36:28.810538 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:36:28.810538 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 61/115] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 14 17:36:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:36:28.811168 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84486e4f-c2f7-40f0-9e9f-26945e3ca635 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:28.814512 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9763975f-c562-4037-8a1b-3e8cbbac4b0c None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:28.856968 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeed9541-723d-4c5f-b321-5b619b14e604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:28.857661 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeed9541-723d-4c5f-b321-5b619b14e604 None admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:28.857957 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeed9541-723d-4c5f-b321-5b619b14e604 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:28.858247 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeed9541-723d-4c5f-b321-5b619b14e604 None admin] PATH_INFO: `/v3/projects` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:28.858978 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeed9541-723d-4c5f-b321-5b619b14e604 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:28.860515 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeed9541-723d-4c5f-b321-5b619b14e604 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:28.941163 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84486e4f-c2f7-40f0-9e9f-26945e3ca635 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:28.951663 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 55/116] 10.222.0.36 () {60 vars in 1141 bytes} [Tue Jun 14 17:36:28 2022] POST /identity/v3/projects => generated 302 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:36:28.952567 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeed9541-723d-4c5f-b321-5b619b14e604 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:29.006355 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc5bd12-ecc7-4cf2-80d7-94ca4fcad98d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:29.008332 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc5bd12-ecc7-4cf2-80d7-94ca4fcad98d None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:29.008664 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc5bd12-ecc7-4cf2-80d7-94ca4fcad98d None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:29.010078 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc5bd12-ecc7-4cf2-80d7-94ca4fcad98d None admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:29.010974 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc5bd12-ecc7-4cf2-80d7-94ca4fcad98d None admin] RBAC: Adding query filter params (name=member) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:36:29.012977 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc5bd12-ecc7-4cf2-80d7-94ca4fcad98d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:29.016406 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc5bd12-ecc7-4cf2-80d7-94ca4fcad98d None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:29.043744 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 62/117] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Jun 14 17:36:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:36:29.044746 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc5bd12-ecc7-4cf2-80d7-94ca4fcad98d None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:29.055756 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:29.158829 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:29.171070 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeed9541-723d-4c5f-b321-5b619b14e604 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:29.230073 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5309888b-9511-4b44-b36a-c867ecad0412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:29.231069 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5309888b-9511-4b44-b36a-c867ecad0412 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:29.231704 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5309888b-9511-4b44-b36a-c867ecad0412 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:29.231996 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5309888b-9511-4b44-b36a-c867ecad0412 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:29.235711 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc5bd12-ecc7-4cf2-80d7-94ca4fcad98d None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:29.258115 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5309888b-9511-4b44-b36a-c867ecad0412 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:36:29.266279 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-5309888b-9511-4b44-b36a-c867ecad0412 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 14 17:36:29.266279 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:36:29.266279 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:36:29.266279 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:36:29.266279 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:36:29.266279 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:36:29.266279 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:36:29.266279 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:36:29.266279 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:36:29.266279 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:36:29.266279 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:36:29.266279 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:36:29.266279 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:36:29.266279 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:36:29.266279 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:36:29.266279 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:36:29.267195 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:36:29.267195 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:36:29.267195 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:36:29.267195 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:36:29.267195 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:36:29.267195 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:36:29.267195 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:36:29.267195 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:36:29.267195 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:36:29.267195 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:36:29.267195 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:36:29.267195 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:36:29.267195 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:36:29.267195 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:36:29.267195 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:36:29.267195 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:36:29.268481 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:36:29.268481 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:36:29.268481 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:36:29.268481 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:36:29.268481 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:36:29.268481 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:36:29.268481 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:36:29.268481 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:36:29.268481 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:36:29.268481 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:36:29.268481 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 14 17:36:29.268481 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:36:29.268481 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 56/118] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 14 17:36:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:36:29.269191 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5309888b-9511-4b44-b36a-c867ecad0412 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:29.290921 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cbee55-5594-4c81-b114-5f99f8889d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:29.291653 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cbee55-5594-4c81-b114-5f99f8889d57 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:29.291937 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cbee55-5594-4c81-b114-5f99f8889d57 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:29.292216 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cbee55-5594-4c81-b114-5f99f8889d57 None admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:29.292974 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cbee55-5594-4c81-b114-5f99f8889d57 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:36:29.293286 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cbee55-5594-4c81-b114-5f99f8889d57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:29.294695 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cbee55-5594-4c81-b114-5f99f8889d57 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:29.306052 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 63/119] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Jun 14 17:36:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:36:29.306924 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cbee55-5594-4c81-b114-5f99f8889d57 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:29.386229 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:29.410428 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5309888b-9511-4b44-b36a-c867ecad0412 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:29.428182 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cbee55-5594-4c81-b114-5f99f8889d57 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:29.456396 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d615baa5-b056-4913-9fab-494f14e2a670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:29.457640 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d615baa5-b056-4913-9fab-494f14e2a670 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:29.457941 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d615baa5-b056-4913-9fab-494f14e2a670 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:29.459113 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d615baa5-b056-4913-9fab-494f14e2a670 None admin] PATH_INFO: `/v3/users/48d36fad27cf4eff8510c2ec4719697c` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:29.460640 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d615baa5-b056-4913-9fab-494f14e2a670 None admin] RBAC: Authorizing `identity:get_user(user_id=48d36fad27cf4eff8510c2ec4719697c)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:29.462750 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d615baa5-b056-4913-9fab-494f14e2a670 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:29.464496 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 57/120] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 14 17:36:29 2022] GET /identity/v3/users/48d36fad27cf4eff8510c2ec4719697c => generated 275 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:36:29.465289 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d615baa5-b056-4913-9fab-494f14e2a670 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:29.471343 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a9110a-38cb-48c2-bc8a-4ef1a3059129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:29.472387 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a9110a-38cb-48c2-bc8a-4ef1a3059129 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:29.474435 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a9110a-38cb-48c2-bc8a-4ef1a3059129 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:29.474795 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a9110a-38cb-48c2-bc8a-4ef1a3059129 None admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:29.475604 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a9110a-38cb-48c2-bc8a-4ef1a3059129 None admin] RBAC: Adding query filter params (name=member) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:36:29.475928 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a9110a-38cb-48c2-bc8a-4ef1a3059129 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:29.477350 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a9110a-38cb-48c2-bc8a-4ef1a3059129 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:29.489960 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 64/121] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Jun 14 17:36:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:36:29.491742 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c52d2c-4ecb-4059-99ad-f20f4cef2bb4 None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:29.492047 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c52d2c-4ecb-4059-99ad-f20f4cef2bb4 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:29.492344 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c52d2c-4ecb-4059-99ad-f20f4cef2bb4 None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:29.494471 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 65/122] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:36:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:36:29.495141 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c52d2c-4ecb-4059-99ad-f20f4cef2bb4 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:29.503840 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:29.615647 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d615baa5-b056-4913-9fab-494f14e2a670 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:29.628434 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c52d2c-4ecb-4059-99ad-f20f4cef2bb4 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:29.659564 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:29.666926 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255a58c5-955a-416f-9122-e5a4cc936c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:29.668080 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255a58c5-955a-416f-9122-e5a4cc936c4a None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:29.670717 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255a58c5-955a-416f-9122-e5a4cc936c4a None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:29.670717 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255a58c5-955a-416f-9122-e5a4cc936c4a None admin] PATH_INFO: `/v3/users/94b2925bbad14739894a8060d5cdc59e` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:29.670914 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e02d6c-885e-4c71-88a0-52f1e0ef4de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:29.670914 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e02d6c-885e-4c71-88a0-52f1e0ef4de7 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:29.670914 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e02d6c-885e-4c71-88a0-52f1e0ef4de7 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:29.670914 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e02d6c-885e-4c71-88a0-52f1e0ef4de7 None admin] PATH_INFO: `/v3/projects/b2d7081316264626896ee5ec5050f5de` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:29.673080 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e02d6c-885e-4c71-88a0-52f1e0ef4de7 None admin] RBAC: Authorizing `identity:get_project(project_id=b2d7081316264626896ee5ec5050f5de)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:29.673987 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e02d6c-885e-4c71-88a0-52f1e0ef4de7 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:29.676010 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 66/123] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 14 17:36:29 2022] GET /identity/v3/projects/b2d7081316264626896ee5ec5050f5de => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:36:29.677165 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e02d6c-885e-4c71-88a0-52f1e0ef4de7 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:29.686495 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255a58c5-955a-416f-9122-e5a4cc936c4a None admin] RBAC: Authorizing `identity:get_user(user_id=94b2925bbad14739894a8060d5cdc59e)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:29.688754 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255a58c5-955a-416f-9122-e5a4cc936c4a None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:29.691192 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 58/124] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 14 17:36:29 2022] GET /identity/v3/users/94b2925bbad14739894a8060d5cdc59e => generated 289 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:36:29.692753 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c05ea6-c03c-4844-8e1f-afd447c5eea4 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:29.693287 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c05ea6-c03c-4844-8e1f-afd447c5eea4 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:29.693722 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c05ea6-c03c-4844-8e1f-afd447c5eea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:29.714507 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-f1c05ea6-c03c-4844-8e1f-afd447c5eea4 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:36:29.716003 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-f1c05ea6-c03c-4844-8e1f-afd447c5eea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:36:29.792956 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 59/125] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:36:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:36:29.794061 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c05ea6-c03c-4844-8e1f-afd447c5eea4 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:29.810570 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:29.834917 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e02d6c-885e-4c71-88a0-52f1e0ef4de7 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:29.874695 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb21bbc-d851-4144-a405-8022d800ecb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:29.875617 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb21bbc-d851-4144-a405-8022d800ecb5 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:29.875913 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb21bbc-d851-4144-a405-8022d800ecb5 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:29.876700 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb21bbc-d851-4144-a405-8022d800ecb5 None admin] PATH_INFO: `/v3/users/48d36fad27cf4eff8510c2ec4719697c` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:29.877953 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb21bbc-d851-4144-a405-8022d800ecb5 None admin] RBAC: Authorizing `identity:get_user(user_id=48d36fad27cf4eff8510c2ec4719697c)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:29.879503 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb21bbc-d851-4144-a405-8022d800ecb5 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:29.882293 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 67/126] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 14 17:36:29 2022] GET /identity/v3/users/48d36fad27cf4eff8510c2ec4719697c => generated 275 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:36:29.883248 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb21bbc-d851-4144-a405-8022d800ecb5 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:29.931251 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c05ea6-c03c-4844-8e1f-afd447c5eea4 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:29.971008 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2538acb8-8786-457a-aa77-5dcc288fcde7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:29.971890 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2538acb8-8786-457a-aa77-5dcc288fcde7 None admin] REQUEST_METHOD: `PUT` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:29.972248 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2538acb8-8786-457a-aa77-5dcc288fcde7 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:29.972604 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2538acb8-8786-457a-aa77-5dcc288fcde7 None admin] PATH_INFO: `/v3/projects/b2d7081316264626896ee5ec5050f5de/users/48d36fad27cf4eff8510c2ec4719697c/roles/9ee80134743f4c2b88525b04df2facba` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:29.976576 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2538acb8-8786-457a-aa77-5dcc288fcde7 None admin] RBAC: Authorizing `identity:create_grant(project_id=b2d7081316264626896ee5ec5050f5de, user_id=48d36fad27cf4eff8510c2ec4719697c, role_id=9ee80134743f4c2b88525b04df2facba)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:29.978434 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2538acb8-8786-457a-aa77-5dcc288fcde7 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:29.982921 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:30.026631 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb21bbc-d851-4144-a405-8022d800ecb5 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:30.063775 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f4a1ad-f3e0-4f9c-a6e0-9761ac9eb946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:30.064442 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f4a1ad-f3e0-4f9c-a6e0-9761ac9eb946 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:30.064734 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f4a1ad-f3e0-4f9c-a6e0-9761ac9eb946 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:30.065021 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f4a1ad-f3e0-4f9c-a6e0-9761ac9eb946 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:30.138422 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 60/127] 10.222.0.36 () {58 vars in 1439 bytes} [Tue Jun 14 17:36:29 2022] PUT /identity/v3/projects/b2d7081316264626896ee5ec5050f5de/users/48d36fad27cf4eff8510c2ec4719697c/roles/9ee80134743f4c2b88525b04df2facba => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:36:30.140458 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2538acb8-8786-457a-aa77-5dcc288fcde7 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:30.142307 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f4a1ad-f3e0-4f9c-a6e0-9761ac9eb946 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:30.143941 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f4a1ad-f3e0-4f9c-a6e0-9761ac9eb946 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:30.250108 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:30.307435 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 68/128] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 14 17:36:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 14 17:36:30.308940 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f4a1ad-f3e0-4f9c-a6e0-9761ac9eb946 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:30.325863 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:30.398595 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2538acb8-8786-457a-aa77-5dcc288fcde7 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:30.439134 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f4a1ad-f3e0-4f9c-a6e0-9761ac9eb946 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:30.447957 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a503401a-2bfc-4c20-97ee-8f398b3ed351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:30.449370 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a503401a-2bfc-4c20-97ee-8f398b3ed351 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:30.449667 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a503401a-2bfc-4c20-97ee-8f398b3ed351 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:30.449954 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a503401a-2bfc-4c20-97ee-8f398b3ed351 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:30.464484 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a503401a-2bfc-4c20-97ee-8f398b3ed351 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:36:30.474858 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-a503401a-2bfc-4c20-97ee-8f398b3ed351 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 14 17:36:30.474858 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:36:30.474858 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:36:30.474858 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:36:30.474858 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:36:30.474858 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:36:30.474858 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:36:30.474858 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:36:30.474858 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:36:30.474858 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:36:30.474858 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:36:30.474858 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:36:30.474858 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:36:30.474858 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:36:30.474858 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:36:30.474858 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:36:30.475757 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:36:30.475757 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:36:30.475757 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:36:30.475757 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:36:30.475757 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:36:30.475757 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:36:30.475757 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:36:30.475757 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:36:30.475757 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:36:30.475757 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:36:30.475757 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:36:30.475757 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:36:30.475757 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:36:30.475757 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:36:30.475757 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:36:30.475757 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:36:30.476507 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:36:30.476507 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:36:30.476507 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:36:30.476507 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:36:30.476507 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:36:30.476507 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:36:30.476507 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:36:30.476507 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:36:30.476507 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:36:30.476507 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:36:30.476507 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 14 17:36:30.476507 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:36:30.478934 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 61/129] 10.222.0.36 () {56 vars in 1114 bytes} [Tue Jun 14 17:36:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:36:30.480179 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a503401a-2bfc-4c20-97ee-8f398b3ed351 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:30.493109 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b00935-36f1-4e32-bca7-5e89ba8f811e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:30.494363 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b00935-36f1-4e32-bca7-5e89ba8f811e None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:30.494879 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b00935-36f1-4e32-bca7-5e89ba8f811e None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:30.495408 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b00935-36f1-4e32-bca7-5e89ba8f811e None admin] PATH_INFO: `/v3/projects/04b70fac2c57427fa08aa88ec925923b` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:30.496980 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b00935-36f1-4e32-bca7-5e89ba8f811e None admin] RBAC: Authorizing `identity:get_project(project_id=04b70fac2c57427fa08aa88ec925923b)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:30.498642 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b00935-36f1-4e32-bca7-5e89ba8f811e None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:30.500714 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 69/130] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 14 17:36:30 2022] GET /identity/v3/projects/04b70fac2c57427fa08aa88ec925923b => generated 312 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:36:30.501909 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b00935-36f1-4e32-bca7-5e89ba8f811e None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:30.570249 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:30.621078 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a503401a-2bfc-4c20-97ee-8f398b3ed351 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:30.664197 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:30.671165 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b09ed1-80fb-4b09-a238-48ddd907fde5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:30.672297 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b09ed1-80fb-4b09-a238-48ddd907fde5 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:30.672817 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b09ed1-80fb-4b09-a238-48ddd907fde5 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:30.673766 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b09ed1-80fb-4b09-a238-48ddd907fde5 None admin] PATH_INFO: `/v3/projects/b2d7081316264626896ee5ec5050f5de` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:30.675501 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b09ed1-80fb-4b09-a238-48ddd907fde5 None admin] RBAC: Authorizing `identity:get_project(project_id=b2d7081316264626896ee5ec5050f5de)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:30.677445 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b09ed1-80fb-4b09-a238-48ddd907fde5 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:30.679763 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 62/131] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 14 17:36:30 2022] GET /identity/v3/projects/b2d7081316264626896ee5ec5050f5de => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:36:30.681149 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b09ed1-80fb-4b09-a238-48ddd907fde5 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:30.715805 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b00935-36f1-4e32-bca7-5e89ba8f811e None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:30.756449 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b258d3-c06d-4835-967c-114c581f4541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:30.757492 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b258d3-c06d-4835-967c-114c581f4541 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:30.757974 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b258d3-c06d-4835-967c-114c581f4541 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:30.758471 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b258d3-c06d-4835-967c-114c581f4541 None admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:30.759479 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b258d3-c06d-4835-967c-114c581f4541 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:36:30.759987 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b258d3-c06d-4835-967c-114c581f4541 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:30.761635 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b258d3-c06d-4835-967c-114c581f4541 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:30.772172 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 70/132] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 14 17:36:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:36:30.773532 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b258d3-c06d-4835-967c-114c581f4541 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:30.817028 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b09ed1-80fb-4b09-a238-48ddd907fde5 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:30.860549 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce5d95f-b722-45a6-b597-f8bd9b9e1180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:30.861826 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce5d95f-b722-45a6-b597-f8bd9b9e1180 None admin] REQUEST_METHOD: `PUT` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:30.862314 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce5d95f-b722-45a6-b597-f8bd9b9e1180 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:30.862842 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce5d95f-b722-45a6-b597-f8bd9b9e1180 None admin] PATH_INFO: `/v3/projects/04b70fac2c57427fa08aa88ec925923b/users/48d36fad27cf4eff8510c2ec4719697c/roles/9ee80134743f4c2b88525b04df2facba` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:30.866127 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce5d95f-b722-45a6-b597-f8bd9b9e1180 None admin] RBAC: Authorizing `identity:create_grant(project_id=04b70fac2c57427fa08aa88ec925923b, user_id=48d36fad27cf4eff8510c2ec4719697c, role_id=9ee80134743f4c2b88525b04df2facba)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:30.868032 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce5d95f-b722-45a6-b597-f8bd9b9e1180 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:30.885954 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:30.896295 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b258d3-c06d-4835-967c-114c581f4541 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:30.933486 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c5cd94-a3ea-490f-b29b-86d3dea0c39e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:30.934116 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c5cd94-a3ea-490f-b29b-86d3dea0c39e None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:30.934411 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c5cd94-a3ea-490f-b29b-86d3dea0c39e None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:30.934694 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c5cd94-a3ea-490f-b29b-86d3dea0c39e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:30.935566 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c5cd94-a3ea-490f-b29b-86d3dea0c39e None admin] RBAC: Adding query filter params (role.id=2b061f334d51497f88c144fcf5764eeb, scope.project.id=b2d7081316264626896ee5ec5050f5de, user.id=94b2925bbad14739894a8060d5cdc59e) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:36:30.935917 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c5cd94-a3ea-490f-b29b-86d3dea0c39e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:30.937373 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c5cd94-a3ea-490f-b29b-86d3dea0c39e None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:30.944118 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 71/133] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 14 17:36:30 2022] GET /identity/v3/role_assignments?user.id=94b2925bbad14739894a8060d5cdc59e&scope.project.id=b2d7081316264626896ee5ec5050f5de&role.id=2b061f334d51497f88c144fcf5764eeb => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:36:30.946064 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb3d2d2-53fc-453d-8523-7574bdca6780 None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:30.946424 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb3d2d2-53fc-453d-8523-7574bdca6780 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:30.946729 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb3d2d2-53fc-453d-8523-7574bdca6780 None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:30.948533 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 72/134] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:36:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:36:30.949402 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb3d2d2-53fc-453d-8523-7574bdca6780 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:30.951853 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 63/135] 10.222.0.36 () {58 vars in 1439 bytes} [Tue Jun 14 17:36:30 2022] PUT /identity/v3/projects/04b70fac2c57427fa08aa88ec925923b/users/48d36fad27cf4eff8510c2ec4719697c/roles/9ee80134743f4c2b88525b04df2facba => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:36:30.973147 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea149f85-1953-47e2-b452-0610dbbcc623 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:30.973147 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea149f85-1953-47e2-b452-0610dbbcc623 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:30.973147 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea149f85-1953-47e2-b452-0610dbbcc623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:30.982281 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-ea149f85-1953-47e2-b452-0610dbbcc623 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:36:30.984795 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-ea149f85-1953-47e2-b452-0610dbbcc623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:36:31.123531 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:31.148860 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 64/136] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:36:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 14 17:36:31.158594 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb3d2d2-53fc-453d-8523-7574bdca6780 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:31.188363 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea149f85-1953-47e2-b452-0610dbbcc623 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:31.219888 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2023d146-e907-4769-b9be-78d7c1c8f440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:31.220795 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2023d146-e907-4769-b9be-78d7c1c8f440 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:31.221089 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2023d146-e907-4769-b9be-78d7c1c8f440 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:31.221369 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2023d146-e907-4769-b9be-78d7c1c8f440 None admin] PATH_INFO: `/v3/users/48d36fad27cf4eff8510c2ec4719697c` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:31.225553 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2023d146-e907-4769-b9be-78d7c1c8f440 None admin] RBAC: Authorizing `identity:get_user(user_id=48d36fad27cf4eff8510c2ec4719697c)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:31.227290 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2023d146-e907-4769-b9be-78d7c1c8f440 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:31.229073 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 73/137] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 14 17:36:30 2022] GET /identity/v3/users/48d36fad27cf4eff8510c2ec4719697c => generated 275 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:36:31.235350 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2023d146-e907-4769-b9be-78d7c1c8f440 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:31.297713 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:31.370247 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea149f85-1953-47e2-b452-0610dbbcc623 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:31.383640 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2023d146-e907-4769-b9be-78d7c1c8f440 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:31.410252 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27abdba-65d6-4fe0-873b-699e901b0283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:31.412066 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27abdba-65d6-4fe0-873b-699e901b0283 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:31.412812 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27abdba-65d6-4fe0-873b-699e901b0283 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:31.413404 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27abdba-65d6-4fe0-873b-699e901b0283 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:31.421839 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f870515-0465-4b7b-a96e-9ebb81ecc267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:31.422634 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f870515-0465-4b7b-a96e-9ebb81ecc267 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:31.422927 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f870515-0465-4b7b-a96e-9ebb81ecc267 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:31.423210 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f870515-0465-4b7b-a96e-9ebb81ecc267 None admin] PATH_INFO: `/v3/projects/b2d7081316264626896ee5ec5050f5de` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:31.424544 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f870515-0465-4b7b-a96e-9ebb81ecc267 None admin] RBAC: Authorizing `identity:get_project(project_id=b2d7081316264626896ee5ec5050f5de)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:31.426070 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f870515-0465-4b7b-a96e-9ebb81ecc267 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:31.429299 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 74/138] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 14 17:36:31 2022] GET /identity/v3/projects/b2d7081316264626896ee5ec5050f5de => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:36:31.429830 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27abdba-65d6-4fe0-873b-699e901b0283 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:36:31.437768 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-b27abdba-65d6-4fe0-873b-699e901b0283 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 17:36:31.437768 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:36:31.437768 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:36:31.437768 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:36:31.437768 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:36:31.437768 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:36:31.437768 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:36:31.437768 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:36:31.437768 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:36:31.437768 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:36:31.437768 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:36:31.437768 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:36:31.437768 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:36:31.437768 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:36:31.437768 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:36:31.437768 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:36:31.438678 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:36:31.438678 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:36:31.438678 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:36:31.438678 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:36:31.438678 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:36:31.438678 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:36:31.438678 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:36:31.438678 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:36:31.438678 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:36:31.438678 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:36:31.438678 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:36:31.438678 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:36:31.438678 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:36:31.438678 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:36:31.438678 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:36:31.438678 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:36:31.439515 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:36:31.439515 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:36:31.439515 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:36:31.439515 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:36:31.439515 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:36:31.439515 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:36:31.439515 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:36:31.439515 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:36:31.439515 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:36:31.439515 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:36:31.439515 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 17:36:31.439515 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:36:31.440927 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f870515-0465-4b7b-a96e-9ebb81ecc267 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:31.442117 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 65/139] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jun 14 17:36:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 17:36:31.447804 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27abdba-65d6-4fe0-873b-699e901b0283 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:31.505582 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:31.566850 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27abdba-65d6-4fe0-873b-699e901b0283 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:31.599124 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:31.605800 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f870515-0465-4b7b-a96e-9ebb81ecc267 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:31.606439 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a83c5a0-872c-42d5-ae40-28672a8519d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:31.607397 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a83c5a0-872c-42d5-ae40-28672a8519d8 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:31.607868 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a83c5a0-872c-42d5-ae40-28672a8519d8 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:31.608314 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a83c5a0-872c-42d5-ae40-28672a8519d8 None admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:31.609238 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a83c5a0-872c-42d5-ae40-28672a8519d8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:36:31.615037 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a83c5a0-872c-42d5-ae40-28672a8519d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:31.615037 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a83c5a0-872c-42d5-ae40-28672a8519d8 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:31.621318 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 66/140] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 14 17:36:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:36:31.622742 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60506184-c91a-4577-8cd6-51d451c674b9 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:31.623047 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60506184-c91a-4577-8cd6-51d451c674b9 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:31.623364 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60506184-c91a-4577-8cd6-51d451c674b9 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:31.624610 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 67/141] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:36:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:36:31.628799 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60506184-c91a-4577-8cd6-51d451c674b9 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:31.643117 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e38599e-7db5-4bd7-b2e1-8fb73f3654f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:31.644057 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e38599e-7db5-4bd7-b2e1-8fb73f3654f3 None admin] REQUEST_METHOD: `PUT` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:31.644347 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e38599e-7db5-4bd7-b2e1-8fb73f3654f3 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:31.644630 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e38599e-7db5-4bd7-b2e1-8fb73f3654f3 None admin] PATH_INFO: `/v3/projects/b2d7081316264626896ee5ec5050f5de/users/48d36fad27cf4eff8510c2ec4719697c/roles/e41c4e25dfdf4810aab2231cf98c98a9` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:31.647109 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e38599e-7db5-4bd7-b2e1-8fb73f3654f3 None admin] RBAC: Authorizing `identity:create_grant(project_id=b2d7081316264626896ee5ec5050f5de, user_id=48d36fad27cf4eff8510c2ec4719697c, role_id=e41c4e25dfdf4810aab2231cf98c98a9)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:31.648627 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e38599e-7db5-4bd7-b2e1-8fb73f3654f3 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:31.719152 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 75/142] 10.222.0.36 () {58 vars in 1439 bytes} [Tue Jun 14 17:36:31 2022] PUT /identity/v3/projects/b2d7081316264626896ee5ec5050f5de/users/48d36fad27cf4eff8510c2ec4719697c/roles/e41c4e25dfdf4810aab2231cf98c98a9 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:36:31.720552 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac442503-6201-435f-99ca-71a47f543a3f None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:31.720903 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac442503-6201-435f-99ca-71a47f543a3f None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:31.721193 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac442503-6201-435f-99ca-71a47f543a3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:31.743227 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60506184-c91a-4577-8cd6-51d451c674b9 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:31.760467 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:31.764425 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-ac442503-6201-435f-99ca-71a47f543a3f None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:36:31.765676 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-ac442503-6201-435f-99ca-71a47f543a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:36:31.787336 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961d8ae9-beea-4a68-9538-1d900237971d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:31.788241 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d8ae9-beea-4a68-9538-1d900237971d None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:31.788539 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d8ae9-beea-4a68-9538-1d900237971d None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:31.788824 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d8ae9-beea-4a68-9538-1d900237971d None admin] PATH_INFO: `/v3/users/bdaeb72186c0489e804154d6d26ae21b` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:31.792559 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961d8ae9-beea-4a68-9538-1d900237971d None admin] RBAC: Authorizing `identity:get_user(user_id=bdaeb72186c0489e804154d6d26ae21b)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:31.792559 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961d8ae9-beea-4a68-9538-1d900237971d None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:31.793404 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 68/143] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 14 17:36:31 2022] GET /identity/v3/users/bdaeb72186c0489e804154d6d26ae21b => generated 247 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:36:31.798942 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961d8ae9-beea-4a68-9538-1d900237971d None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:31.897750 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 76/144] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:36:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:36:31.921800 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961d8ae9-beea-4a68-9538-1d900237971d None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:31.956726 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac442503-6201-435f-99ca-71a47f543a3f None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:31.959404 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7146474d-dc7e-4538-b3f6-d516a629c058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:31.960099 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7146474d-dc7e-4538-b3f6-d516a629c058 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:31.960395 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7146474d-dc7e-4538-b3f6-d516a629c058 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:31.960681 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7146474d-dc7e-4538-b3f6-d516a629c058 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:32.019463 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:32.037801 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7146474d-dc7e-4538-b3f6-d516a629c058 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:32.039638 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7146474d-dc7e-4538-b3f6-d516a629c058 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:32.153482 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 69/145] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 14 17:36:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 14 17:36:32.159044 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7146474d-dc7e-4538-b3f6-d516a629c058 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:32.181936 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:32.199812 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac442503-6201-435f-99ca-71a47f543a3f None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:32.256094 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8a9449-6510-4320-9caa-b0f7ea296fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:32.256919 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8a9449-6510-4320-9caa-b0f7ea296fc8 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:32.257206 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8a9449-6510-4320-9caa-b0f7ea296fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:32.257488 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8a9449-6510-4320-9caa-b0f7ea296fc8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:32.258744 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8a9449-6510-4320-9caa-b0f7ea296fc8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:32.260240 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8a9449-6510-4320-9caa-b0f7ea296fc8 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:32.261889 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 77/146] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 14 17:36:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:36:32.267138 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8a9449-6510-4320-9caa-b0f7ea296fc8 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:32.296856 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:32.347146 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7146474d-dc7e-4538-b3f6-d516a629c058 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:32.413943 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8a9449-6510-4320-9caa-b0f7ea296fc8 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:32.453269 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e5d2ae-a942-4c48-b2b7-ae5f6ae92ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:32.454148 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e5d2ae-a942-4c48-b2b7-ae5f6ae92ead None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:32.454438 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e5d2ae-a942-4c48-b2b7-ae5f6ae92ead None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:32.454721 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e5d2ae-a942-4c48-b2b7-ae5f6ae92ead None admin] PATH_INFO: `/v3/projects/b2d7081316264626896ee5ec5050f5de` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:32.456227 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e5d2ae-a942-4c48-b2b7-ae5f6ae92ead None admin] RBAC: Authorizing `identity:get_project(project_id=b2d7081316264626896ee5ec5050f5de)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:32.457697 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e5d2ae-a942-4c48-b2b7-ae5f6ae92ead None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:32.459502 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 70/147] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 14 17:36:32 2022] GET /identity/v3/projects/b2d7081316264626896ee5ec5050f5de => generated 298 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:36:32.460791 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9129264f-9283-4162-b5fd-87adc5ce260a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:32.461480 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9129264f-9283-4162-b5fd-87adc5ce260a None admin] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:32.461766 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9129264f-9283-4162-b5fd-87adc5ce260a None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:32.462044 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9129264f-9283-4162-b5fd-87adc5ce260a None admin] PATH_INFO: `/v3/users` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:32.462770 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9129264f-9283-4162-b5fd-87adc5ce260a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:32.464239 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9129264f-9283-4162-b5fd-87adc5ce260a None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:32.470137 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e5d2ae-a942-4c48-b2b7-ae5f6ae92ead None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:32.566124 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 78/148] 10.222.0.36 () {60 vars in 1132 bytes} [Tue Jun 14 17:36:32 2022] POST /identity/v3/users => generated 283 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 17:36:32.594030 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e5d2ae-a942-4c48-b2b7-ae5f6ae92ead None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:32.636856 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b08a18d-e11e-4c0d-af21-55de2ce145d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:32.637559 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b08a18d-e11e-4c0d-af21-55de2ce145d0 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:32.637851 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b08a18d-e11e-4c0d-af21-55de2ce145d0 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:32.638138 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b08a18d-e11e-4c0d-af21-55de2ce145d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:32.639066 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b08a18d-e11e-4c0d-af21-55de2ce145d0 None admin] RBAC: Adding query filter params (role.id=1348580877d04014bfdec4d866b98a74, scope.project.id=b2d7081316264626896ee5ec5050f5de, user.id=bdaeb72186c0489e804154d6d26ae21b) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:36:32.639422 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b08a18d-e11e-4c0d-af21-55de2ce145d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:32.640980 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b08a18d-e11e-4c0d-af21-55de2ce145d0 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:32.648340 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 71/149] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 14 17:36:32 2022] GET /identity/v3/role_assignments?user.id=bdaeb72186c0489e804154d6d26ae21b&scope.project.id=b2d7081316264626896ee5ec5050f5de&role.id=1348580877d04014bfdec4d866b98a74 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:36:33.216250 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab162be-7964-41b8-9787-0864bb4c6061 None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:33.216764 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab162be-7964-41b8-9787-0864bb4c6061 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:33.216861 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab162be-7964-41b8-9787-0864bb4c6061 None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:33.218189 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 79/150] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:36:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:36:33.223388 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bacaae6-1d45-4599-9f3c-2f1c0427f9fa None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:33.224228 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bacaae6-1d45-4599-9f3c-2f1c0427f9fa None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:33.224517 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bacaae6-1d45-4599-9f3c-2f1c0427f9fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:33.244634 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-9bacaae6-1d45-4599-9f3c-2f1c0427f9fa None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:36:33.245882 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-9bacaae6-1d45-4599-9f3c-2f1c0427f9fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:36:33.253824 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:33.329730 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 72/151] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:36:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:36:33.354976 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab162be-7964-41b8-9787-0864bb4c6061 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:33.368745 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:33.495073 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab162be-7964-41b8-9787-0864bb4c6061 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:33.540091 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed11d41-514d-4c26-82c8-0492c97792b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:33.541263 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed11d41-514d-4c26-82c8-0492c97792b3 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:33.541749 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed11d41-514d-4c26-82c8-0492c97792b3 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:33.542222 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed11d41-514d-4c26-82c8-0492c97792b3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:33.558277 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed11d41-514d-4c26-82c8-0492c97792b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:36:33.566522 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-0ed11d41-514d-4c26-82c8-0492c97792b3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 14 17:36:33.566522 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:36:33.566522 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:36:33.566522 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:36:33.566522 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:36:33.566522 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:36:33.566522 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:36:33.566522 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:36:33.566522 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:36:33.566522 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:36:33.566522 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:36:33.566522 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:36:33.566522 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:36:33.566522 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:36:33.566522 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:36:33.566522 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:36:33.567577 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:36:33.567577 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:36:33.567577 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:36:33.567577 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:36:33.567577 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:36:33.567577 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:36:33.567577 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:36:33.567577 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:36:33.567577 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:36:33.567577 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:36:33.567577 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:36:33.567577 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:36:33.567577 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:36:33.567577 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:36:33.567577 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:36:33.567577 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:36:33.568328 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:36:33.568328 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:36:33.568328 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:36:33.568328 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:36:33.568328 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:36:33.568328 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:36:33.568328 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:36:33.568328 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:36:33.568328 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:36:33.568328 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:36:33.568328 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 14 17:36:33.568328 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:36:33.570805 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 80/152] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 14 17:36:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:36:33.576962 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bacaae6-1d45-4599-9f3c-2f1c0427f9fa None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:33.702662 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bacaae6-1d45-4599-9f3c-2f1c0427f9fa None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:33.742647 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770af029-519e-4b0a-ae0a-946b78cf56d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:33.743363 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770af029-519e-4b0a-ae0a-946b78cf56d7 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:33.743659 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770af029-519e-4b0a-ae0a-946b78cf56d7 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:33.743947 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770af029-519e-4b0a-ae0a-946b78cf56d7 None admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:33.744710 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770af029-519e-4b0a-ae0a-946b78cf56d7 None admin] RBAC: Adding query filter params (name=member) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:36:33.745025 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770af029-519e-4b0a-ae0a-946b78cf56d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:33.746463 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770af029-519e-4b0a-ae0a-946b78cf56d7 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:33.756112 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 73/153] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Jun 14 17:36:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:36:33.761704 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed11d41-514d-4c26-82c8-0492c97792b3 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:33.863345 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:33.913951 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed11d41-514d-4c26-82c8-0492c97792b3 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:33.958567 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b13524f-fecb-44ee-8ce2-92f067116299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:33.959749 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b13524f-fecb-44ee-8ce2-92f067116299 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:33.960040 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b13524f-fecb-44ee-8ce2-92f067116299 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:33.960317 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b13524f-fecb-44ee-8ce2-92f067116299 None admin] PATH_INFO: `/v3/users/48d36fad27cf4eff8510c2ec4719697c` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:33.961550 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b13524f-fecb-44ee-8ce2-92f067116299 None admin] RBAC: Authorizing `identity:get_user(user_id=48d36fad27cf4eff8510c2ec4719697c)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:33.963007 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b13524f-fecb-44ee-8ce2-92f067116299 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:33.964975 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 81/154] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 14 17:36:33 2022] GET /identity/v3/users/48d36fad27cf4eff8510c2ec4719697c => generated 275 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:36:33.970350 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770af029-519e-4b0a-ae0a-946b78cf56d7 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:33.983116 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:33.988245 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cc200a-486a-4812-842f-d67f685e91cf None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:33.988740 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cc200a-486a-4812-842f-d67f685e91cf None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:33.989238 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cc200a-486a-4812-842f-d67f685e91cf None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:33.990862 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 82/155] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:36:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 14 17:36:33.996414 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef94a101-3da7-497b-a2c2-80411e002066 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:33.997001 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef94a101-3da7-497b-a2c2-80411e002066 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:33.997434 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef94a101-3da7-497b-a2c2-80411e002066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:34.031446 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-ef94a101-3da7-497b-a2c2-80411e002066 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:36:34.033212 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-ef94a101-3da7-497b-a2c2-80411e002066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:36:34.110224 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770af029-519e-4b0a-ae0a-946b78cf56d7 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:34.152896 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 83/156] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:36:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 14 17:36:34.179706 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc95014-f4b8-4041-9dc9-bfd5fa47c75f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:34.180680 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc95014-f4b8-4041-9dc9-bfd5fa47c75f None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:34.181150 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc95014-f4b8-4041-9dc9-bfd5fa47c75f None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:34.181585 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc95014-f4b8-4041-9dc9-bfd5fa47c75f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:34.231401 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef94a101-3da7-497b-a2c2-80411e002066 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:34.285083 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc95014-f4b8-4041-9dc9-bfd5fa47c75f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:34.287441 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc95014-f4b8-4041-9dc9-bfd5fa47c75f None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:34.291060 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:34.327365 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:34.368248 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef94a101-3da7-497b-a2c2-80411e002066 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:34.415645 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597254b0-2d58-44e9-98a4-0f24d569cf53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:34.416877 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597254b0-2d58-44e9-98a4-0f24d569cf53 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:34.417397 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597254b0-2d58-44e9-98a4-0f24d569cf53 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:34.417871 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597254b0-2d58-44e9-98a4-0f24d569cf53 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:34.432143 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597254b0-2d58-44e9-98a4-0f24d569cf53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:36:34.442414 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-597254b0-2d58-44e9-98a4-0f24d569cf53 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 14 17:36:34.442414 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:36:34.442414 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:36:34.442414 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:36:34.442414 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:36:34.442414 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:36:34.442414 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:36:34.442414 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:36:34.442414 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:36:34.442414 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:36:34.442414 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:36:34.442414 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:36:34.442414 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:36:34.442414 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:36:34.442414 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:36:34.442414 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:36:34.443394 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:36:34.443394 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:36:34.443394 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:36:34.443394 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:36:34.443394 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:36:34.443394 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:36:34.443394 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:36:34.443394 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:36:34.443394 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:36:34.443394 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:36:34.443394 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:36:34.443394 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:36:34.443394 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:36:34.443394 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:36:34.443394 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:36:34.443394 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:36:34.444194 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:36:34.444194 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:36:34.444194 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:36:34.444194 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:36:34.444194 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:36:34.444194 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:36:34.444194 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:36:34.444194 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:36:34.444194 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:36:34.444194 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:36:34.444194 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 14 17:36:34.444194 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:36:34.446802 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 84/157] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 14 17:36:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 17:36:34.453230 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd0b01-744b-438a-900e-d0227ac837d2 None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:34.453815 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd0b01-744b-438a-900e-d0227ac837d2 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:34.454364 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd0b01-744b-438a-900e-d0227ac837d2 None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:34.456023 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 85/158] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:36:34 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:36:34.458469 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bd0b01-744b-438a-900e-d0227ac837d2 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:34.510240 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 74/159] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 14 17:36:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 540 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 14 17:36:34.512028 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808a6b77-bd4a-48c9-86c2-4f27cbfaf25e None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:34.512652 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808a6b77-bd4a-48c9-86c2-4f27cbfaf25e None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:34.516923 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808a6b77-bd4a-48c9-86c2-4f27cbfaf25e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:34.553465 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-808a6b77-bd4a-48c9-86c2-4f27cbfaf25e None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:36:34.555217 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-808a6b77-bd4a-48c9-86c2-4f27cbfaf25e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:36:34.655992 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bd0b01-744b-438a-900e-d0227ac837d2 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:34.657192 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 75/160] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:36:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:36:34.658581 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808a6b77-bd4a-48c9-86c2-4f27cbfaf25e None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:34.694949 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:34.695485 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:34.713130 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b510b19a-be00-4319-a6b4-0f0300da336f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:34.715050 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b510b19a-be00-4319-a6b4-0f0300da336f None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:34.715050 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b510b19a-be00-4319-a6b4-0f0300da336f None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:34.715050 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b510b19a-be00-4319-a6b4-0f0300da336f None admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:34.715442 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b510b19a-be00-4319-a6b4-0f0300da336f None admin] RBAC: Adding query filter params (name=reader) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:36:34.715822 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b510b19a-be00-4319-a6b4-0f0300da336f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:34.717229 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b510b19a-be00-4319-a6b4-0f0300da336f None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:34.738041 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 86/161] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Jun 14 17:36:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:36:34.739400 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b510b19a-be00-4319-a6b4-0f0300da336f None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:34.773930 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808a6b77-bd4a-48c9-86c2-4f27cbfaf25e None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:34.817647 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c74a9c-14e1-40ec-a694-ed8aa1ee3bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:34.818506 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c74a9c-14e1-40ec-a694-ed8aa1ee3bec None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:34.818899 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c74a9c-14e1-40ec-a694-ed8aa1ee3bec None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:34.819190 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c74a9c-14e1-40ec-a694-ed8aa1ee3bec None admin] PATH_INFO: `/v3/projects/b2d7081316264626896ee5ec5050f5de` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:34.821841 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c74a9c-14e1-40ec-a694-ed8aa1ee3bec None admin] RBAC: Authorizing `identity:get_project(project_id=b2d7081316264626896ee5ec5050f5de)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:34.823612 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c74a9c-14e1-40ec-a694-ed8aa1ee3bec None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:34.825572 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 76/162] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 14 17:36:34 2022] GET /identity/v3/projects/b2d7081316264626896ee5ec5050f5de => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:36:34.826354 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c74a9c-14e1-40ec-a694-ed8aa1ee3bec None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:34.878559 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b510b19a-be00-4319-a6b4-0f0300da336f None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:34.944889 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c74a9c-14e1-40ec-a694-ed8aa1ee3bec None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:34.946702 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:34.947424 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248db615-ffee-464a-9750-d350f9bb0859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:34.948263 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248db615-ffee-464a-9750-d350f9bb0859 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:34.948552 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248db615-ffee-464a-9750-d350f9bb0859 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:34.948832 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248db615-ffee-464a-9750-d350f9bb0859 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:34.976827 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248db615-ffee-464a-9750-d350f9bb0859 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:36:34.984729 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-248db615-ffee-464a-9750-d350f9bb0859 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 14 17:36:34.984729 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:36:34.984729 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:36:34.984729 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:36:34.984729 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:36:34.984729 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:36:34.984729 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:36:34.984729 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:36:34.984729 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:36:34.984729 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:36:34.984729 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:36:34.984729 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:36:34.984729 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:36:34.984729 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:36:34.984729 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:36:34.984729 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:36:34.985583 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:36:34.985583 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:36:34.985583 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:36:34.985583 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:36:34.985583 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:36:34.985583 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:36:34.985583 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:36:34.985583 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:36:34.985583 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:36:34.985583 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:36:34.985583 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:36:34.985583 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:36:34.985583 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:36:34.985583 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:36:34.985583 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:36:34.985583 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:36:34.986444 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:36:34.986444 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:36:34.986444 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:36:34.986444 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:36:34.986444 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:36:34.986444 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:36:34.986444 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:36:34.986444 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:36:34.986444 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:36:34.986444 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:36:34.986444 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 14 17:36:34.986444 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:36:34.986444 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 87/163] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 14 17:36:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:36:34.991533 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248db615-ffee-464a-9750-d350f9bb0859 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:34.991758 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c71a6b6-8edb-46fc-b877-695a082009c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:34.992568 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c71a6b6-8edb-46fc-b877-695a082009c4 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:34.992883 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c71a6b6-8edb-46fc-b877-695a082009c4 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:34.993169 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c71a6b6-8edb-46fc-b877-695a082009c4 None admin] PATH_INFO: `/v3/users/94b2925bbad14739894a8060d5cdc59e` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:34.994514 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c71a6b6-8edb-46fc-b877-695a082009c4 None admin] RBAC: Authorizing `identity:get_user(user_id=94b2925bbad14739894a8060d5cdc59e)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:34.996137 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c71a6b6-8edb-46fc-b877-695a082009c4 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:34.998139 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 77/164] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 14 17:36:34 2022] GET /identity/v3/users/94b2925bbad14739894a8060d5cdc59e => generated 289 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:36:34.998886 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c71a6b6-8edb-46fc-b877-695a082009c4 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:35.072719 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:35.159317 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c71a6b6-8edb-46fc-b877-695a082009c4 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:35.160260 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248db615-ffee-464a-9750-d350f9bb0859 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:35.228671 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59888929-156b-4ee7-86e8-e6a77c10b676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:35.229360 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59888929-156b-4ee7-86e8-e6a77c10b676 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:35.229642 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59888929-156b-4ee7-86e8-e6a77c10b676 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:35.229924 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59888929-156b-4ee7-86e8-e6a77c10b676 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:35.230922 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59888929-156b-4ee7-86e8-e6a77c10b676 None admin] RBAC: Adding query filter params (role.id=9ee80134743f4c2b88525b04df2facba, scope.project.id=b2d7081316264626896ee5ec5050f5de, user.id=48d36fad27cf4eff8510c2ec4719697c) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:36:35.231244 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59888929-156b-4ee7-86e8-e6a77c10b676 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:35.232747 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59888929-156b-4ee7-86e8-e6a77c10b676 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:35.244663 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 88/165] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 14 17:36:34 2022] GET /identity/v3/role_assignments?user.id=48d36fad27cf4eff8510c2ec4719697c&scope.project.id=b2d7081316264626896ee5ec5050f5de&role.id=9ee80134743f4c2b88525b04df2facba => generated 608 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:36:35.245519 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59888929-156b-4ee7-86e8-e6a77c10b676 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:35.253754 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b79d04c-00b9-4564-9d24-d9ae9d70b70f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:35.254454 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b79d04c-00b9-4564-9d24-d9ae9d70b70f None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:35.255370 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b79d04c-00b9-4564-9d24-d9ae9d70b70f None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:35.255737 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b79d04c-00b9-4564-9d24-d9ae9d70b70f None admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:35.256623 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b79d04c-00b9-4564-9d24-d9ae9d70b70f None admin] RBAC: Adding query filter params (name=member) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:36:35.256973 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b79d04c-00b9-4564-9d24-d9ae9d70b70f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:35.258396 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b79d04c-00b9-4564-9d24-d9ae9d70b70f None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:35.278769 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 78/166] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Jun 14 17:36:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:36:35.284527 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b79d04c-00b9-4564-9d24-d9ae9d70b70f None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:35.350906 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:35.407544 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59888929-156b-4ee7-86e8-e6a77c10b676 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:35.434409 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:35.436051 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b79d04c-00b9-4564-9d24-d9ae9d70b70f None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:35.479325 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803bd637-11c0-49ae-b407-ae41287c99ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:35.479325 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803bd637-11c0-49ae-b407-ae41287c99ca None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:35.479325 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803bd637-11c0-49ae-b407-ae41287c99ca None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:35.479325 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803bd637-11c0-49ae-b407-ae41287c99ca None admin] PATH_INFO: `/v3/projects/b2d7081316264626896ee5ec5050f5de` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:35.479791 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803bd637-11c0-49ae-b407-ae41287c99ca None admin] RBAC: Authorizing `identity:get_project(project_id=b2d7081316264626896ee5ec5050f5de)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:35.480071 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803bd637-11c0-49ae-b407-ae41287c99ca None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:35.481822 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 89/167] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 14 17:36:35 2022] GET /identity/v3/projects/b2d7081316264626896ee5ec5050f5de => generated 298 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:36:35.482316 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdff7624-32ed-4b40-9820-00ae358cc7bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:35.483173 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1071063d-ca80-45f0-bc4c-2b693ac06b07 None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:35.483495 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1071063d-ca80-45f0-bc4c-2b693ac06b07 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:35.483700 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdff7624-32ed-4b40-9820-00ae358cc7bb None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:35.483883 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1071063d-ca80-45f0-bc4c-2b693ac06b07 None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:35.484309 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdff7624-32ed-4b40-9820-00ae358cc7bb None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:35.484735 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdff7624-32ed-4b40-9820-00ae358cc7bb None admin] PATH_INFO: `/v3/users/48d36fad27cf4eff8510c2ec4719697c` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:35.485059 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 90/168] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:36:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:36:35.488466 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1071063d-ca80-45f0-bc4c-2b693ac06b07 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:35.489640 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdff7624-32ed-4b40-9820-00ae358cc7bb None admin] RBAC: Authorizing `identity:get_user(user_id=48d36fad27cf4eff8510c2ec4719697c)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:35.491132 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdff7624-32ed-4b40-9820-00ae358cc7bb None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:35.493075 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 79/169] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 14 17:36:35 2022] GET /identity/v3/users/48d36fad27cf4eff8510c2ec4719697c => generated 275 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:36:35.500495 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdff7624-32ed-4b40-9820-00ae358cc7bb None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:35.655751 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1071063d-ca80-45f0-bc4c-2b693ac06b07 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:35.689665 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:35.694075 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdff7624-32ed-4b40-9820-00ae358cc7bb None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:35.703721 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640b910c-c66e-482a-b753-b91a5b464631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:35.704921 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640b910c-c66e-482a-b753-b91a5b464631 None admin] REQUEST_METHOD: `PUT` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:35.705376 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640b910c-c66e-482a-b753-b91a5b464631 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:35.705813 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640b910c-c66e-482a-b753-b91a5b464631 None admin] PATH_INFO: `/v3/projects/b2d7081316264626896ee5ec5050f5de/users/94b2925bbad14739894a8060d5cdc59e/roles/2b061f334d51497f88c144fcf5764eeb` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:35.709717 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640b910c-c66e-482a-b753-b91a5b464631 None admin] RBAC: Authorizing `identity:create_grant(project_id=b2d7081316264626896ee5ec5050f5de, user_id=94b2925bbad14739894a8060d5cdc59e, role_id=2b061f334d51497f88c144fcf5764eeb)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:35.709717 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640b910c-c66e-482a-b753-b91a5b464631 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:35.740199 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd558e8c-475a-4405-8a67-ca6a32cd3af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:35.740927 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd558e8c-475a-4405-8a67-ca6a32cd3af6 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:35.741222 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd558e8c-475a-4405-8a67-ca6a32cd3af6 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:35.741549 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd558e8c-475a-4405-8a67-ca6a32cd3af6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:35.798201 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 91/170] 10.222.0.36 () {58 vars in 1439 bytes} [Tue Jun 14 17:36:35 2022] PUT /identity/v3/projects/b2d7081316264626896ee5ec5050f5de/users/94b2925bbad14739894a8060d5cdc59e/roles/2b061f334d51497f88c144fcf5764eeb => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:36:35.803466 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215e8cb5-c3ee-4723-a8ec-5c9741f2824b None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:35.804373 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215e8cb5-c3ee-4723-a8ec-5c9741f2824b None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:35.805038 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215e8cb5-c3ee-4723-a8ec-5c9741f2824b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:35.827087 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd558e8c-475a-4405-8a67-ca6a32cd3af6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:35.827087 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd558e8c-475a-4405-8a67-ca6a32cd3af6 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:35.836332 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-215e8cb5-c3ee-4723-a8ec-5c9741f2824b None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:36:35.838018 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-215e8cb5-c3ee-4723-a8ec-5c9741f2824b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:36:35.919670 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:35.996987 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 92/171] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:36:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:36:36.024050 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:36.029125 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 80/172] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 14 17:36:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 529 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 14 17:36:36.035227 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215e8cb5-c3ee-4723-a8ec-5c9741f2824b None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:36.045342 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd558e8c-475a-4405-8a67-ca6a32cd3af6 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:36.221607 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd558e8c-475a-4405-8a67-ca6a32cd3af6 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:36.225488 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215e8cb5-c3ee-4723-a8ec-5c9741f2824b None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:36.277374 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c4d1ba-9622-4670-865f-4aafbbec7396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:36.278198 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c4d1ba-9622-4670-865f-4aafbbec7396 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:36.278487 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c4d1ba-9622-4670-865f-4aafbbec7396 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:36.278746 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c4d1ba-9622-4670-865f-4aafbbec7396 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:36.289756 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9444378e-8610-4486-8e53-b721b791f087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:36.290626 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9444378e-8610-4486-8e53-b721b791f087 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:36.290931 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9444378e-8610-4486-8e53-b721b791f087 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:36.291207 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9444378e-8610-4486-8e53-b721b791f087 None admin] PATH_INFO: `/v3/projects/04b70fac2c57427fa08aa88ec925923b` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:36.292688 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9444378e-8610-4486-8e53-b721b791f087 None admin] RBAC: Authorizing `identity:get_project(project_id=04b70fac2c57427fa08aa88ec925923b)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:36.294138 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9444378e-8610-4486-8e53-b721b791f087 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:36.295859 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 93/173] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 14 17:36:36 2022] GET /identity/v3/projects/04b70fac2c57427fa08aa88ec925923b => generated 312 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:36:36.302295 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9444378e-8610-4486-8e53-b721b791f087 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:36.303821 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c4d1ba-9622-4670-865f-4aafbbec7396 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:36:36.312017 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-64c4d1ba-9622-4670-865f-4aafbbec7396 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 14 17:36:36.312017 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:36:36.312017 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:36:36.312017 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:36:36.312017 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:36:36.312017 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:36:36.312017 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:36:36.312017 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:36:36.312017 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:36:36.312017 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:36:36.312017 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:36:36.312017 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:36:36.312017 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:36:36.312017 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:36:36.312017 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:36:36.312017 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:36:36.312912 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:36:36.312912 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:36:36.312912 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:36:36.312912 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:36:36.312912 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:36:36.312912 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:36:36.312912 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:36:36.312912 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:36:36.312912 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:36:36.312912 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:36:36.312912 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:36:36.312912 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:36:36.312912 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:36:36.312912 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:36:36.312912 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:36:36.312912 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:36:36.313748 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:36:36.313748 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:36:36.313748 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:36:36.313748 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:36:36.313748 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:36:36.313748 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:36:36.313748 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:36:36.313748 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:36:36.313748 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:36:36.313748 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:36:36.313748 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 14 17:36:36.313748 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:36:36.316231 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 81/174] 10.222.0.36 () {56 vars in 1114 bytes} [Tue Jun 14 17:36:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:36:36.322962 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c4d1ba-9622-4670-865f-4aafbbec7396 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:36.383779 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:36.427472 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:36.492780 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9444378e-8610-4486-8e53-b721b791f087 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:36.502781 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c4d1ba-9622-4670-865f-4aafbbec7396 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:36.555069 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ae09d9-c8f1-4b71-a9bf-ca50cc9ed17a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:36.555766 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ae09d9-c8f1-4b71-a9bf-ca50cc9ed17a None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:36.556047 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ae09d9-c8f1-4b71-a9bf-ca50cc9ed17a None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:36.556324 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ae09d9-c8f1-4b71-a9bf-ca50cc9ed17a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:36.557263 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ae09d9-c8f1-4b71-a9bf-ca50cc9ed17a None admin] RBAC: Adding query filter params (role.id=9ee80134743f4c2b88525b04df2facba, scope.project.id=04b70fac2c57427fa08aa88ec925923b, user.id=48d36fad27cf4eff8510c2ec4719697c) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:36:36.557580 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ae09d9-c8f1-4b71-a9bf-ca50cc9ed17a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:36.559046 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ae09d9-c8f1-4b71-a9bf-ca50cc9ed17a None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:36.565786 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c39a215-1b04-48fa-96bb-7c2e799b3947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:36.571320 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c39a215-1b04-48fa-96bb-7c2e799b3947 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:36.571320 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c39a215-1b04-48fa-96bb-7c2e799b3947 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:36.571320 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c39a215-1b04-48fa-96bb-7c2e799b3947 None admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:36.571320 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c39a215-1b04-48fa-96bb-7c2e799b3947 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:36:36.571320 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c39a215-1b04-48fa-96bb-7c2e799b3947 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:36.572087 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c39a215-1b04-48fa-96bb-7c2e799b3947 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:36.581373 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 94/175] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 14 17:36:36 2022] GET /identity/v3/role_assignments?user.id=48d36fad27cf4eff8510c2ec4719697c&scope.project.id=04b70fac2c57427fa08aa88ec925923b&role.id=9ee80134743f4c2b88525b04df2facba => generated 608 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:36:36.585228 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 82/176] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 14 17:36:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:36:36.592496 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ae09d9-c8f1-4b71-a9bf-ca50cc9ed17a None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:36.713341 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843ae92d-0dde-4f02-a6f5-6e731fdcf109 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:36.714014 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843ae92d-0dde-4f02-a6f5-6e731fdcf109 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:36.714014 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843ae92d-0dde-4f02-a6f5-6e731fdcf109 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:36.715589 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 83/177] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:36:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 14 17:36:36.736856 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa50b157-5e3a-427c-bf0b-6bd3e6748888 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:36.737194 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa50b157-5e3a-427c-bf0b-6bd3e6748888 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:36.737408 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa50b157-5e3a-427c-bf0b-6bd3e6748888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:36.745922 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ae09d9-c8f1-4b71-a9bf-ca50cc9ed17a None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:36.763679 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:36.779286 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-fa50b157-5e3a-427c-bf0b-6bd3e6748888 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:36:36.782935 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-fa50b157-5e3a-427c-bf0b-6bd3e6748888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:36:36.807314 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bea78b-1173-4f2e-9ad5-79243a9346b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:36.808657 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bea78b-1173-4f2e-9ad5-79243a9346b1 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:36.809253 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bea78b-1173-4f2e-9ad5-79243a9346b1 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:36.809575 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bea78b-1173-4f2e-9ad5-79243a9346b1 None admin] PATH_INFO: `/v3/users/48d36fad27cf4eff8510c2ec4719697c` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:36.812131 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bea78b-1173-4f2e-9ad5-79243a9346b1 None admin] RBAC: Authorizing `identity:get_user(user_id=48d36fad27cf4eff8510c2ec4719697c)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:36.813622 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bea78b-1173-4f2e-9ad5-79243a9346b1 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:36.815410 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 95/178] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 14 17:36:36 2022] GET /identity/v3/users/48d36fad27cf4eff8510c2ec4719697c => generated 275 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:36:36.823685 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bea78b-1173-4f2e-9ad5-79243a9346b1 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:36.928325 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 84/179] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:36:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:36:36.972059 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa50b157-5e3a-427c-bf0b-6bd3e6748888 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:37.038391 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bea78b-1173-4f2e-9ad5-79243a9346b1 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:37.040274 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:37.107384 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f0f555-c1f1-4ba9-8e73-fefa970c4646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:37.108064 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f0f555-c1f1-4ba9-8e73-fefa970c4646 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:37.109580 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f0f555-c1f1-4ba9-8e73-fefa970c4646 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:37.109883 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f0f555-c1f1-4ba9-8e73-fefa970c4646 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:37.131727 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa50b157-5e3a-427c-bf0b-6bd3e6748888 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:37.164342 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:37.198813 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f0f555-c1f1-4ba9-8e73-fefa970c4646 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:37.200287 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9759ae9e-3c04-4e28-b2e5-15887bff8873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:37.201099 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9759ae9e-3c04-4e28-b2e5-15887bff8873 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:37.201206 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f0f555-c1f1-4ba9-8e73-fefa970c4646 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:37.201381 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9759ae9e-3c04-4e28-b2e5-15887bff8873 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:37.201658 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9759ae9e-3c04-4e28-b2e5-15887bff8873 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:37.212925 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9759ae9e-3c04-4e28-b2e5-15887bff8873 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:36:37.221073 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-9759ae9e-3c04-4e28-b2e5-15887bff8873 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 17:36:37.221073 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:36:37.221073 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:36:37.221073 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:36:37.221073 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:36:37.221073 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:36:37.221073 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:36:37.221073 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:36:37.221073 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:36:37.221073 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:36:37.221073 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:36:37.221073 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:36:37.221073 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:36:37.221073 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:36:37.221073 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:36:37.221073 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:36:37.221982 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:36:37.221982 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:36:37.221982 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:36:37.221982 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:36:37.221982 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:36:37.221982 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:36:37.221982 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:36:37.221982 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:36:37.221982 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:36:37.221982 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:36:37.221982 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:36:37.221982 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:36:37.221982 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:36:37.221982 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:36:37.221982 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:36:37.221982 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:36:37.223176 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:36:37.223176 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:36:37.223176 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:36:37.223176 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:36:37.223176 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:36:37.223176 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:36:37.223176 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:36:37.223176 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:36:37.223176 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:36:37.223176 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:36:37.223176 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 17:36:37.223176 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:36:37.223176 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 85/180] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jun 14 17:36:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 17:36:37.224534 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1d1bc5-4fa3-4ef2-b800-4b228a41d261 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:37.224534 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1d1bc5-4fa3-4ef2-b800-4b228a41d261 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:37.224534 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1d1bc5-4fa3-4ef2-b800-4b228a41d261 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:37.230309 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 86/181] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:36:37 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:36:37.231158 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1d1bc5-4fa3-4ef2-b800-4b228a41d261 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:37.348248 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 96/182] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 14 17:36:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 14 17:36:37.348248 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dae538-3c0b-45cc-b481-4b42b42a80cc None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:37.348248 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dae538-3c0b-45cc-b481-4b42b42a80cc None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:37.348248 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dae538-3c0b-45cc-b481-4b42b42a80cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:37.365083 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-26dae538-3c0b-45cc-b481-4b42b42a80cc None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:36:37.366543 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-26dae538-3c0b-45cc-b481-4b42b42a80cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:36:37.382180 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1d1bc5-4fa3-4ef2-b800-4b228a41d261 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:37.397931 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:37.423628 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd55c55-5824-4483-9bfc-0ca745dc477a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:37.424722 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd55c55-5824-4483-9bfc-0ca745dc477a None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:37.425019 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd55c55-5824-4483-9bfc-0ca745dc477a None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:37.425444 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd55c55-5824-4483-9bfc-0ca745dc477a None admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:37.426314 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd55c55-5824-4483-9bfc-0ca745dc477a None admin] RBAC: Adding query filter params (name=admin) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:36:37.427532 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd55c55-5824-4483-9bfc-0ca745dc477a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:37.429534 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd55c55-5824-4483-9bfc-0ca745dc477a None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:37.434219 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:37.447321 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 97/183] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:36:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:36:37.447321 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dae538-3c0b-45cc-b481-4b42b42a80cc None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:37.447560 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 87/184] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 14 17:36:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:36:37.447560 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aad400-a1f7-46f4-87dd-396a5fb0190e None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:37.447560 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aad400-a1f7-46f4-87dd-396a5fb0190e None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:37.447560 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aad400-a1f7-46f4-87dd-396a5fb0190e None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:37.447560 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 88/185] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:36:37 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:36:37.448347 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aad400-a1f7-46f4-87dd-396a5fb0190e None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:37.548668 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dae538-3c0b-45cc-b481-4b42b42a80cc None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:37.569202 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aad400-a1f7-46f4-87dd-396a5fb0190e None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:37.588011 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e0d4d8-ca74-4c3a-a0d8-721eb194a083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:37.588887 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e0d4d8-ca74-4c3a-a0d8-721eb194a083 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:37.589169 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e0d4d8-ca74-4c3a-a0d8-721eb194a083 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:37.589447 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e0d4d8-ca74-4c3a-a0d8-721eb194a083 None admin] PATH_INFO: `/v3/projects/b2d7081316264626896ee5ec5050f5de` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:37.590627 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e0d4d8-ca74-4c3a-a0d8-721eb194a083 None admin] RBAC: Authorizing `identity:get_project(project_id=b2d7081316264626896ee5ec5050f5de)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:37.592114 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e0d4d8-ca74-4c3a-a0d8-721eb194a083 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:37.593851 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 98/186] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 14 17:36:37 2022] GET /identity/v3/projects/b2d7081316264626896ee5ec5050f5de => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:36:37.600806 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f67fad7-e601-499b-8d20-9c5b8489c33a None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:37.601139 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f67fad7-e601-499b-8d20-9c5b8489c33a None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:37.601431 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f67fad7-e601-499b-8d20-9c5b8489c33a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:37.608390 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c4bd09-bb31-42a2-b467-ba2aa78f9ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:37.609266 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c4bd09-bb31-42a2-b467-ba2aa78f9ee1 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:37.609550 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c4bd09-bb31-42a2-b467-ba2aa78f9ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:37.609825 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c4bd09-bb31-42a2-b467-ba2aa78f9ee1 None admin] PATH_INFO: `/v3/users/19054823196b4608b2cd7e101021183d` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:37.619070 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-5f67fad7-e601-499b-8d20-9c5b8489c33a None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:36:37.620270 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-5f67fad7-e601-499b-8d20-9c5b8489c33a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:36:37.628388 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c4bd09-bb31-42a2-b467-ba2aa78f9ee1 None admin] RBAC: Authorizing `identity:get_user(user_id=19054823196b4608b2cd7e101021183d)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:37.630292 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c4bd09-bb31-42a2-b467-ba2aa78f9ee1 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:37.632425 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 89/187] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 14 17:36:37 2022] GET /identity/v3/users/19054823196b4608b2cd7e101021183d => generated 283 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:36:37.633140 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c4bd09-bb31-42a2-b467-ba2aa78f9ee1 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:37.666075 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:37.696331 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:37.701998 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 99/188] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:36:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:36:37.702657 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f67fad7-e601-499b-8d20-9c5b8489c33a None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:37.751116 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c4bd09-bb31-42a2-b467-ba2aa78f9ee1 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:37.788698 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67241bab-fe68-48a5-9c44-f8fdb29bddec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:37.789518 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67241bab-fe68-48a5-9c44-f8fdb29bddec None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:37.789797 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67241bab-fe68-48a5-9c44-f8fdb29bddec None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:37.790086 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67241bab-fe68-48a5-9c44-f8fdb29bddec None admin] PATH_INFO: `/v3/domains/default` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:37.791343 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67241bab-fe68-48a5-9c44-f8fdb29bddec None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:37.792869 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67241bab-fe68-48a5-9c44-f8fdb29bddec None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:37.794661 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 90/189] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 14 17:36:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:36:37.795271 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67241bab-fe68-48a5-9c44-f8fdb29bddec None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:37.822491 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f67fad7-e601-499b-8d20-9c5b8489c33a None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:37.860832 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1804cbfe-5af9-448a-8ce8-8a537db8d050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:37.861443 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1804cbfe-5af9-448a-8ce8-8a537db8d050 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:37.861734 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1804cbfe-5af9-448a-8ce8-8a537db8d050 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:37.862179 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1804cbfe-5af9-448a-8ce8-8a537db8d050 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:37.862845 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1804cbfe-5af9-448a-8ce8-8a537db8d050 None admin] RBAC: Adding query filter params (role.id=e41c4e25dfdf4810aab2231cf98c98a9, scope.project.id=b2d7081316264626896ee5ec5050f5de, user.id=48d36fad27cf4eff8510c2ec4719697c) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:36:37.863162 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1804cbfe-5af9-448a-8ce8-8a537db8d050 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:37.865048 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1804cbfe-5af9-448a-8ce8-8a537db8d050 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:37.871330 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 100/190] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 14 17:36:37 2022] GET /identity/v3/role_assignments?user.id=48d36fad27cf4eff8510c2ec4719697c&scope.project.id=b2d7081316264626896ee5ec5050f5de&role.id=e41c4e25dfdf4810aab2231cf98c98a9 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:36:37.871998 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1804cbfe-5af9-448a-8ce8-8a537db8d050 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:37.915374 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:37.916323 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67241bab-fe68-48a5-9c44-f8fdb29bddec None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:37.950230 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:37.965333 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9491e369-0ebc-4422-ba48-781038bd2bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:37.966157 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9491e369-0ebc-4422-ba48-781038bd2bf7 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:37.966499 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9491e369-0ebc-4422-ba48-781038bd2bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:37.966839 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9491e369-0ebc-4422-ba48-781038bd2bf7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:38.000115 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1804cbfe-5af9-448a-8ce8-8a537db8d050 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:38.050944 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d21344a-7f28-4e47-ac67-1707ecb6b4ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:38.051961 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d21344a-7f28-4e47-ac67-1707ecb6b4ea None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:38.053004 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d21344a-7f28-4e47-ac67-1707ecb6b4ea None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:38.053004 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d21344a-7f28-4e47-ac67-1707ecb6b4ea None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:38.057793 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9491e369-0ebc-4422-ba48-781038bd2bf7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:38.059536 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9491e369-0ebc-4422-ba48-781038bd2bf7 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:38.066353 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d21344a-7f28-4e47-ac67-1707ecb6b4ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:36:38.075460 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-0d21344a-7f28-4e47-ac67-1707ecb6b4ea None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 14 17:36:38.075460 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:36:38.075460 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:36:38.075460 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:36:38.075460 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:36:38.075460 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:36:38.075460 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:36:38.075460 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:36:38.075460 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:36:38.075460 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:36:38.075460 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:36:38.075460 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:36:38.075460 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:36:38.075460 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:36:38.075460 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:36:38.075460 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:36:38.076393 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:36:38.076393 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:36:38.076393 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:36:38.076393 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:36:38.076393 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:36:38.076393 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:36:38.076393 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:36:38.076393 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:36:38.076393 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:36:38.076393 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:36:38.076393 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:36:38.076393 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:36:38.076393 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:36:38.076393 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:36:38.076393 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:36:38.076393 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:36:38.077204 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:36:38.077204 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:36:38.077204 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:36:38.077204 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:36:38.077204 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:36:38.077204 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:36:38.077204 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:36:38.077204 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:36:38.077204 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:36:38.077204 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:36:38.077204 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 14 17:36:38.077204 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:36:38.077204 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 101/191] 10.222.0.36 () {56 vars in 1114 bytes} [Tue Jun 14 17:36:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:36:38.077852 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d21344a-7f28-4e47-ac67-1707ecb6b4ea None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:38.185413 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:38.189108 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 91/192] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 14 17:36:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 14 17:36:38.192198 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9491e369-0ebc-4422-ba48-781038bd2bf7 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:38.214417 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d21344a-7f28-4e47-ac67-1707ecb6b4ea None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:38.238792 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:38.250650 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbe1928-413b-493d-8432-1f6fb0642969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:38.251341 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbe1928-413b-493d-8432-1f6fb0642969 None admin] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:38.251634 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbe1928-413b-493d-8432-1f6fb0642969 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:38.251911 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbe1928-413b-493d-8432-1f6fb0642969 None admin] PATH_INFO: `/v3/users` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:38.252680 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbe1928-413b-493d-8432-1f6fb0642969 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:38.254271 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbe1928-413b-493d-8432-1f6fb0642969 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:38.304975 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9491e369-0ebc-4422-ba48-781038bd2bf7 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:38.337825 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acede606-4c9d-4d54-aa1d-4bb516f5ad88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:38.338492 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acede606-4c9d-4d54-aa1d-4bb516f5ad88 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:38.338775 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acede606-4c9d-4d54-aa1d-4bb516f5ad88 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:38.339049 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acede606-4c9d-4d54-aa1d-4bb516f5ad88 None admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:38.339824 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acede606-4c9d-4d54-aa1d-4bb516f5ad88 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:36:38.340131 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acede606-4c9d-4d54-aa1d-4bb516f5ad88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:38.341539 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acede606-4c9d-4d54-aa1d-4bb516f5ad88 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:38.350152 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 92/193] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 14 17:36:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:36:38.350940 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acede606-4c9d-4d54-aa1d-4bb516f5ad88 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:38.383180 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 102/194] 10.222.0.36 () {60 vars in 1132 bytes} [Tue Jun 14 17:36:38 2022] POST /identity/v3/users => generated 297 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:36:38.383180 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbe1928-413b-493d-8432-1f6fb0642969 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:38.430932 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:38.480208 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acede606-4c9d-4d54-aa1d-4bb516f5ad88 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:38.527546 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca754e7-3b77-4109-a5eb-081cbcbb2a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:38.528656 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca754e7-3b77-4109-a5eb-081cbcbb2a9a None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:38.529093 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca754e7-3b77-4109-a5eb-081cbcbb2a9a None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:38.529441 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca754e7-3b77-4109-a5eb-081cbcbb2a9a None admin] PATH_INFO: `/v3/projects/b16d781254d347058aede92d9bba41ee` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:38.530860 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca754e7-3b77-4109-a5eb-081cbcbb2a9a None admin] RBAC: Authorizing `identity:get_project(project_id=b16d781254d347058aede92d9bba41ee)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:38.531710 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbe1928-413b-493d-8432-1f6fb0642969 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:38.532553 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca754e7-3b77-4109-a5eb-081cbcbb2a9a None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:38.534738 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 93/195] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 14 17:36:38 2022] GET /identity/v3/projects/b16d781254d347058aede92d9bba41ee => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:36:38.541499 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca754e7-3b77-4109-a5eb-081cbcbb2a9a None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:38.573602 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84721dd-9ae9-4e86-92d4-d8070b9304fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:38.574750 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84721dd-9ae9-4e86-92d4-d8070b9304fa None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:38.575283 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84721dd-9ae9-4e86-92d4-d8070b9304fa None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:38.575739 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84721dd-9ae9-4e86-92d4-d8070b9304fa None admin] PATH_INFO: `/v3/users/19054823196b4608b2cd7e101021183d` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:38.577446 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84721dd-9ae9-4e86-92d4-d8070b9304fa None admin] RBAC: Authorizing `identity:get_user(user_id=19054823196b4608b2cd7e101021183d)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:38.579275 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84721dd-9ae9-4e86-92d4-d8070b9304fa None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:38.581516 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 103/196] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 14 17:36:38 2022] GET /identity/v3/users/19054823196b4608b2cd7e101021183d => generated 283 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:36:38.588003 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84721dd-9ae9-4e86-92d4-d8070b9304fa None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:38.654100 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:38.672784 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca754e7-3b77-4109-a5eb-081cbcbb2a9a None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:38.708578 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:38.713674 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9d016a-c053-4d0e-935b-f8fd299f67b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:38.714354 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9d016a-c053-4d0e-935b-f8fd299f67b9 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:38.714638 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9d016a-c053-4d0e-935b-f8fd299f67b9 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:38.714915 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9d016a-c053-4d0e-935b-f8fd299f67b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:38.715819 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9d016a-c053-4d0e-935b-f8fd299f67b9 None admin] RBAC: Adding query filter params (role.id=1348580877d04014bfdec4d866b98a74, scope.project.id=b16d781254d347058aede92d9bba41ee, user.id=19054823196b4608b2cd7e101021183d) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:36:38.716151 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9d016a-c053-4d0e-935b-f8fd299f67b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:38.717631 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9d016a-c053-4d0e-935b-f8fd299f67b9 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:38.724717 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 94/197] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 14 17:36:38 2022] GET /identity/v3/role_assignments?user.id=19054823196b4608b2cd7e101021183d&scope.project.id=b16d781254d347058aede92d9bba41ee&role.id=1348580877d04014bfdec4d866b98a74 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:36:38.725730 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84721dd-9ae9-4e86-92d4-d8070b9304fa None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:38.726030 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e3ad32-24aa-4b93-88a0-1966a628a5d8 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:38.726326 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e3ad32-24aa-4b93-88a0-1966a628a5d8 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:38.726608 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e3ad32-24aa-4b93-88a0-1966a628a5d8 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:38.729863 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 95/198] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:36:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:36:38.735499 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51aaad9-fb22-45d8-afa1-8cc0a4feb541 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:38.735819 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51aaad9-fb22-45d8-afa1-8cc0a4feb541 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:38.736383 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51aaad9-fb22-45d8-afa1-8cc0a4feb541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:38.759346 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-a51aaad9-fb22-45d8-afa1-8cc0a4feb541 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:36:38.761335 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-a51aaad9-fb22-45d8-afa1-8cc0a4feb541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:36:38.780992 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50169574-07b5-412d-ad2a-99e174660a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:38.782199 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50169574-07b5-412d-ad2a-99e174660a6f None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:38.783201 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50169574-07b5-412d-ad2a-99e174660a6f None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:38.783735 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50169574-07b5-412d-ad2a-99e174660a6f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:38.880839 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50169574-07b5-412d-ad2a-99e174660a6f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:38.882408 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50169574-07b5-412d-ad2a-99e174660a6f None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:38.917540 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 96/199] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:36:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 14 17:36:38.940507 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:38.954266 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51aaad9-fb22-45d8-afa1-8cc0a4feb541 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:39.034757 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 104/200] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 14 17:36:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 14 17:36:39.040729 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50169574-07b5-412d-ad2a-99e174660a6f None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:39.133838 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51aaad9-fb22-45d8-afa1-8cc0a4feb541 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:39.184735 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:39.201603 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f38c48d-9485-44a4-a467-3936c7da147e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:39.202644 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f38c48d-9485-44a4-a467-3936c7da147e None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:39.203071 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f38c48d-9485-44a4-a467-3936c7da147e None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:39.203525 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f38c48d-9485-44a4-a467-3936c7da147e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:39.215577 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f38c48d-9485-44a4-a467-3936c7da147e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:36:39.225017 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-9f38c48d-9485-44a4-a467-3936c7da147e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 14 17:36:39.225017 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:36:39.225017 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:36:39.225017 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:36:39.225017 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:36:39.225017 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:36:39.225017 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:36:39.225017 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:36:39.225017 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:36:39.225017 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:36:39.225017 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:36:39.225017 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:36:39.225017 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:36:39.225017 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:36:39.225017 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:36:39.225017 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:36:39.226101 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:36:39.226101 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:36:39.226101 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:36:39.226101 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:36:39.226101 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:36:39.226101 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:36:39.226101 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:36:39.226101 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:36:39.226101 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:36:39.226101 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:36:39.226101 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:36:39.226101 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:36:39.226101 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:36:39.226101 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:36:39.226101 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:36:39.226101 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:36:39.227152 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:36:39.227152 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:36:39.227152 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:36:39.227152 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:36:39.227152 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:36:39.227152 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:36:39.227152 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:36:39.227152 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:36:39.227152 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:36:39.227152 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:36:39.227152 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 14 17:36:39.227152 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:36:39.229209 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 97/201] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 14 17:36:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 17:36:39.235353 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50169574-07b5-412d-ad2a-99e174660a6f None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:39.236436 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f38c48d-9485-44a4-a467-3936c7da147e None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:39.306544 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2945844f-9dda-46f7-a50b-d312a75f2dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:39.307373 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2945844f-9dda-46f7-a50b-d312a75f2dbb None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:39.307659 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2945844f-9dda-46f7-a50b-d312a75f2dbb None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:39.307934 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2945844f-9dda-46f7-a50b-d312a75f2dbb None admin] PATH_INFO: `/v3/projects/b16d781254d347058aede92d9bba41ee` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:39.309132 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2945844f-9dda-46f7-a50b-d312a75f2dbb None admin] RBAC: Authorizing `identity:get_project(project_id=b16d781254d347058aede92d9bba41ee)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:39.310642 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2945844f-9dda-46f7-a50b-d312a75f2dbb None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:39.323369 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 105/202] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 14 17:36:39 2022] GET /identity/v3/projects/b16d781254d347058aede92d9bba41ee => generated 302 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:36:39.329079 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2945844f-9dda-46f7-a50b-d312a75f2dbb None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:39.370234 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:39.393696 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f38c48d-9485-44a4-a467-3936c7da147e None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:39.461784 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2945844f-9dda-46f7-a50b-d312a75f2dbb None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:39.476756 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1926178-6945-4b55-b4d9-64061c2add64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:39.477546 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1926178-6945-4b55-b4d9-64061c2add64 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:39.477842 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1926178-6945-4b55-b4d9-64061c2add64 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:39.478126 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1926178-6945-4b55-b4d9-64061c2add64 None admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:39.478891 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1926178-6945-4b55-b4d9-64061c2add64 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:36:39.479263 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1926178-6945-4b55-b4d9-64061c2add64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:39.480949 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1926178-6945-4b55-b4d9-64061c2add64 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:39.490960 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 98/203] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Jun 14 17:36:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:36:39.503760 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1926178-6945-4b55-b4d9-64061c2add64 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:39.504308 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a0c307-2cbf-42c1-8881-aa9d9a68c80d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:39.506101 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a0c307-2cbf-42c1-8881-aa9d9a68c80d None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:39.506390 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a0c307-2cbf-42c1-8881-aa9d9a68c80d None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:39.506670 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a0c307-2cbf-42c1-8881-aa9d9a68c80d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:39.507606 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a0c307-2cbf-42c1-8881-aa9d9a68c80d None admin] RBAC: Adding query filter params (role.id=e41c4e25dfdf4810aab2231cf98c98a9, scope.project.id=b16d781254d347058aede92d9bba41ee, user.id=19054823196b4608b2cd7e101021183d) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:36:39.507948 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a0c307-2cbf-42c1-8881-aa9d9a68c80d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:39.509373 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a0c307-2cbf-42c1-8881-aa9d9a68c80d None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:39.515597 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 106/204] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 14 17:36:39 2022] GET /identity/v3/role_assignments?user.id=19054823196b4608b2cd7e101021183d&scope.project.id=b16d781254d347058aede92d9bba41ee&role.id=e41c4e25dfdf4810aab2231cf98c98a9 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:36:39.597826 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:39.667613 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1926178-6945-4b55-b4d9-64061c2add64 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:39.715909 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75ae544-f72b-4b88-a177-b316e9fe004d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:39.716868 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ae544-f72b-4b88-a177-b316e9fe004d None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:39.717160 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ae544-f72b-4b88-a177-b316e9fe004d None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:39.717440 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ae544-f72b-4b88-a177-b316e9fe004d None admin] PATH_INFO: `/v3/users/94b2925bbad14739894a8060d5cdc59e` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:39.718761 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75ae544-f72b-4b88-a177-b316e9fe004d None admin] RBAC: Authorizing `identity:get_user(user_id=94b2925bbad14739894a8060d5cdc59e)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:39.720286 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75ae544-f72b-4b88-a177-b316e9fe004d None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:39.722360 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 99/205] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 14 17:36:39 2022] GET /identity/v3/users/94b2925bbad14739894a8060d5cdc59e => generated 289 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:36:39.728231 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a0c307-2cbf-42c1-8881-aa9d9a68c80d None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:39.818413 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:39.841083 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a0c307-2cbf-42c1-8881-aa9d9a68c80d None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:39.876531 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c49a6b-b31e-4635-9fac-12b990c06663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:39.877225 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c49a6b-b31e-4635-9fac-12b990c06663 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:39.877520 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c49a6b-b31e-4635-9fac-12b990c06663 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:39.877807 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c49a6b-b31e-4635-9fac-12b990c06663 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:39.980409 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c49a6b-b31e-4635-9fac-12b990c06663 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:39.982020 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c49a6b-b31e-4635-9fac-12b990c06663 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:40.087069 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:40.112697 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 107/206] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 14 17:36:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 14 17:36:40.124402 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75ae544-f72b-4b88-a177-b316e9fe004d None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:40.256344 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75ae544-f72b-4b88-a177-b316e9fe004d None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:40.272924 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:40.298307 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e91c4c-82e9-4c05-833d-b530b29d51bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:40.299632 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e91c4c-82e9-4c05-833d-b530b29d51bd None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:40.299926 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e91c4c-82e9-4c05-833d-b530b29d51bd None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:40.300208 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e91c4c-82e9-4c05-833d-b530b29d51bd None admin] PATH_INFO: `/v3/projects/b2d7081316264626896ee5ec5050f5de` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:40.301485 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e91c4c-82e9-4c05-833d-b530b29d51bd None admin] RBAC: Authorizing `identity:get_project(project_id=b2d7081316264626896ee5ec5050f5de)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:40.302952 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e91c4c-82e9-4c05-833d-b530b29d51bd None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:40.305282 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 100/207] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 14 17:36:40 2022] GET /identity/v3/projects/b2d7081316264626896ee5ec5050f5de => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:36:40.311383 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c49a6b-b31e-4635-9fac-12b990c06663 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:40.448203 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c49a6b-b31e-4635-9fac-12b990c06663 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:40.498825 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17840932-6029-47ad-9a5f-d75d579f12a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:40.500225 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17840932-6029-47ad-9a5f-d75d579f12a3 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:40.500660 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17840932-6029-47ad-9a5f-d75d579f12a3 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:40.501149 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17840932-6029-47ad-9a5f-d75d579f12a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:40.502128 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17840932-6029-47ad-9a5f-d75d579f12a3 None admin] RBAC: Adding query filter params (role.id=2b061f334d51497f88c144fcf5764eeb, scope.project.id=b2d7081316264626896ee5ec5050f5de, user.id=94b2925bbad14739894a8060d5cdc59e) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:36:40.502602 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17840932-6029-47ad-9a5f-d75d579f12a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:40.504240 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17840932-6029-47ad-9a5f-d75d579f12a3 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:40.515948 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 108/208] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 14 17:36:40 2022] GET /identity/v3/role_assignments?user.id=94b2925bbad14739894a8060d5cdc59e&scope.project.id=b2d7081316264626896ee5ec5050f5de&role.id=2b061f334d51497f88c144fcf5764eeb => generated 608 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:36:41.171171 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c07129f-0847-46b5-a7b3-5c84c9c73939 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:41.171693 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c07129f-0847-46b5-a7b3-5c84c9c73939 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:41.171795 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c07129f-0847-46b5-a7b3-5c84c9c73939 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:41.173445 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 101/209] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:36:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:36:41.180275 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6e6628-1bc1-4d61-a66b-cfa27358ff70 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:41.180569 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6e6628-1bc1-4d61-a66b-cfa27358ff70 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:41.180850 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6e6628-1bc1-4d61-a66b-cfa27358ff70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:41.199092 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-cd6e6628-1bc1-4d61-a66b-cfa27358ff70 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:36:41.200809 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-cd6e6628-1bc1-4d61-a66b-cfa27358ff70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:36:41.244241 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:41.282253 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 109/210] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:36:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:36:41.306325 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c07129f-0847-46b5-a7b3-5c84c9c73939 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:41.400844 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614f8916-e4e3-43b8-9b15-1179e283f4a9 None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:41.401519 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614f8916-e4e3-43b8-9b15-1179e283f4a9 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:41.402062 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614f8916-e4e3-43b8-9b15-1179e283f4a9 None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:41.403856 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 110/211] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:36:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:36:41.409970 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba524272-dbd9-4274-951f-643c518ae2b5 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:41.410596 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba524272-dbd9-4274-951f-643c518ae2b5 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:41.411711 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba524272-dbd9-4274-951f-643c518ae2b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:41.423348 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c07129f-0847-46b5-a7b3-5c84c9c73939 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:41.432778 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-ba524272-dbd9-4274-951f-643c518ae2b5 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:36:41.433579 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-ba524272-dbd9-4274-951f-643c518ae2b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:36:41.464176 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787e1021-325a-4709-8f93-9be2408b12ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:41.464985 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e1021-325a-4709-8f93-9be2408b12ef None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:41.465312 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e1021-325a-4709-8f93-9be2408b12ef None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:41.465598 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e1021-325a-4709-8f93-9be2408b12ef None admin] PATH_INFO: `/v3/domains/default` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:41.466858 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787e1021-325a-4709-8f93-9be2408b12ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:41.468302 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787e1021-325a-4709-8f93-9be2408b12ef None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:41.470110 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 102/212] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 14 17:36:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:36:41.472703 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee8b6fb-74eb-4398-aaa1-4e56520f8656 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:41.473242 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee8b6fb-74eb-4398-aaa1-4e56520f8656 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:41.474243 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee8b6fb-74eb-4398-aaa1-4e56520f8656 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:41.479895 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 103/213] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:36:41 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:36:41.480247 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee8b6fb-74eb-4398-aaa1-4e56520f8656 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:41.515455 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 111/214] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:36:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 14 17:36:41.516992 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5b9188-e8bb-40ad-bd0b-b827ade36f2e None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:41.517463 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5b9188-e8bb-40ad-bd0b-b827ade36f2e None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:41.517751 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5b9188-e8bb-40ad-bd0b-b827ade36f2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:41.535174 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:41.539967 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-dd5b9188-e8bb-40ad-bd0b-b827ade36f2e None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:36:41.541165 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-dd5b9188-e8bb-40ad-bd0b-b827ade36f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:36:41.592656 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee8b6fb-74eb-4398-aaa1-4e56520f8656 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:41.635329 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 112/215] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:36:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:36:41.635329 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5b9188-e8bb-40ad-bd0b-b827ade36f2e None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:41.637800 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824c96fb-30dc-4647-8a92-5234fcaf4742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:41.638980 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824c96fb-30dc-4647-8a92-5234fcaf4742 None admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:41.639363 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824c96fb-30dc-4647-8a92-5234fcaf4742 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:41.639666 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824c96fb-30dc-4647-8a92-5234fcaf4742 None admin] PATH_INFO: `/v3/users` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:41.640882 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824c96fb-30dc-4647-8a92-5234fcaf4742 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:41.642948 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824c96fb-30dc-4647-8a92-5234fcaf4742 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:41.662746 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:41.730847 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5b9188-e8bb-40ad-bd0b-b827ade36f2e None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:41.764399 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9d6973-ff38-459b-b32c-eb3269683052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:41.765199 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9d6973-ff38-459b-b32c-eb3269683052 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:41.765489 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9d6973-ff38-459b-b32c-eb3269683052 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:41.765769 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9d6973-ff38-459b-b32c-eb3269683052 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:41.776670 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9d6973-ff38-459b-b32c-eb3269683052 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:36:41.784800 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-5b9d6973-ff38-459b-b32c-eb3269683052 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 14 17:36:41.784800 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:36:41.784800 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:36:41.784800 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:36:41.784800 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:36:41.784800 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:36:41.784800 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:36:41.784800 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:36:41.784800 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:36:41.784800 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:36:41.784800 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:36:41.784800 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:36:41.784800 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:36:41.784800 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:36:41.784800 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:36:41.784800 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:36:41.786609 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:36:41.786609 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:36:41.786609 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:36:41.786609 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:36:41.786609 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:36:41.786609 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:36:41.786609 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:36:41.786609 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:36:41.786609 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:36:41.786609 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:36:41.786609 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:36:41.786609 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:36:41.786609 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:36:41.786609 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:36:41.786609 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:36:41.786609 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:36:41.787840 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:36:41.787840 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:36:41.787840 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:36:41.787840 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:36:41.787840 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:36:41.787840 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:36:41.787840 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:36:41.787840 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:36:41.787840 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:36:41.787840 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:36:41.787840 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 14 17:36:41.787840 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:36:41.788961 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 104/216] 10.222.0.36 () {60 vars in 1132 bytes} [Tue Jun 14 17:36:41 2022] POST /identity/v3/users => generated 297 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:36:41.789511 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824c96fb-30dc-4647-8a92-5234fcaf4742 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:41.791861 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 113/217] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 14 17:36:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:36:41.796747 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9d6973-ff38-459b-b32c-eb3269683052 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:41.924724 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824c96fb-30dc-4647-8a92-5234fcaf4742 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:41.947805 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:41.960967 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:41.970078 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9d6973-ff38-459b-b32c-eb3269683052 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:41.975694 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac09dc02-ed10-4aa3-a569-f76a63ae6b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:41.976873 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac09dc02-ed10-4aa3-a569-f76a63ae6b87 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:41.977386 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac09dc02-ed10-4aa3-a569-f76a63ae6b87 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:41.977905 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac09dc02-ed10-4aa3-a569-f76a63ae6b87 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:41.993406 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac09dc02-ed10-4aa3-a569-f76a63ae6b87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:36:42.001466 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-ac09dc02-ed10-4aa3-a569-f76a63ae6b87 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 17:36:42.001466 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:36:42.001466 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:36:42.001466 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:36:42.001466 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:36:42.001466 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:36:42.001466 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:36:42.001466 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:36:42.001466 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:36:42.001466 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:36:42.001466 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:36:42.001466 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:36:42.001466 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:36:42.001466 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:36:42.001466 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:36:42.001466 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:36:42.002651 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:36:42.002651 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:36:42.002651 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:36:42.002651 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:36:42.002651 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:36:42.002651 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:36:42.002651 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:36:42.002651 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:36:42.002651 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:36:42.002651 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:36:42.002651 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:36:42.002651 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:36:42.002651 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:36:42.002651 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:36:42.002651 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:36:42.002651 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:36:42.003483 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:36:42.003483 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:36:42.003483 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:36:42.003483 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:36:42.003483 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:36:42.003483 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:36:42.003483 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:36:42.003483 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:36:42.003483 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:36:42.003483 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:36:42.003483 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 17:36:42.003483 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:36:42.004144 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 105/218] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jun 14 17:36:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:36:42.005619 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfa59ea-c1c3-4748-b720-92c8d608e8e6 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:42.005891 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfa59ea-c1c3-4748-b720-92c8d608e8e6 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:42.006173 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfa59ea-c1c3-4748-b720-92c8d608e8e6 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:42.011340 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 106/219] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:36:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:36:42.013132 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfa59ea-c1c3-4748-b720-92c8d608e8e6 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:42.017007 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4731432-1e59-4094-8bfd-a8c7f5dbcad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:42.018164 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4731432-1e59-4094-8bfd-a8c7f5dbcad7 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:42.018450 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4731432-1e59-4094-8bfd-a8c7f5dbcad7 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:42.018726 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4731432-1e59-4094-8bfd-a8c7f5dbcad7 None admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:42.019528 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4731432-1e59-4094-8bfd-a8c7f5dbcad7 None admin] RBAC: Adding query filter params (name=member) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:36:42.020426 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4731432-1e59-4094-8bfd-a8c7f5dbcad7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:42.022601 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4731432-1e59-4094-8bfd-a8c7f5dbcad7 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:42.035550 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 114/220] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Jun 14 17:36:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:36:42.040136 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee14adfc-7df2-45e0-a91b-e4e7e58eb3a3 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:42.040428 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee14adfc-7df2-45e0-a91b-e4e7e58eb3a3 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:42.040719 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee14adfc-7df2-45e0-a91b-e4e7e58eb3a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:42.059415 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-ee14adfc-7df2-45e0-a91b-e4e7e58eb3a3 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:36:42.060628 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-ee14adfc-7df2-45e0-a91b-e4e7e58eb3a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:36:42.142215 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfa59ea-c1c3-4748-b720-92c8d608e8e6 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:42.152843 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 115/221] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:36:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:36:42.153750 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee14adfc-7df2-45e0-a91b-e4e7e58eb3a3 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:42.186221 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53727a1b-afd1-4ac2-b92d-a9b49dde70c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:42.186913 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53727a1b-afd1-4ac2-b92d-a9b49dde70c3 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:42.187206 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53727a1b-afd1-4ac2-b92d-a9b49dde70c3 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:42.187540 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53727a1b-afd1-4ac2-b92d-a9b49dde70c3 None admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:42.188362 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53727a1b-afd1-4ac2-b92d-a9b49dde70c3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:36:42.188715 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53727a1b-afd1-4ac2-b92d-a9b49dde70c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:42.190131 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53727a1b-afd1-4ac2-b92d-a9b49dde70c3 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:42.200958 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 107/222] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 14 17:36:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:36:42.201810 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53727a1b-afd1-4ac2-b92d-a9b49dde70c3 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:42.240278 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:42.272747 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:42.291154 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee14adfc-7df2-45e0-a91b-e4e7e58eb3a3 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:42.334634 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53727a1b-afd1-4ac2-b92d-a9b49dde70c3 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:42.336034 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccd5547-2be7-46e1-96e3-119217115857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:42.337083 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccd5547-2be7-46e1-96e3-119217115857 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:42.337446 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccd5547-2be7-46e1-96e3-119217115857 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:42.337808 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccd5547-2be7-46e1-96e3-119217115857 None admin] PATH_INFO: `/v3/users/b8f6fe5b390a476b98c9bf8fde068303` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:42.354868 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccd5547-2be7-46e1-96e3-119217115857 None admin] RBAC: Authorizing `identity:get_user(user_id=b8f6fe5b390a476b98c9bf8fde068303)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:42.356543 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccd5547-2be7-46e1-96e3-119217115857 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:42.358444 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 116/223] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 14 17:36:42 2022] GET /identity/v3/users/b8f6fe5b390a476b98c9bf8fde068303 => generated 297 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:36:42.359453 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccd5547-2be7-46e1-96e3-119217115857 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:42.380662 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b64258-ff34-488f-aa96-50fd3491cb43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:42.382123 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b64258-ff34-488f-aa96-50fd3491cb43 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:42.382591 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b64258-ff34-488f-aa96-50fd3491cb43 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:42.383073 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b64258-ff34-488f-aa96-50fd3491cb43 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:42.398821 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b64258-ff34-488f-aa96-50fd3491cb43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:36:42.407698 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-48b64258-ff34-488f-aa96-50fd3491cb43 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 14 17:36:42.407698 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:36:42.407698 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:36:42.407698 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:36:42.407698 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:36:42.407698 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:36:42.407698 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:36:42.407698 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:36:42.407698 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:36:42.407698 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:36:42.407698 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:36:42.407698 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:36:42.407698 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:36:42.407698 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:36:42.407698 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:36:42.407698 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:36:42.408826 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:36:42.408826 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:36:42.408826 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:36:42.408826 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:36:42.408826 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:36:42.408826 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:36:42.408826 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:36:42.408826 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:36:42.408826 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:36:42.408826 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:36:42.408826 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:36:42.408826 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:36:42.408826 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:36:42.408826 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:36:42.408826 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:36:42.408826 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:36:42.409814 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:36:42.409814 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:36:42.409814 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:36:42.409814 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:36:42.409814 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:36:42.409814 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:36:42.409814 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:36:42.409814 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:36:42.409814 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:36:42.409814 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:36:42.409814 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 14 17:36:42.409814 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:36:42.411897 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 108/224] 10.222.0.36 () {56 vars in 1114 bytes} [Tue Jun 14 17:36:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:36:42.416781 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b64258-ff34-488f-aa96-50fd3491cb43 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:42.492730 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccd5547-2be7-46e1-96e3-119217115857 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:42.523357 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:42.536177 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b64258-ff34-488f-aa96-50fd3491cb43 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:42.545430 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc975903-ec24-4aa2-a66e-ead0f7d8f670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:42.547274 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc975903-ec24-4aa2-a66e-ead0f7d8f670 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:42.548038 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc975903-ec24-4aa2-a66e-ead0f7d8f670 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:42.548467 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc975903-ec24-4aa2-a66e-ead0f7d8f670 None admin] PATH_INFO: `/v3/users/19054823196b4608b2cd7e101021183d` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:42.550098 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc975903-ec24-4aa2-a66e-ead0f7d8f670 None admin] RBAC: Authorizing `identity:get_user(user_id=19054823196b4608b2cd7e101021183d)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:42.553523 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc975903-ec24-4aa2-a66e-ead0f7d8f670 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:42.555847 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 117/225] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 14 17:36:42 2022] GET /identity/v3/users/19054823196b4608b2cd7e101021183d => generated 283 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:36:42.557077 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc975903-ec24-4aa2-a66e-ead0f7d8f670 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:42.572997 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:42.584762 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77886ab8-e39d-4e30-b80f-54544860e689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:42.585647 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77886ab8-e39d-4e30-b80f-54544860e689 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:42.586332 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77886ab8-e39d-4e30-b80f-54544860e689 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:42.592047 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77886ab8-e39d-4e30-b80f-54544860e689 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:42.668880 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77886ab8-e39d-4e30-b80f-54544860e689 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:42.669505 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc975903-ec24-4aa2-a66e-ead0f7d8f670 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:42.670359 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77886ab8-e39d-4e30-b80f-54544860e689 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:42.708945 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42424703-8ed7-4e67-a377-2405282f1f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:42.710770 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42424703-8ed7-4e67-a377-2405282f1f9a None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:42.711261 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42424703-8ed7-4e67-a377-2405282f1f9a None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:42.711787 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42424703-8ed7-4e67-a377-2405282f1f9a None admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:42.712725 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42424703-8ed7-4e67-a377-2405282f1f9a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:36:42.713220 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42424703-8ed7-4e67-a377-2405282f1f9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:42.715352 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42424703-8ed7-4e67-a377-2405282f1f9a None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:42.726659 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 118/226] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 14 17:36:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:36:42.727980 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42424703-8ed7-4e67-a377-2405282f1f9a None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:42.775099 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:42.790308 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 109/227] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 14 17:36:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 14 17:36:42.792174 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77886ab8-e39d-4e30-b80f-54544860e689 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:42.822370 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:42.854900 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42424703-8ed7-4e67-a377-2405282f1f9a None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:42.892811 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15069e5-5888-42f6-8620-f7a786bc8df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:42.894003 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15069e5-5888-42f6-8620-f7a786bc8df3 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:42.894732 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15069e5-5888-42f6-8620-f7a786bc8df3 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:42.895971 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15069e5-5888-42f6-8620-f7a786bc8df3 None admin] PATH_INFO: `/v3/projects/b16d781254d347058aede92d9bba41ee` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:42.897535 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15069e5-5888-42f6-8620-f7a786bc8df3 None admin] RBAC: Authorizing `identity:get_project(project_id=b16d781254d347058aede92d9bba41ee)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:42.899191 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15069e5-5888-42f6-8620-f7a786bc8df3 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:42.900523 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77886ab8-e39d-4e30-b80f-54544860e689 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:42.901922 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 119/228] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 14 17:36:42 2022] GET /identity/v3/projects/b16d781254d347058aede92d9bba41ee => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:36:42.902981 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15069e5-5888-42f6-8620-f7a786bc8df3 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:42.937720 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ab6811-c03a-456c-943d-16928fd45604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:42.938702 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab6811-c03a-456c-943d-16928fd45604 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:42.938992 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab6811-c03a-456c-943d-16928fd45604 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:42.939272 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab6811-c03a-456c-943d-16928fd45604 None admin] PATH_INFO: `/v3/users/19054823196b4608b2cd7e101021183d` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:42.940522 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ab6811-c03a-456c-943d-16928fd45604 None admin] RBAC: Authorizing `identity:get_user(user_id=19054823196b4608b2cd7e101021183d)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:42.942748 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ab6811-c03a-456c-943d-16928fd45604 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:42.944536 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 110/229] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 14 17:36:42 2022] GET /identity/v3/users/19054823196b4608b2cd7e101021183d => generated 283 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:36:42.945281 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ab6811-c03a-456c-943d-16928fd45604 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:43.012193 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:43.014765 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15069e5-5888-42f6-8620-f7a786bc8df3 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:43.051109 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e058f66c-fa48-47b5-8f41-3ae43d00ab4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:43.052937 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e058f66c-fa48-47b5-8f41-3ae43d00ab4c None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:43.053422 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e058f66c-fa48-47b5-8f41-3ae43d00ab4c None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:43.055987 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e058f66c-fa48-47b5-8f41-3ae43d00ab4c None admin] PATH_INFO: `/v3/projects/b16d781254d347058aede92d9bba41ee` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:43.055987 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e058f66c-fa48-47b5-8f41-3ae43d00ab4c None admin] RBAC: Authorizing `identity:get_project(project_id=b16d781254d347058aede92d9bba41ee)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:43.056974 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e058f66c-fa48-47b5-8f41-3ae43d00ab4c None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:43.058929 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 120/230] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 14 17:36:42 2022] GET /identity/v3/projects/b16d781254d347058aede92d9bba41ee => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:36:43.059039 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ab6811-c03a-456c-943d-16928fd45604 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:43.060428 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e058f66c-fa48-47b5-8f41-3ae43d00ab4c None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:43.072770 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:43.096714 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d437a7fa-6d3d-4adf-9d80-e794684f8dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:43.097899 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d437a7fa-6d3d-4adf-9d80-e794684f8dec None admin] REQUEST_METHOD: `PUT` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:43.098429 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d437a7fa-6d3d-4adf-9d80-e794684f8dec None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:43.099044 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d437a7fa-6d3d-4adf-9d80-e794684f8dec None admin] PATH_INFO: `/v3/projects/b16d781254d347058aede92d9bba41ee/users/19054823196b4608b2cd7e101021183d/roles/1348580877d04014bfdec4d866b98a74` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:43.101441 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d437a7fa-6d3d-4adf-9d80-e794684f8dec None admin] RBAC: Authorizing `identity:create_grant(project_id=b16d781254d347058aede92d9bba41ee, user_id=19054823196b4608b2cd7e101021183d, role_id=1348580877d04014bfdec4d866b98a74)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:43.103032 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d437a7fa-6d3d-4adf-9d80-e794684f8dec None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:43.173244 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e058f66c-fa48-47b5-8f41-3ae43d00ab4c None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:43.208877 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 111/231] 10.222.0.36 () {58 vars in 1439 bytes} [Tue Jun 14 17:36:42 2022] PUT /identity/v3/projects/b16d781254d347058aede92d9bba41ee/users/19054823196b4608b2cd7e101021183d/roles/1348580877d04014bfdec4d866b98a74 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:36:43.210616 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d437a7fa-6d3d-4adf-9d80-e794684f8dec None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:43.214291 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda65db0-fa33-4863-9e78-0f28bceda8ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:43.216548 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda65db0-fa33-4863-9e78-0f28bceda8ef None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:43.216849 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda65db0-fa33-4863-9e78-0f28bceda8ef None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:43.217136 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda65db0-fa33-4863-9e78-0f28bceda8ef None admin] PATH_INFO: `/v3/projects/b16d781254d347058aede92d9bba41ee` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:43.218526 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda65db0-fa33-4863-9e78-0f28bceda8ef None admin] RBAC: Authorizing `identity:get_project(project_id=b16d781254d347058aede92d9bba41ee)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:43.220209 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda65db0-fa33-4863-9e78-0f28bceda8ef None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:43.223368 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 121/232] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 14 17:36:43 2022] GET /identity/v3/projects/b16d781254d347058aede92d9bba41ee => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:36:43.232399 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda65db0-fa33-4863-9e78-0f28bceda8ef None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:43.382038 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:43.408399 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda65db0-fa33-4863-9e78-0f28bceda8ef None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:43.422010 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d437a7fa-6d3d-4adf-9d80-e794684f8dec None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:43.445977 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:43.447882 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cba63b7-713d-49b8-8bf9-d4a7d1e8df6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:43.449051 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cba63b7-713d-49b8-8bf9-d4a7d1e8df6f None admin] REQUEST_METHOD: `PUT` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:43.449574 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cba63b7-713d-49b8-8bf9-d4a7d1e8df6f None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:43.450047 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cba63b7-713d-49b8-8bf9-d4a7d1e8df6f None admin] PATH_INFO: `/v3/projects/b16d781254d347058aede92d9bba41ee/users/19054823196b4608b2cd7e101021183d/roles/e41c4e25dfdf4810aab2231cf98c98a9` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:43.460213 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cba63b7-713d-49b8-8bf9-d4a7d1e8df6f None admin] RBAC: Authorizing `identity:create_grant(project_id=b16d781254d347058aede92d9bba41ee, user_id=19054823196b4608b2cd7e101021183d, role_id=e41c4e25dfdf4810aab2231cf98c98a9)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:43.462005 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cba63b7-713d-49b8-8bf9-d4a7d1e8df6f None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:43.464684 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393fc29e-9014-48c5-a5c6-3b3bb844b070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:43.465480 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393fc29e-9014-48c5-a5c6-3b3bb844b070 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:43.465835 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393fc29e-9014-48c5-a5c6-3b3bb844b070 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:43.466494 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393fc29e-9014-48c5-a5c6-3b3bb844b070 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:43.471327 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393fc29e-9014-48c5-a5c6-3b3bb844b070 None admin] RBAC: Adding query filter params (role.id=9ee80134743f4c2b88525b04df2facba, scope.project.id=b16d781254d347058aede92d9bba41ee, user.id=b8f6fe5b390a476b98c9bf8fde068303) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:36:43.471327 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393fc29e-9014-48c5-a5c6-3b3bb844b070 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:43.471327 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393fc29e-9014-48c5-a5c6-3b3bb844b070 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:43.476354 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 112/233] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 14 17:36:43 2022] GET /identity/v3/role_assignments?user.id=b8f6fe5b390a476b98c9bf8fde068303&scope.project.id=b16d781254d347058aede92d9bba41ee&role.id=9ee80134743f4c2b88525b04df2facba => generated 259 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:36:43.550078 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 122/234] 10.222.0.36 () {58 vars in 1439 bytes} [Tue Jun 14 17:36:43 2022] PUT /identity/v3/projects/b16d781254d347058aede92d9bba41ee/users/19054823196b4608b2cd7e101021183d/roles/e41c4e25dfdf4810aab2231cf98c98a9 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:36:44.327912 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61964faa-50ad-4264-9528-69e3f45fa0d4 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:44.328463 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61964faa-50ad-4264-9528-69e3f45fa0d4 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:44.328463 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61964faa-50ad-4264-9528-69e3f45fa0d4 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:44.330127 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 113/235] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:36:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:36:44.341265 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fba9edf-4ee4-47cb-8d1c-9854ea4430f0 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:44.341581 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fba9edf-4ee4-47cb-8d1c-9854ea4430f0 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:44.341854 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fba9edf-4ee4-47cb-8d1c-9854ea4430f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:44.363895 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-8fba9edf-4ee4-47cb-8d1c-9854ea4430f0 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:36:44.366160 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-8fba9edf-4ee4-47cb-8d1c-9854ea4430f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:36:44.380766 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3350ed90-0446-4be4-8c40-d6f0e481e5c3 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:44.381376 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3350ed90-0446-4be4-8c40-d6f0e481e5c3 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:44.381944 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3350ed90-0446-4be4-8c40-d6f0e481e5c3 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:44.383610 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 114/236] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:36:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 14 17:36:44.389601 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b9d6fc-0054-47a7-8580-50a5b0401347 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:44.390224 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b9d6fc-0054-47a7-8580-50a5b0401347 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:44.390705 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b9d6fc-0054-47a7-8580-50a5b0401347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:44.427037 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-04b9d6fc-0054-47a7-8580-50a5b0401347 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:36:44.428297 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-04b9d6fc-0054-47a7-8580-50a5b0401347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:36:44.489578 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 123/237] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:36:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:36:44.541506 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 115/238] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:36:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 14 17:36:44.548844 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fba9edf-4ee4-47cb-8d1c-9854ea4430f0 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:44.577507 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b9d6fc-0054-47a7-8580-50a5b0401347 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:44.626898 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:44.687385 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fba9edf-4ee4-47cb-8d1c-9854ea4430f0 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:44.748173 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b9d6fc-0054-47a7-8580-50a5b0401347 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:44.759093 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35d1f6f-8986-469b-a3ac-be382c41fea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:44.759940 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35d1f6f-8986-469b-a3ac-be382c41fea3 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:44.760281 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35d1f6f-8986-469b-a3ac-be382c41fea3 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:44.760571 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35d1f6f-8986-469b-a3ac-be382c41fea3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:44.763432 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35d1f6f-8986-469b-a3ac-be382c41fea3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:44.764937 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35d1f6f-8986-469b-a3ac-be382c41fea3 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:44.766584 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 124/239] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 14 17:36:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:36:44.775675 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:44.777257 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35d1f6f-8986-469b-a3ac-be382c41fea3 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:44.823787 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca582e8-8151-4613-b2c9-e51209eb34f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:44.824605 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca582e8-8151-4613-b2c9-e51209eb34f6 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:44.824894 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca582e8-8151-4613-b2c9-e51209eb34f6 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:44.825177 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca582e8-8151-4613-b2c9-e51209eb34f6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:44.858483 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca582e8-8151-4613-b2c9-e51209eb34f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:36:44.872734 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-eca582e8-8151-4613-b2c9-e51209eb34f6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 14 17:36:44.872734 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:36:44.872734 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:36:44.872734 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:36:44.872734 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:36:44.872734 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:36:44.872734 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:36:44.872734 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:36:44.872734 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:36:44.872734 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:36:44.872734 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:36:44.872734 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:36:44.872734 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:36:44.872734 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:36:44.872734 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:36:44.872734 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:36:44.873833 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:36:44.873833 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:36:44.873833 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:36:44.873833 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:36:44.873833 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:36:44.873833 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:36:44.873833 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:36:44.873833 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:36:44.873833 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:36:44.873833 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:36:44.873833 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:36:44.873833 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:36:44.873833 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:36:44.873833 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:36:44.873833 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:36:44.873833 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:36:44.874619 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:36:44.874619 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:36:44.874619 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:36:44.874619 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:36:44.874619 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:36:44.874619 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:36:44.874619 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:36:44.874619 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:36:44.874619 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:36:44.874619 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:36:44.874619 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 14 17:36:44.874619 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:36:44.874619 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 116/240] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 14 17:36:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:36:44.882366 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca582e8-8151-4613-b2c9-e51209eb34f6 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:44.883126 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35d1f6f-8986-469b-a3ac-be382c41fea3 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:44.920112 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032f8d34-9940-4d3a-a6ad-e82e214c8066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:44.920797 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032f8d34-9940-4d3a-a6ad-e82e214c8066 None admin] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:44.921086 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032f8d34-9940-4d3a-a6ad-e82e214c8066 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:44.921369 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032f8d34-9940-4d3a-a6ad-e82e214c8066 None admin] PATH_INFO: `/v3/users` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:44.922080 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032f8d34-9940-4d3a-a6ad-e82e214c8066 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:44.923578 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032f8d34-9940-4d3a-a6ad-e82e214c8066 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:44.931010 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:45.028406 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca582e8-8151-4613-b2c9-e51209eb34f6 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:45.038333 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 125/241] 10.222.0.36 () {60 vars in 1132 bytes} [Tue Jun 14 17:36:44 2022] POST /identity/v3/users => generated 293 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 17:36:45.086547 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14eff04-8ee3-4ac2-8c9a-3de4e617cd5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:45.087326 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14eff04-8ee3-4ac2-8c9a-3de4e617cd5f None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:45.087624 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14eff04-8ee3-4ac2-8c9a-3de4e617cd5f None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:45.087906 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14eff04-8ee3-4ac2-8c9a-3de4e617cd5f None admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:45.088681 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14eff04-8ee3-4ac2-8c9a-3de4e617cd5f None admin] RBAC: Adding query filter params (name=reader) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:36:45.089005 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14eff04-8ee3-4ac2-8c9a-3de4e617cd5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:45.090416 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14eff04-8ee3-4ac2-8c9a-3de4e617cd5f None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:45.110252 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 117/242] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Jun 14 17:36:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:36:45.117412 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032f8d34-9940-4d3a-a6ad-e82e214c8066 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:45.264451 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032f8d34-9940-4d3a-a6ad-e82e214c8066 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:45.308757 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81f642b-988e-4e6b-af20-2741205b46c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:45.310032 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81f642b-988e-4e6b-af20-2741205b46c7 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:45.310525 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81f642b-988e-4e6b-af20-2741205b46c7 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:45.311007 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81f642b-988e-4e6b-af20-2741205b46c7 None admin] PATH_INFO: `/v3/users/eb8cae07506d42619409ad147f4abbca` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:45.330308 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81f642b-988e-4e6b-af20-2741205b46c7 None admin] RBAC: Authorizing `identity:get_user(user_id=eb8cae07506d42619409ad147f4abbca)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:45.332178 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81f642b-988e-4e6b-af20-2741205b46c7 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:45.335249 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 126/243] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 14 17:36:45 2022] GET /identity/v3/users/eb8cae07506d42619409ad147f4abbca => generated 297 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:36:45.341017 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14eff04-8ee3-4ac2-8c9a-3de4e617cd5f None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:45.385205 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:45.466890 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14eff04-8ee3-4ac2-8c9a-3de4e617cd5f None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:45.503656 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e689df-8872-427c-b8fa-22ec88165533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:45.505182 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e689df-8872-427c-b8fa-22ec88165533 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:45.505482 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e689df-8872-427c-b8fa-22ec88165533 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:45.505826 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e689df-8872-427c-b8fa-22ec88165533 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:45.587284 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e689df-8872-427c-b8fa-22ec88165533 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:45.588738 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e689df-8872-427c-b8fa-22ec88165533 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:45.623919 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:45.705064 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 118/244] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 14 17:36:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 14 17:36:45.711382 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81f642b-988e-4e6b-af20-2741205b46c7 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:45.771013 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:45.832025 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81f642b-988e-4e6b-af20-2741205b46c7 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:45.878168 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de13136-5f53-4f1b-972d-bdad86d32141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:45.879001 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de13136-5f53-4f1b-972d-bdad86d32141 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:45.880100 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de13136-5f53-4f1b-972d-bdad86d32141 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:45.880385 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de13136-5f53-4f1b-972d-bdad86d32141 None admin] PATH_INFO: `/v3/projects/b16d781254d347058aede92d9bba41ee` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:45.881780 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de13136-5f53-4f1b-972d-bdad86d32141 None admin] RBAC: Authorizing `identity:get_project(project_id=b16d781254d347058aede92d9bba41ee)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:45.883444 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de13136-5f53-4f1b-972d-bdad86d32141 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:45.885686 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 127/245] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 14 17:36:45 2022] GET /identity/v3/projects/b16d781254d347058aede92d9bba41ee => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:36:45.895027 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e689df-8872-427c-b8fa-22ec88165533 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:45.922502 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d3f56-81ea-4e95-96ee-c143f1d4841b None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:45.922824 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d3f56-81ea-4e95-96ee-c143f1d4841b None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:45.923125 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d3f56-81ea-4e95-96ee-c143f1d4841b None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:45.924537 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 128/246] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:36:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 14 17:36:45.930502 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdf5d92-25e7-43f5-be34-924cac8b1de5 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:45.930799 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdf5d92-25e7-43f5-be34-924cac8b1de5 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:45.931082 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdf5d92-25e7-43f5-be34-924cac8b1de5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:45.956521 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-1bdf5d92-25e7-43f5-be34-924cac8b1de5 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:36:45.958055 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-1bdf5d92-25e7-43f5-be34-924cac8b1de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:36:46.048375 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 129/247] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:36:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:36:46.063742 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e689df-8872-427c-b8fa-22ec88165533 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:46.073658 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdf5d92-25e7-43f5-be34-924cac8b1de5 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:46.131756 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:46.143325 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beac4ca-cbc8-4ee2-9211-c80c5d5b2750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:46.143325 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beac4ca-cbc8-4ee2-9211-c80c5d5b2750 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:46.143325 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beac4ca-cbc8-4ee2-9211-c80c5d5b2750 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:46.143325 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beac4ca-cbc8-4ee2-9211-c80c5d5b2750 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:46.143705 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9beac4ca-cbc8-4ee2-9211-c80c5d5b2750 None admin] RBAC: Adding query filter params (role.id=2b061f334d51497f88c144fcf5764eeb, scope.project.id=b16d781254d347058aede92d9bba41ee, user.id=eb8cae07506d42619409ad147f4abbca) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:36:46.143705 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9beac4ca-cbc8-4ee2-9211-c80c5d5b2750 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:46.143705 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9beac4ca-cbc8-4ee2-9211-c80c5d5b2750 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:46.156807 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 119/248] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 14 17:36:45 2022] GET /identity/v3/role_assignments?user.id=eb8cae07506d42619409ad147f4abbca&scope.project.id=b16d781254d347058aede92d9bba41ee&role.id=2b061f334d51497f88c144fcf5764eeb => generated 259 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:36:46.159728 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:46.261949 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdf5d92-25e7-43f5-be34-924cac8b1de5 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:46.301972 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9f6032-3597-4609-a098-93d4f5de305e None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:46.302313 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9f6032-3597-4609-a098-93d4f5de305e None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:46.302570 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9f6032-3597-4609-a098-93d4f5de305e None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:46.304416 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 120/249] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:36:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 14 17:36:46.310212 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33098906-7242-4101-b0aa-761c832b231a None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:46.310547 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33098906-7242-4101-b0aa-761c832b231a None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:46.310789 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33098906-7242-4101-b0aa-761c832b231a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:46.320183 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a520c64-a0fb-4a5e-aae5-3ea2637d61cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:46.321375 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a520c64-a0fb-4a5e-aae5-3ea2637d61cd None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:46.321893 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a520c64-a0fb-4a5e-aae5-3ea2637d61cd None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:46.322382 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a520c64-a0fb-4a5e-aae5-3ea2637d61cd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:46.330502 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-33098906-7242-4101-b0aa-761c832b231a None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:36:46.331973 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-33098906-7242-4101-b0aa-761c832b231a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:36:46.344414 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a520c64-a0fb-4a5e-aae5-3ea2637d61cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:36:46.353669 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-7a520c64-a0fb-4a5e-aae5-3ea2637d61cd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 17:36:46.353669 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:36:46.353669 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:36:46.353669 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:36:46.353669 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:36:46.353669 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:36:46.353669 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:36:46.353669 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:36:46.353669 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:36:46.353669 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:36:46.353669 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:36:46.353669 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:36:46.353669 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:36:46.353669 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:36:46.353669 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:36:46.353669 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:36:46.354591 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:36:46.354591 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:36:46.354591 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:36:46.354591 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:36:46.354591 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:36:46.354591 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:36:46.354591 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:36:46.354591 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:36:46.354591 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:36:46.354591 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:36:46.354591 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:36:46.354591 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:36:46.354591 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:36:46.354591 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:36:46.354591 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:36:46.354591 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:36:46.355417 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:36:46.355417 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:36:46.355417 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:36:46.355417 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:36:46.355417 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:36:46.355417 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:36:46.355417 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:36:46.355417 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:36:46.355417 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:36:46.355417 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:36:46.355417 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 17:36:46.355417 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:36:46.364553 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 130/250] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jun 14 17:36:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 17:36:46.370074 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a520c64-a0fb-4a5e-aae5-3ea2637d61cd None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:46.407670 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 121/251] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:36:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:36:46.409013 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1444c6-dbaa-473e-bce1-3ce215a4c5e2 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:46.412387 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1444c6-dbaa-473e-bce1-3ce215a4c5e2 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:46.412387 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1444c6-dbaa-473e-bce1-3ce215a4c5e2 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:46.420007 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 122/252] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:36:46 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:36:46.425422 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a30fe54-ab27-4670-a038-f40ad72555dc None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:46.425719 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a30fe54-ab27-4670-a038-f40ad72555dc None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:46.426010 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a30fe54-ab27-4670-a038-f40ad72555dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:46.462935 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-9a30fe54-ab27-4670-a038-f40ad72555dc None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:36:46.465368 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-9a30fe54-ab27-4670-a038-f40ad72555dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:36:46.547679 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a520c64-a0fb-4a5e-aae5-3ea2637d61cd None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:46.556196 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:46.568597 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 123/253] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:36:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 14 17:36:46.574718 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a30fe54-ab27-4670-a038-f40ad72555dc None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:46.596284 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cda7f0-2eba-4360-a65f-1ea06ed93a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:46.599325 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cda7f0-2eba-4360-a65f-1ea06ed93a7e None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:46.599325 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cda7f0-2eba-4360-a65f-1ea06ed93a7e None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:46.599325 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cda7f0-2eba-4360-a65f-1ea06ed93a7e None admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:46.607098 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cda7f0-2eba-4360-a65f-1ea06ed93a7e None admin] RBAC: Adding query filter params (name=admin) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:36:46.607494 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cda7f0-2eba-4360-a65f-1ea06ed93a7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:46.610295 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cda7f0-2eba-4360-a65f-1ea06ed93a7e None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:46.630918 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 131/254] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 14 17:36:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:36:46.638674 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cda7f0-2eba-4360-a65f-1ea06ed93a7e None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:46.710481 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:46.776922 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cda7f0-2eba-4360-a65f-1ea06ed93a7e None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:46.816747 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a30fe54-ab27-4670-a038-f40ad72555dc None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:46.819041 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ace070-8658-4793-ba3c-f87d0460a3bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:46.821141 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ace070-8658-4793-ba3c-f87d0460a3bc None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:46.821643 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ace070-8658-4793-ba3c-f87d0460a3bc None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:46.822123 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ace070-8658-4793-ba3c-f87d0460a3bc None admin] PATH_INFO: `/v3/users/19054823196b4608b2cd7e101021183d` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:46.823620 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ace070-8658-4793-ba3c-f87d0460a3bc None admin] RBAC: Authorizing `identity:get_user(user_id=19054823196b4608b2cd7e101021183d)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:46.825323 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ace070-8658-4793-ba3c-f87d0460a3bc None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:46.831934 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 132/255] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 14 17:36:46 2022] GET /identity/v3/users/19054823196b4608b2cd7e101021183d => generated 283 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:36:46.833734 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ace070-8658-4793-ba3c-f87d0460a3bc None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:46.881285 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:46.910341 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284f13ef-0fa3-4037-b35b-7fb46a7bbdb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:46.914072 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284f13ef-0fa3-4037-b35b-7fb46a7bbdb4 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:46.914361 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284f13ef-0fa3-4037-b35b-7fb46a7bbdb4 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:46.914644 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284f13ef-0fa3-4037-b35b-7fb46a7bbdb4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:46.933174 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284f13ef-0fa3-4037-b35b-7fb46a7bbdb4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:36:46.941628 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-284f13ef-0fa3-4037-b35b-7fb46a7bbdb4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 14 17:36:46.941628 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:36:46.941628 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:36:46.941628 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:36:46.941628 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:36:46.941628 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:36:46.941628 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:36:46.941628 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:36:46.941628 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:36:46.941628 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:36:46.941628 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:36:46.941628 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:36:46.941628 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:36:46.941628 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:36:46.941628 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:36:46.941628 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:36:46.942888 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:36:46.942888 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:36:46.942888 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:36:46.942888 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:36:46.942888 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:36:46.942888 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:36:46.942888 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:36:46.942888 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:36:46.942888 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:36:46.942888 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:36:46.942888 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:36:46.942888 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:36:46.942888 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:36:46.942888 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:36:46.942888 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:36:46.942888 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:36:46.943713 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:36:46.943713 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:36:46.943713 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:36:46.943713 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:36:46.943713 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:36:46.943713 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:36:46.943713 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:36:46.943713 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:36:46.943713 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:36:46.943713 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:36:46.943713 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 14 17:36:46.943713 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:36:46.951002 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 124/256] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 14 17:36:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 377 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:36:46.952237 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284f13ef-0fa3-4037-b35b-7fb46a7bbdb4 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:47.010301 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ace070-8658-4793-ba3c-f87d0460a3bc None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:47.063238 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284f13ef-0fa3-4037-b35b-7fb46a7bbdb4 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:47.076610 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830ac74b-1705-4bf1-ab04-9b72ec62d3e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:47.077432 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830ac74b-1705-4bf1-ab04-9b72ec62d3e9 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:47.077719 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830ac74b-1705-4bf1-ab04-9b72ec62d3e9 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:47.078092 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830ac74b-1705-4bf1-ab04-9b72ec62d3e9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:47.083666 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:47.101306 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830ac74b-1705-4bf1-ab04-9b72ec62d3e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:36:47.104267 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1674ea3-6147-48bf-a5ec-353a408f59d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:47.105030 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1674ea3-6147-48bf-a5ec-353a408f59d8 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:47.105532 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1674ea3-6147-48bf-a5ec-353a408f59d8 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:47.106031 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1674ea3-6147-48bf-a5ec-353a408f59d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:47.110089 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-830ac74b-1705-4bf1-ab04-9b72ec62d3e9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 14 17:36:47.110089 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:36:47.110089 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:36:47.110089 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:36:47.110089 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:36:47.110089 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:36:47.110089 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:36:47.110089 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:36:47.110089 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:36:47.110089 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:36:47.110089 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:36:47.110089 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:36:47.110089 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:36:47.110089 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:36:47.110089 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:36:47.110089 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:36:47.110967 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:36:47.110967 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:36:47.110967 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:36:47.110967 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:36:47.110967 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:36:47.110967 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:36:47.110967 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:36:47.110967 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:36:47.110967 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:36:47.110967 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:36:47.110967 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:36:47.110967 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:36:47.110967 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:36:47.110967 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:36:47.110967 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:36:47.110967 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:36:47.111810 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:36:47.111810 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:36:47.111810 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:36:47.111810 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:36:47.111810 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:36:47.111810 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:36:47.111810 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:36:47.111810 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:36:47.111810 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:36:47.111810 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:36:47.111810 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 14 17:36:47.111810 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:36:47.115503 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 133/257] 10.222.0.36 () {56 vars in 1114 bytes} [Tue Jun 14 17:36:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:36:47.116599 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830ac74b-1705-4bf1-ab04-9b72ec62d3e9 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:47.235048 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1674ea3-6147-48bf-a5ec-353a408f59d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:47.236674 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1674ea3-6147-48bf-a5ec-353a408f59d8 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:47.315874 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:47.325423 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830ac74b-1705-4bf1-ab04-9b72ec62d3e9 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:47.365162 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 125/258] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 14 17:36:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 14 17:36:47.366029 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1674ea3-6147-48bf-a5ec-353a408f59d8 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:47.394627 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46150357-8b12-4d1d-9555-f2ab03a502fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:47.395479 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46150357-8b12-4d1d-9555-f2ab03a502fa None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:47.395825 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46150357-8b12-4d1d-9555-f2ab03a502fa None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:47.396116 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46150357-8b12-4d1d-9555-f2ab03a502fa None admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:47.396875 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46150357-8b12-4d1d-9555-f2ab03a502fa None admin] RBAC: Adding query filter params (name=member) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:36:47.397196 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46150357-8b12-4d1d-9555-f2ab03a502fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:47.398593 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46150357-8b12-4d1d-9555-f2ab03a502fa None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:47.406534 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:47.416374 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 134/259] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Jun 14 17:36:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:36:47.417228 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46150357-8b12-4d1d-9555-f2ab03a502fa None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:47.569246 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1674ea3-6147-48bf-a5ec-353a408f59d8 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:47.609789 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d884c7-ab82-4232-be5e-82cbdd7d8042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:47.610603 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d884c7-ab82-4232-be5e-82cbdd7d8042 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:47.610902 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d884c7-ab82-4232-be5e-82cbdd7d8042 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:47.611191 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d884c7-ab82-4232-be5e-82cbdd7d8042 None admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:47.612129 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d884c7-ab82-4232-be5e-82cbdd7d8042 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:36:47.612449 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d884c7-ab82-4232-be5e-82cbdd7d8042 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:47.614718 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d884c7-ab82-4232-be5e-82cbdd7d8042 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:47.623845 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 126/260] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 14 17:36:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:36:47.624827 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d884c7-ab82-4232-be5e-82cbdd7d8042 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:47.635337 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46150357-8b12-4d1d-9555-f2ab03a502fa None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:47.709181 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:47.709486 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6001f8ab-2eb1-46cc-a974-e5322d47edc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:47.710385 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6001f8ab-2eb1-46cc-a974-e5322d47edc7 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:47.710678 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6001f8ab-2eb1-46cc-a974-e5322d47edc7 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:47.710988 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6001f8ab-2eb1-46cc-a974-e5322d47edc7 None admin] PATH_INFO: `/v3/projects/b16d781254d347058aede92d9bba41ee` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:47.716047 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6001f8ab-2eb1-46cc-a974-e5322d47edc7 None admin] RBAC: Authorizing `identity:get_project(project_id=b16d781254d347058aede92d9bba41ee)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:47.717534 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6001f8ab-2eb1-46cc-a974-e5322d47edc7 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:47.719620 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 135/261] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 14 17:36:47 2022] GET /identity/v3/projects/b16d781254d347058aede92d9bba41ee => generated 302 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:36:47.720414 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6001f8ab-2eb1-46cc-a974-e5322d47edc7 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:47.734633 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d884c7-ab82-4232-be5e-82cbdd7d8042 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:47.757733 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:47.773357 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9292b24-08ab-42d0-982c-1b97e8578d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:47.774564 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9292b24-08ab-42d0-982c-1b97e8578d23 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:47.775055 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9292b24-08ab-42d0-982c-1b97e8578d23 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:47.775624 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9292b24-08ab-42d0-982c-1b97e8578d23 None admin] PATH_INFO: `/v3/users/b8f6fe5b390a476b98c9bf8fde068303` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:47.777072 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9292b24-08ab-42d0-982c-1b97e8578d23 None admin] RBAC: Authorizing `identity:get_user(user_id=b8f6fe5b390a476b98c9bf8fde068303)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:47.778782 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9292b24-08ab-42d0-982c-1b97e8578d23 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:47.781668 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 127/262] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 14 17:36:47 2022] GET /identity/v3/users/b8f6fe5b390a476b98c9bf8fde068303 => generated 297 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:36:47.782726 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9292b24-08ab-42d0-982c-1b97e8578d23 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:47.901598 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9292b24-08ab-42d0-982c-1b97e8578d23 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:47.938484 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6001f8ab-2eb1-46cc-a974-e5322d47edc7 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:47.940642 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35fa535-530d-4fa7-a6ca-7af0aff91122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:47.941584 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35fa535-530d-4fa7-a6ca-7af0aff91122 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:47.942617 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35fa535-530d-4fa7-a6ca-7af0aff91122 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:47.943112 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35fa535-530d-4fa7-a6ca-7af0aff91122 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:47.944306 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35fa535-530d-4fa7-a6ca-7af0aff91122 None admin] RBAC: Adding query filter params (role.id=1348580877d04014bfdec4d866b98a74, scope.project.id=b16d781254d347058aede92d9bba41ee, user.id=19054823196b4608b2cd7e101021183d) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:36:47.944890 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35fa535-530d-4fa7-a6ca-7af0aff91122 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:47.946585 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35fa535-530d-4fa7-a6ca-7af0aff91122 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:47.953902 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 128/263] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 14 17:36:47 2022] GET /identity/v3/role_assignments?user.id=19054823196b4608b2cd7e101021183d&scope.project.id=b16d781254d347058aede92d9bba41ee&role.id=1348580877d04014bfdec4d866b98a74 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:36:47.955002 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35fa535-530d-4fa7-a6ca-7af0aff91122 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:47.987687 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:48.064849 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecd6a24-837d-4787-8594-f094fbb8d47d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:48.065769 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecd6a24-837d-4787-8594-f094fbb8d47d None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:48.066057 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecd6a24-837d-4787-8594-f094fbb8d47d None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:48.066349 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecd6a24-837d-4787-8594-f094fbb8d47d None admin] PATH_INFO: `/v3/users/19054823196b4608b2cd7e101021183d` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:48.067759 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecd6a24-837d-4787-8594-f094fbb8d47d None admin] RBAC: Authorizing `identity:get_user(user_id=19054823196b4608b2cd7e101021183d)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:48.069244 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecd6a24-837d-4787-8594-f094fbb8d47d None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:48.070958 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 136/264] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 14 17:36:47 2022] GET /identity/v3/users/19054823196b4608b2cd7e101021183d => generated 283 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:36:48.080244 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecd6a24-837d-4787-8594-f094fbb8d47d None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:48.086969 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35fa535-530d-4fa7-a6ca-7af0aff91122 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:48.123924 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef7ccf0-65ad-4f47-96c1-0a5b14402c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:48.124807 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef7ccf0-65ad-4f47-96c1-0a5b14402c16 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:48.125097 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef7ccf0-65ad-4f47-96c1-0a5b14402c16 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:48.125383 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef7ccf0-65ad-4f47-96c1-0a5b14402c16 None admin] PATH_INFO: `/v3/projects/b16d781254d347058aede92d9bba41ee` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:48.128256 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef7ccf0-65ad-4f47-96c1-0a5b14402c16 None admin] RBAC: Authorizing `identity:get_project(project_id=b16d781254d347058aede92d9bba41ee)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:48.130590 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef7ccf0-65ad-4f47-96c1-0a5b14402c16 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:48.133957 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 129/265] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 14 17:36:47 2022] GET /identity/v3/projects/b16d781254d347058aede92d9bba41ee => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:36:48.140153 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef7ccf0-65ad-4f47-96c1-0a5b14402c16 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:48.265210 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:48.275080 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:48.289011 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecd6a24-837d-4787-8594-f094fbb8d47d None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:48.311801 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef7ccf0-65ad-4f47-96c1-0a5b14402c16 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:48.370335 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113f2ac3-0ffa-4e7f-a103-1f502d50e542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:48.371028 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113f2ac3-0ffa-4e7f-a103-1f502d50e542 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:48.372123 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113f2ac3-0ffa-4e7f-a103-1f502d50e542 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:48.372414 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113f2ac3-0ffa-4e7f-a103-1f502d50e542 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:48.392540 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b382d5-3e5b-4c29-98d4-74e162a15a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:48.393608 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b382d5-3e5b-4c29-98d4-74e162a15a6a None admin] REQUEST_METHOD: `PUT` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:48.393910 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b382d5-3e5b-4c29-98d4-74e162a15a6a None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:48.394167 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b382d5-3e5b-4c29-98d4-74e162a15a6a None admin] PATH_INFO: `/v3/projects/b16d781254d347058aede92d9bba41ee/users/b8f6fe5b390a476b98c9bf8fde068303/roles/9ee80134743f4c2b88525b04df2facba` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:48.396345 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b382d5-3e5b-4c29-98d4-74e162a15a6a None admin] RBAC: Authorizing `identity:create_grant(project_id=b16d781254d347058aede92d9bba41ee, user_id=b8f6fe5b390a476b98c9bf8fde068303, role_id=9ee80134743f4c2b88525b04df2facba)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:48.397818 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b382d5-3e5b-4c29-98d4-74e162a15a6a None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:48.471532 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113f2ac3-0ffa-4e7f-a103-1f502d50e542 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:48.473289 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113f2ac3-0ffa-4e7f-a103-1f502d50e542 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:48.485844 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 130/266] 10.222.0.36 () {58 vars in 1439 bytes} [Tue Jun 14 17:36:48 2022] PUT /identity/v3/projects/b16d781254d347058aede92d9bba41ee/users/b8f6fe5b390a476b98c9bf8fde068303/roles/9ee80134743f4c2b88525b04df2facba => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 17:36:48.487202 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c17e270-e3c5-4fd5-9148-a0d3407ea965 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:48.487524 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c17e270-e3c5-4fd5-9148-a0d3407ea965 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:48.487812 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c17e270-e3c5-4fd5-9148-a0d3407ea965 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:48.489637 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 131/267] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:36:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:36:48.497133 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77465877-8106-46c1-a063-e8ddb6bc3cb7 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:48.497416 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77465877-8106-46c1-a063-e8ddb6bc3cb7 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:48.497704 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77465877-8106-46c1-a063-e8ddb6bc3cb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:48.517882 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-77465877-8106-46c1-a063-e8ddb6bc3cb7 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:36:48.519192 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-77465877-8106-46c1-a063-e8ddb6bc3cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:36:48.625766 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:48.628537 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 132/268] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:36:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:36:48.630748 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31117183-182c-4079-bcdd-02c515ec69d6 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:48.631228 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31117183-182c-4079-bcdd-02c515ec69d6 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:48.636072 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 137/269] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 14 17:36:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 556 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 14 17:36:48.641504 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31117183-182c-4079-bcdd-02c515ec69d6 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:48.641786 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 133/270] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:36:48 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:36:48.644483 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113f2ac3-0ffa-4e7f-a103-1f502d50e542 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:48.649226 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac2e959-7798-4857-964b-fd644a96812e None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:48.649719 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac2e959-7798-4857-964b-fd644a96812e None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:48.650214 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac2e959-7798-4857-964b-fd644a96812e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:48.674461 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-bac2e959-7798-4857-964b-fd644a96812e None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:36:48.675775 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-bac2e959-7798-4857-964b-fd644a96812e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:36:48.764709 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:48.771653 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 134/271] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:36:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:36:48.772289 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113f2ac3-0ffa-4e7f-a103-1f502d50e542 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:48.772715 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac2e959-7798-4857-964b-fd644a96812e None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:48.827831 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f97360b-12ba-4ae1-8a8c-b3f5eca08ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:48.829145 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f97360b-12ba-4ae1-8a8c-b3f5eca08ed3 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:48.829625 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f97360b-12ba-4ae1-8a8c-b3f5eca08ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:48.830091 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f97360b-12ba-4ae1-8a8c-b3f5eca08ed3 None admin] PATH_INFO: `/v3/projects/b16d781254d347058aede92d9bba41ee` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:48.831576 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f97360b-12ba-4ae1-8a8c-b3f5eca08ed3 None admin] RBAC: Authorizing `identity:get_project(project_id=b16d781254d347058aede92d9bba41ee)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:48.834269 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f97360b-12ba-4ae1-8a8c-b3f5eca08ed3 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:48.839402 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 138/272] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 14 17:36:48 2022] GET /identity/v3/projects/b16d781254d347058aede92d9bba41ee => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:36:48.840651 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f97360b-12ba-4ae1-8a8c-b3f5eca08ed3 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:48.882936 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac2e959-7798-4857-964b-fd644a96812e None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:48.921860 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af90155-ccc8-4856-95f9-76d8ffc63188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:48.922667 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af90155-ccc8-4856-95f9-76d8ffc63188 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:48.922956 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af90155-ccc8-4856-95f9-76d8ffc63188 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:48.923239 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af90155-ccc8-4856-95f9-76d8ffc63188 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:48.924068 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:48.925584 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af90155-ccc8-4856-95f9-76d8ffc63188 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:48.927828 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af90155-ccc8-4856-95f9-76d8ffc63188 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:48.929705 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 135/273] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 14 17:36:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:36:48.930299 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af90155-ccc8-4856-95f9-76d8ffc63188 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:48.969293 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f97360b-12ba-4ae1-8a8c-b3f5eca08ed3 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:49.006483 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:49.010114 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b29a9a-4b9b-4548-b0f5-f42a10367c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:49.011157 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b29a9a-4b9b-4548-b0f5-f42a10367c6b None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:49.011667 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b29a9a-4b9b-4548-b0f5-f42a10367c6b None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:49.012137 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b29a9a-4b9b-4548-b0f5-f42a10367c6b None admin] PATH_INFO: `/v3/roles/member` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:49.025970 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b29a9a-4b9b-4548-b0f5-f42a10367c6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:36:49.034844 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-61b29a9a-4b9b-4548-b0f5-f42a10367c6b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 14 17:36:49.034844 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:36:49.034844 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:36:49.034844 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:36:49.034844 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:36:49.034844 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:36:49.034844 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:36:49.034844 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:36:49.034844 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:36:49.034844 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:36:49.034844 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:36:49.034844 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:36:49.034844 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:36:49.034844 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:36:49.034844 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:36:49.034844 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:36:49.037204 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:36:49.037204 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:36:49.037204 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:36:49.037204 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:36:49.037204 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:36:49.037204 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:36:49.037204 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:36:49.037204 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:36:49.037204 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:36:49.037204 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:36:49.037204 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:36:49.037204 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:36:49.037204 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:36:49.037204 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:36:49.037204 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:36:49.037204 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:36:49.038323 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:36:49.038323 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:36:49.038323 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:36:49.038323 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:36:49.038323 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:36:49.038323 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:36:49.038323 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:36:49.038323 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:36:49.038323 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:36:49.038323 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:36:49.038323 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 14 17:36:49.038323 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:36:49.045369 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af90155-ccc8-4856-95f9-76d8ffc63188 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:49.045910 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 139/274] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 14 17:36:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:36:49.047689 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b29a9a-4b9b-4548-b0f5-f42a10367c6b None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:49.084231 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7abf4f5-0e76-4778-81ad-294ee1af9199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:49.084872 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7abf4f5-0e76-4778-81ad-294ee1af9199 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:49.085162 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7abf4f5-0e76-4778-81ad-294ee1af9199 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:49.085464 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7abf4f5-0e76-4778-81ad-294ee1af9199 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:49.086443 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7abf4f5-0e76-4778-81ad-294ee1af9199 None admin] RBAC: Adding query filter params (role.id=e41c4e25dfdf4810aab2231cf98c98a9, scope.project.id=b16d781254d347058aede92d9bba41ee, user.id=19054823196b4608b2cd7e101021183d) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:36:49.086738 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7abf4f5-0e76-4778-81ad-294ee1af9199 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:49.088339 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7abf4f5-0e76-4778-81ad-294ee1af9199 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:49.095146 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 136/275] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 14 17:36:48 2022] GET /identity/v3/role_assignments?user.id=19054823196b4608b2cd7e101021183d&scope.project.id=b16d781254d347058aede92d9bba41ee&role.id=e41c4e25dfdf4810aab2231cf98c98a9 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:36:49.096253 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7abf4f5-0e76-4778-81ad-294ee1af9199 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:49.214306 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7abf4f5-0e76-4778-81ad-294ee1af9199 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:49.224375 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b29a9a-4b9b-4548-b0f5-f42a10367c6b None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:49.251088 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:49.255906 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:49.268977 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d8b158-dfe4-4ea7-b979-eb815c6779ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:49.271887 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d8b158-dfe4-4ea7-b979-eb815c6779ef None admin] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:49.273063 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d8b158-dfe4-4ea7-b979-eb815c6779ef None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:49.274366 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d8b158-dfe4-4ea7-b979-eb815c6779ef None admin] PATH_INFO: `/v3/users` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:49.276046 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d8b158-dfe4-4ea7-b979-eb815c6779ef None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:49.276953 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99958b4d-61fe-45c7-938d-ed9861c1e9f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:49.277868 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99958b4d-61fe-45c7-938d-ed9861c1e9f0 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:49.279812 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99958b4d-61fe-45c7-938d-ed9861c1e9f0 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:49.280328 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99958b4d-61fe-45c7-938d-ed9861c1e9f0 None admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:49.281308 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99958b4d-61fe-45c7-938d-ed9861c1e9f0 None admin] RBAC: Adding query filter params (name=member) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:36:49.281918 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d8b158-dfe4-4ea7-b979-eb815c6779ef None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:49.282945 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99958b4d-61fe-45c7-938d-ed9861c1e9f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:49.290619 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99958b4d-61fe-45c7-938d-ed9861c1e9f0 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:49.303695 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 137/276] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Jun 14 17:36:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:36:49.310013 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd27141-1da6-444c-b590-48bd1935b5cc None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:49.310312 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd27141-1da6-444c-b590-48bd1935b5cc None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:49.310597 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd27141-1da6-444c-b590-48bd1935b5cc None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:49.312028 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 138/277] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:36:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:36:49.316411 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd27141-1da6-444c-b590-48bd1935b5cc None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:49.412369 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 140/278] 10.222.0.36 () {60 vars in 1132 bytes} [Tue Jun 14 17:36:49 2022] POST /identity/v3/users => generated 293 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:36:49.419338 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07d6ed4-9bb5-427f-ad5d-fe61eb479461 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:49.419338 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07d6ed4-9bb5-427f-ad5d-fe61eb479461 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:49.419614 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07d6ed4-9bb5-427f-ad5d-fe61eb479461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:49.440639 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-d07d6ed4-9bb5-427f-ad5d-fe61eb479461 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:36:49.442544 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-d07d6ed4-9bb5-427f-ad5d-fe61eb479461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:36:49.458118 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd27141-1da6-444c-b590-48bd1935b5cc None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:49.508464 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05573879-e44d-4f8d-b605-770359205071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:49.509659 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05573879-e44d-4f8d-b605-770359205071 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:49.509952 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05573879-e44d-4f8d-b605-770359205071 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:49.510260 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05573879-e44d-4f8d-b605-770359205071 None admin] PATH_INFO: `/v3/users/ba6c68b3d7dc42a1a07391d2e932326f` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:49.533065 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05573879-e44d-4f8d-b605-770359205071 None admin] RBAC: Authorizing `identity:get_user(user_id=ba6c68b3d7dc42a1a07391d2e932326f)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:49.534818 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05573879-e44d-4f8d-b605-770359205071 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:49.539998 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 141/280] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:36:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:36:49.542540 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 139/280] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 14 17:36:49 2022] GET /identity/v3/users/ba6c68b3d7dc42a1a07391d2e932326f => generated 293 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:36:49.544567 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07d6ed4-9bb5-427f-ad5d-fe61eb479461 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:49.575559 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05573879-e44d-4f8d-b605-770359205071 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:49.640516 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:49.671409 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07d6ed4-9bb5-427f-ad5d-fe61eb479461 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:49.683582 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:49.707809 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05573879-e44d-4f8d-b605-770359205071 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:49.725320 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14645c4-e9db-4163-bc60-33a43a36ef51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:49.726043 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14645c4-e9db-4163-bc60-33a43a36ef51 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:49.726404 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14645c4-e9db-4163-bc60-33a43a36ef51 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:49.727144 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14645c4-e9db-4163-bc60-33a43a36ef51 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:49.728081 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14645c4-e9db-4163-bc60-33a43a36ef51 None admin] RBAC: Adding query filter params (role.id=9ee80134743f4c2b88525b04df2facba, user.id=ba6c68b3d7dc42a1a07391d2e932326f, scope.system=all) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:36:49.728403 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14645c4-e9db-4163-bc60-33a43a36ef51 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:49.730277 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14645c4-e9db-4163-bc60-33a43a36ef51 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:49.744201 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 142/281] 10.222.0.36 () {56 vars in 1308 bytes} [Tue Jun 14 17:36:49 2022] GET /identity/v3/role_assignments?user.id=ba6c68b3d7dc42a1a07391d2e932326f&scope.system=all&role.id=9ee80134743f4c2b88525b04df2facba => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:36:49.764169 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28576c07-d7da-4c00-b9c7-099729ca5a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:49.765241 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28576c07-d7da-4c00-b9c7-099729ca5a6d None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:49.765676 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28576c07-d7da-4c00-b9c7-099729ca5a6d None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:49.766109 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28576c07-d7da-4c00-b9c7-099729ca5a6d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:49.780932 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28576c07-d7da-4c00-b9c7-099729ca5a6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:36:49.790212 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-28576c07-d7da-4c00-b9c7-099729ca5a6d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 14 17:36:49.790212 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:36:49.790212 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:36:49.790212 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:36:49.790212 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:36:49.790212 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:36:49.790212 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:36:49.790212 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:36:49.790212 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:36:49.790212 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:36:49.790212 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:36:49.790212 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:36:49.790212 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:36:49.790212 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:36:49.790212 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:36:49.790212 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:36:49.791338 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:36:49.791338 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:36:49.791338 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:36:49.791338 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:36:49.791338 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:36:49.791338 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:36:49.791338 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:36:49.791338 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:36:49.791338 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:36:49.791338 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:36:49.791338 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:36:49.791338 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:36:49.791338 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:36:49.791338 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:36:49.791338 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:36:49.791338 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:36:49.792337 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:36:49.792337 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:36:49.792337 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:36:49.792337 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:36:49.792337 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:36:49.792337 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:36:49.792337 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:36:49.792337 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:36:49.792337 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:36:49.792337 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:36:49.792337 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 14 17:36:49.792337 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:36:49.794407 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 140/282] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 14 17:36:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 17:36:49.800852 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14645c4-e9db-4163-bc60-33a43a36ef51 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:49.951601 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14645c4-e9db-4163-bc60-33a43a36ef51 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:49.989563 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8b1629-b258-4ddb-aafb-c8223296fef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:49.990925 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8b1629-b258-4ddb-aafb-c8223296fef9 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:49.991389 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8b1629-b258-4ddb-aafb-c8223296fef9 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:49.991820 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8b1629-b258-4ddb-aafb-c8223296fef9 None admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:49.992743 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8b1629-b258-4ddb-aafb-c8223296fef9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:36:49.993208 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8b1629-b258-4ddb-aafb-c8223296fef9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:49.994730 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8b1629-b258-4ddb-aafb-c8223296fef9 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:50.003924 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 143/283] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Jun 14 17:36:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:36:50.012704 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28576c07-d7da-4c00-b9c7-099729ca5a6d None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:50.153319 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28576c07-d7da-4c00-b9c7-099729ca5a6d None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:50.172835 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:50.206782 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719b2081-4c8e-4aac-9d03-120911ff12d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:50.208698 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b2081-4c8e-4aac-9d03-120911ff12d9 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:50.209139 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b2081-4c8e-4aac-9d03-120911ff12d9 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:50.209597 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b2081-4c8e-4aac-9d03-120911ff12d9 None admin] PATH_INFO: `/v3/users/eb8cae07506d42619409ad147f4abbca` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:50.211219 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719b2081-4c8e-4aac-9d03-120911ff12d9 None admin] RBAC: Authorizing `identity:get_user(user_id=eb8cae07506d42619409ad147f4abbca)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:50.212952 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719b2081-4c8e-4aac-9d03-120911ff12d9 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:50.215168 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 141/284] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 14 17:36:50 2022] GET /identity/v3/users/eb8cae07506d42619409ad147f4abbca => generated 297 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:36:50.221005 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8b1629-b258-4ddb-aafb-c8223296fef9 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:50.272332 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:50.371147 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8b1629-b258-4ddb-aafb-c8223296fef9 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:50.427019 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635b3c4d-fd62-4ec4-82ca-22f2d07a71d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:50.427924 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635b3c4d-fd62-4ec4-82ca-22f2d07a71d2 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:50.428211 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635b3c4d-fd62-4ec4-82ca-22f2d07a71d2 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:50.428491 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635b3c4d-fd62-4ec4-82ca-22f2d07a71d2 None admin] PATH_INFO: `/v3/projects/b16d781254d347058aede92d9bba41ee` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:50.429776 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635b3c4d-fd62-4ec4-82ca-22f2d07a71d2 None admin] RBAC: Authorizing `identity:get_project(project_id=b16d781254d347058aede92d9bba41ee)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:50.431223 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635b3c4d-fd62-4ec4-82ca-22f2d07a71d2 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:50.432977 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 144/285] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 14 17:36:50 2022] GET /identity/v3/projects/b16d781254d347058aede92d9bba41ee => generated 302 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:36:50.438959 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719b2081-4c8e-4aac-9d03-120911ff12d9 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:50.590121 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719b2081-4c8e-4aac-9d03-120911ff12d9 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:50.641878 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975e6886-dacf-4544-a550-84af4275d4eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:50.642787 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975e6886-dacf-4544-a550-84af4275d4eb None admin] REQUEST_METHOD: `PUT` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:50.643075 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975e6886-dacf-4544-a550-84af4275d4eb None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:50.643377 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975e6886-dacf-4544-a550-84af4275d4eb None admin] PATH_INFO: `/v3/projects/b16d781254d347058aede92d9bba41ee/users/eb8cae07506d42619409ad147f4abbca/roles/2b061f334d51497f88c144fcf5764eeb` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:50.645961 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975e6886-dacf-4544-a550-84af4275d4eb None admin] RBAC: Authorizing `identity:create_grant(project_id=b16d781254d347058aede92d9bba41ee, user_id=eb8cae07506d42619409ad147f4abbca, role_id=2b061f334d51497f88c144fcf5764eeb)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:50.647523 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975e6886-dacf-4544-a550-84af4275d4eb None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:50.726225 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 142/286] 10.222.0.36 () {58 vars in 1439 bytes} [Tue Jun 14 17:36:50 2022] PUT /identity/v3/projects/b16d781254d347058aede92d9bba41ee/users/eb8cae07506d42619409ad147f4abbca/roles/2b061f334d51497f88c144fcf5764eeb => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:36:51.012424 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b015ee3-0a18-468b-933c-9d9879536201 None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:51.012931 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b015ee3-0a18-468b-933c-9d9879536201 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:51.012931 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b015ee3-0a18-468b-933c-9d9879536201 None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:51.014581 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 145/287] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:36:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:36:51.021030 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0973728-720a-470a-9946-1159f09b0f07 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:51.021366 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0973728-720a-470a-9946-1159f09b0f07 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:51.021606 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0973728-720a-470a-9946-1159f09b0f07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:51.039243 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-f0973728-720a-470a-9946-1159f09b0f07 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:36:51.040537 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-f0973728-720a-470a-9946-1159f09b0f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:36:51.080994 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:51.130363 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 143/288] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:36:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 14 17:36:51.154853 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b015ee3-0a18-468b-933c-9d9879536201 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:51.285154 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b015ee3-0a18-468b-933c-9d9879536201 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:51.287047 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:51.326767 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e751f669-7dae-451d-856d-31d33307854c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:51.327611 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e751f669-7dae-451d-856d-31d33307854c None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:51.327898 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e751f669-7dae-451d-856d-31d33307854c None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:51.328181 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e751f669-7dae-451d-856d-31d33307854c None admin] PATH_INFO: `/v3/roles/member` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:51.339067 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e751f669-7dae-451d-856d-31d33307854c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:36:51.346837 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-e751f669-7dae-451d-856d-31d33307854c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 14 17:36:51.346837 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:36:51.346837 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:36:51.346837 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:36:51.346837 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:36:51.346837 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:36:51.346837 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:36:51.346837 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:36:51.346837 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:36:51.346837 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:36:51.346837 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:36:51.346837 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:36:51.346837 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:36:51.346837 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:36:51.346837 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:36:51.346837 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:36:51.347855 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:36:51.347855 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:36:51.347855 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:36:51.347855 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:36:51.347855 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:36:51.347855 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:36:51.347855 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:36:51.347855 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:36:51.347855 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:36:51.347855 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:36:51.347855 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:36:51.347855 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:36:51.347855 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:36:51.347855 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:36:51.347855 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:36:51.347855 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:36:51.349636 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:36:51.349636 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:36:51.349636 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:36:51.349636 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:36:51.349636 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:36:51.349636 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:36:51.349636 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:36:51.349636 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:36:51.349636 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:36:51.349636 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:36:51.349636 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 14 17:36:51.349636 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:36:51.349636 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 146/289] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 14 17:36:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:36:51.354189 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0973728-720a-470a-9946-1159f09b0f07 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:51.481829 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0973728-720a-470a-9946-1159f09b0f07 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:51.532785 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03be152-d621-48d4-b269-a220e39aac5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:51.533459 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03be152-d621-48d4-b269-a220e39aac5b None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:51.533746 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03be152-d621-48d4-b269-a220e39aac5b None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:51.534028 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03be152-d621-48d4-b269-a220e39aac5b None admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:51.534776 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03be152-d621-48d4-b269-a220e39aac5b None admin] RBAC: Adding query filter params (name=member) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:36:51.535086 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03be152-d621-48d4-b269-a220e39aac5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:51.537260 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03be152-d621-48d4-b269-a220e39aac5b None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:51.548034 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 144/290] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Jun 14 17:36:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:36:51.554223 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e751f669-7dae-451d-856d-31d33307854c None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:51.692998 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e751f669-7dae-451d-856d-31d33307854c None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:51.744054 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a4549e-65ad-4891-a7b2-3ab9338066db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:51.744956 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a4549e-65ad-4891-a7b2-3ab9338066db None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:51.745245 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a4549e-65ad-4891-a7b2-3ab9338066db None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:51.745524 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a4549e-65ad-4891-a7b2-3ab9338066db None admin] PATH_INFO: `/v3/users/b8f6fe5b390a476b98c9bf8fde068303` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:51.746771 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a4549e-65ad-4891-a7b2-3ab9338066db None admin] RBAC: Authorizing `identity:get_user(user_id=b8f6fe5b390a476b98c9bf8fde068303)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:51.748268 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a4549e-65ad-4891-a7b2-3ab9338066db None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:51.750220 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 147/291] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 14 17:36:51 2022] GET /identity/v3/users/b8f6fe5b390a476b98c9bf8fde068303 => generated 297 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:36:51.755759 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03be152-d621-48d4-b269-a220e39aac5b None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:51.854364 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:51.948116 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03be152-d621-48d4-b269-a220e39aac5b None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:51.998077 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d2f2a4-c101-4a19-a29a-89e1e1ba2366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:51.998736 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d2f2a4-c101-4a19-a29a-89e1e1ba2366 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:51.999023 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d2f2a4-c101-4a19-a29a-89e1e1ba2366 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:51.999321 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d2f2a4-c101-4a19-a29a-89e1e1ba2366 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:52.082997 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d2f2a4-c101-4a19-a29a-89e1e1ba2366 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:52.084220 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d2f2a4-c101-4a19-a29a-89e1e1ba2366 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:52.126773 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:52.235080 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 145/292] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 14 17:36:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 14 17:36:52.241694 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a4549e-65ad-4891-a7b2-3ab9338066db None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:52.297623 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:52.345197 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8fed7c-ec10-4370-906d-ab1942ab4ec0 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:52.345554 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8fed7c-ec10-4370-906d-ab1942ab4ec0 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:52.345772 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8fed7c-ec10-4370-906d-ab1942ab4ec0 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:52.347283 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 146/293] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:36:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 14 17:36:52.353111 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363e89f0-1a66-4dd0-a63c-d7a8f25d6bc0 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:52.353400 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363e89f0-1a66-4dd0-a63c-d7a8f25d6bc0 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:52.353684 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363e89f0-1a66-4dd0-a63c-d7a8f25d6bc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:52.387426 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-363e89f0-1a66-4dd0-a63c-d7a8f25d6bc0 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:36:52.389264 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-363e89f0-1a66-4dd0-a63c-d7a8f25d6bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:36:52.406784 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a4549e-65ad-4891-a7b2-3ab9338066db None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:52.469233 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f66d41-7c25-46a8-bc57-00847cdab15c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:52.475352 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f66d41-7c25-46a8-bc57-00847cdab15c None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:52.475906 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f66d41-7c25-46a8-bc57-00847cdab15c None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:52.476400 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f66d41-7c25-46a8-bc57-00847cdab15c None admin] PATH_INFO: `/v3/projects/b16d781254d347058aede92d9bba41ee` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:52.477923 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f66d41-7c25-46a8-bc57-00847cdab15c None admin] RBAC: Authorizing `identity:get_project(project_id=b16d781254d347058aede92d9bba41ee)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:52.479603 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f66d41-7c25-46a8-bc57-00847cdab15c None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:52.483871 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 148/294] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 14 17:36:52 2022] GET /identity/v3/projects/b16d781254d347058aede92d9bba41ee => generated 302 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:36:52.490573 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f66d41-7c25-46a8-bc57-00847cdab15c None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:52.524666 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 147/295] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:36:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 14 17:36:52.531351 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934a71f5-b399-4bc6-81e0-2ae230755979 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:52.531351 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934a71f5-b399-4bc6-81e0-2ae230755979 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:52.531351 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934a71f5-b399-4bc6-81e0-2ae230755979 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:52.531351 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 148/296] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:36:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:36:52.537223 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec82410-46bc-4906-9129-f6248f42f380 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:52.537517 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec82410-46bc-4906-9129-f6248f42f380 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:52.537798 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec82410-46bc-4906-9129-f6248f42f380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:52.565148 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-cec82410-46bc-4906-9129-f6248f42f380 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:36:52.566444 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-cec82410-46bc-4906-9129-f6248f42f380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:36:52.633490 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:52.642544 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:52.646529 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f66d41-7c25-46a8-bc57-00847cdab15c None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:52.648423 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 149/297] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:36:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:36:52.649657 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec82410-46bc-4906-9129-f6248f42f380 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:52.686853 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca1ab46-affe-4f1d-916b-de7e9701cc4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:52.687552 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca1ab46-affe-4f1d-916b-de7e9701cc4b None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:52.687879 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca1ab46-affe-4f1d-916b-de7e9701cc4b None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:52.688124 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca1ab46-affe-4f1d-916b-de7e9701cc4b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:52.688961 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca1ab46-affe-4f1d-916b-de7e9701cc4b None admin] RBAC: Adding query filter params (role.id=9ee80134743f4c2b88525b04df2facba, scope.project.id=b16d781254d347058aede92d9bba41ee, user.id=b8f6fe5b390a476b98c9bf8fde068303) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:36:52.689282 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca1ab46-affe-4f1d-916b-de7e9701cc4b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:52.690754 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca1ab46-affe-4f1d-916b-de7e9701cc4b None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:52.703688 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 149/298] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 14 17:36:52 2022] GET /identity/v3/role_assignments?user.id=b8f6fe5b390a476b98c9bf8fde068303&scope.project.id=b16d781254d347058aede92d9bba41ee&role.id=9ee80134743f4c2b88525b04df2facba => generated 608 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:36:52.705829 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb01df9a-e362-44fe-9bea-3620f21e3634 None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:52.706312 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb01df9a-e362-44fe-9bea-3620f21e3634 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:52.706788 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb01df9a-e362-44fe-9bea-3620f21e3634 None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:52.709782 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 150/299] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:36:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:36:52.711073 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb01df9a-e362-44fe-9bea-3620f21e3634 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:52.796252 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec82410-46bc-4906-9129-f6248f42f380 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:52.844400 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1401404-074a-4b08-97d9-624571ab7965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:52.845237 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1401404-074a-4b08-97d9-624571ab7965 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:52.845746 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1401404-074a-4b08-97d9-624571ab7965 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:52.846040 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1401404-074a-4b08-97d9-624571ab7965 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:52.863371 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1401404-074a-4b08-97d9-624571ab7965 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:36:52.868533 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb01df9a-e362-44fe-9bea-3620f21e3634 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:52.873711 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-f1401404-074a-4b08-97d9-624571ab7965 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 14 17:36:52.873711 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:36:52.873711 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:36:52.873711 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:36:52.873711 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:36:52.873711 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:36:52.873711 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:36:52.873711 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:36:52.873711 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:36:52.873711 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:36:52.873711 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:36:52.873711 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:36:52.873711 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:36:52.873711 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:36:52.873711 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:36:52.873711 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:36:52.874710 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:36:52.874710 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:36:52.874710 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:36:52.874710 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:36:52.874710 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:36:52.874710 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:36:52.874710 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:36:52.874710 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:36:52.874710 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:36:52.874710 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:36:52.874710 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:36:52.874710 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:36:52.874710 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:36:52.874710 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:36:52.874710 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:36:52.874710 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:36:52.876196 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:36:52.876196 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:36:52.876196 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:36:52.876196 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:36:52.876196 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:36:52.876196 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:36:52.876196 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:36:52.876196 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:36:52.876196 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:36:52.876196 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:36:52.876196 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 14 17:36:52.876196 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:36:52.876196 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 150/300] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 14 17:36:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:36:52.876854 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a25b58-9de9-4263-b32c-11d6d9fae352 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:52.876919 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a25b58-9de9-4263-b32c-11d6d9fae352 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:52.877205 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a25b58-9de9-4263-b32c-11d6d9fae352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:52.902750 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-59a25b58-9de9-4263-b32c-11d6d9fae352 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:36:52.904027 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-59a25b58-9de9-4263-b32c-11d6d9fae352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:36:52.917726 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c53ad8-b62b-444f-872a-977dd0dc8e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:52.918594 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c53ad8-b62b-444f-872a-977dd0dc8e69 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:52.918862 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c53ad8-b62b-444f-872a-977dd0dc8e69 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:52.919147 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c53ad8-b62b-444f-872a-977dd0dc8e69 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:52.920394 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c53ad8-b62b-444f-872a-977dd0dc8e69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:52.921844 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c53ad8-b62b-444f-872a-977dd0dc8e69 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:52.923572 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 151/301] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 14 17:36:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:36:52.924416 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c53ad8-b62b-444f-872a-977dd0dc8e69 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:52.969578 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:52.971898 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:53.011390 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 151/302] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:36:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:36:53.012590 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a25b58-9de9-4263-b32c-11d6d9fae352 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:53.056235 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c53ad8-b62b-444f-872a-977dd0dc8e69 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:53.091232 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61bd795-c0e5-46c9-b42a-f0078d1b8a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:53.091948 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61bd795-c0e5-46c9-b42a-f0078d1b8a40 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:53.092233 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61bd795-c0e5-46c9-b42a-f0078d1b8a40 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:53.092519 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61bd795-c0e5-46c9-b42a-f0078d1b8a40 None admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:53.093268 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61bd795-c0e5-46c9-b42a-f0078d1b8a40 None admin] RBAC: Adding query filter params (name=member) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:36:53.093582 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61bd795-c0e5-46c9-b42a-f0078d1b8a40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:53.094967 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61bd795-c0e5-46c9-b42a-f0078d1b8a40 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:53.108717 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 152/303] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Jun 14 17:36:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:36:53.108717 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61bd795-c0e5-46c9-b42a-f0078d1b8a40 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:53.131177 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a25b58-9de9-4263-b32c-11d6d9fae352 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:53.168602 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469ba5bc-ee2c-469a-997d-e2f077f2cb65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:53.169290 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469ba5bc-ee2c-469a-997d-e2f077f2cb65 None admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:53.169583 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469ba5bc-ee2c-469a-997d-e2f077f2cb65 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:53.169866 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469ba5bc-ee2c-469a-997d-e2f077f2cb65 None admin] PATH_INFO: `/v3/groups` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:53.170552 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469ba5bc-ee2c-469a-997d-e2f077f2cb65 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:53.172047 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469ba5bc-ee2c-469a-997d-e2f077f2cb65 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:53.202497 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:53.210905 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61bd795-c0e5-46c9-b42a-f0078d1b8a40 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:53.248791 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfe706d-da80-40ad-8e98-e8e4657b7b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:53.251442 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfe706d-da80-40ad-8e98-e8e4657b7b14 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:53.251442 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfe706d-da80-40ad-8e98-e8e4657b7b14 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:53.251442 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfe706d-da80-40ad-8e98-e8e4657b7b14 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:53.262098 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfe706d-da80-40ad-8e98-e8e4657b7b14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:36:53.270425 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-8bfe706d-da80-40ad-8e98-e8e4657b7b14 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 14 17:36:53.270425 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:36:53.270425 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:36:53.270425 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:36:53.270425 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:36:53.270425 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:36:53.270425 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:36:53.270425 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:36:53.270425 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:36:53.270425 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:36:53.270425 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:36:53.270425 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:36:53.270425 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:36:53.270425 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:36:53.270425 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:36:53.270425 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:36:53.271544 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:36:53.271544 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:36:53.271544 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:36:53.271544 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:36:53.271544 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:36:53.271544 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:36:53.271544 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:36:53.271544 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:36:53.271544 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:36:53.271544 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:36:53.271544 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:36:53.271544 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:36:53.271544 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:36:53.271544 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:36:53.271544 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:36:53.271544 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:36:53.272384 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:36:53.272384 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:36:53.272384 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:36:53.272384 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:36:53.272384 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:36:53.272384 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:36:53.272384 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:36:53.272384 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:36:53.272384 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:36:53.272384 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:36:53.272384 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 14 17:36:53.272384 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:36:53.272384 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 153/304] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 14 17:36:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:36:53.274081 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfe706d-da80-40ad-8e98-e8e4657b7b14 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:53.319851 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 152/305] 10.222.0.36 () {60 vars in 1134 bytes} [Tue Jun 14 17:36:53 2022] POST /identity/v3/groups => generated 229 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:36:53.331774 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469ba5bc-ee2c-469a-997d-e2f077f2cb65 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:53.386530 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:53.396495 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfe706d-da80-40ad-8e98-e8e4657b7b14 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:53.445508 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d0c87d-7a11-48b0-a325-a117fbeb0b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:53.446514 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d0c87d-7a11-48b0-a325-a117fbeb0b61 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:53.446802 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d0c87d-7a11-48b0-a325-a117fbeb0b61 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:53.447086 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d0c87d-7a11-48b0-a325-a117fbeb0b61 None admin] PATH_INFO: `/v3/users/ba6c68b3d7dc42a1a07391d2e932326f` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:53.448885 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d0c87d-7a11-48b0-a325-a117fbeb0b61 None admin] RBAC: Authorizing `identity:get_user(user_id=ba6c68b3d7dc42a1a07391d2e932326f)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:53.450764 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d0c87d-7a11-48b0-a325-a117fbeb0b61 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:53.459851 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 154/306] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 14 17:36:53 2022] GET /identity/v3/users/ba6c68b3d7dc42a1a07391d2e932326f => generated 293 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:36:53.461391 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d0c87d-7a11-48b0-a325-a117fbeb0b61 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:53.474262 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469ba5bc-ee2c-469a-997d-e2f077f2cb65 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:53.512729 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8c1262-eb72-445f-87f4-631a70dd7930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:53.513421 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8c1262-eb72-445f-87f4-631a70dd7930 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:53.513719 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8c1262-eb72-445f-87f4-631a70dd7930 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:53.514039 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8c1262-eb72-445f-87f4-631a70dd7930 None admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:53.514970 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8c1262-eb72-445f-87f4-631a70dd7930 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:36:53.515311 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8c1262-eb72-445f-87f4-631a70dd7930 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:53.516820 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8c1262-eb72-445f-87f4-631a70dd7930 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:53.528870 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 153/307] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Jun 14 17:36:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:36:53.529780 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d9e2ca-dd0b-4341-af4e-63c78b536789 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:53.530161 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d9e2ca-dd0b-4341-af4e-63c78b536789 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:53.530451 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d9e2ca-dd0b-4341-af4e-63c78b536789 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:53.532145 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 154/308] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:36:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:36:53.537997 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d9e2ca-dd0b-4341-af4e-63c78b536789 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:53.600393 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d0c87d-7a11-48b0-a325-a117fbeb0b61 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:53.639272 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153b8f49-3092-4c32-8149-e047da78da2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:53.640244 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153b8f49-3092-4c32-8149-e047da78da2d None admin] REQUEST_METHOD: `PUT` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:53.640541 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153b8f49-3092-4c32-8149-e047da78da2d None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:53.640816 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153b8f49-3092-4c32-8149-e047da78da2d None admin] PATH_INFO: `/v3/system/users/ba6c68b3d7dc42a1a07391d2e932326f/roles/9ee80134743f4c2b88525b04df2facba` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:53.642466 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153b8f49-3092-4c32-8149-e047da78da2d None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=ba6c68b3d7dc42a1a07391d2e932326f, role_id=9ee80134743f4c2b88525b04df2facba)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:53.643918 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153b8f49-3092-4c32-8149-e047da78da2d None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:53.651028 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d9e2ca-dd0b-4341-af4e-63c78b536789 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:53.653073 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:53.685110 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b6cf93-86b7-4476-9d00-d3fea7f80549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:53.685997 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b6cf93-86b7-4476-9d00-d3fea7f80549 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:53.686289 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b6cf93-86b7-4476-9d00-d3fea7f80549 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:53.686574 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b6cf93-86b7-4476-9d00-d3fea7f80549 None admin] PATH_INFO: `/v3/users/3c65c6b27f1d42b7b7a6c2af0d38c872` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:53.701730 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b6cf93-86b7-4476-9d00-d3fea7f80549 None admin] RBAC: Authorizing `identity:get_user(user_id=3c65c6b27f1d42b7b7a6c2af0d38c872)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:53.703124 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b6cf93-86b7-4476-9d00-d3fea7f80549 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:53.704894 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 155/309] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 14 17:36:53 2022] GET /identity/v3/users/3c65c6b27f1d42b7b7a6c2af0d38c872 => generated 293 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:36:53.706345 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b7c696-f71d-42cf-83d1-0a972b75b3d1 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:53.706795 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b7c696-f71d-42cf-83d1-0a972b75b3d1 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:53.707132 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b7c696-f71d-42cf-83d1-0a972b75b3d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:53.720401 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 155/310] 10.222.0.36 () {58 vars in 1334 bytes} [Tue Jun 14 17:36:53 2022] PUT /identity/v3/system/users/ba6c68b3d7dc42a1a07391d2e932326f/roles/9ee80134743f4c2b88525b04df2facba => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 17:36:53.721067 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153b8f49-3092-4c32-8149-e047da78da2d None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:53.733126 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-83b7c696-f71d-42cf-83d1-0a972b75b3d1 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:36:53.737738 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-83b7c696-f71d-42cf-83d1-0a972b75b3d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:36:53.818576 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 156/311] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:36:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:36:53.834290 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:53.839323 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:53.846582 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b7c696-f71d-42cf-83d1-0a972b75b3d1 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:53.856981 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153b8f49-3092-4c32-8149-e047da78da2d None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:53.914557 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57fe402-3759-426b-abf3-9cb57deeaa5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:53.915413 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57fe402-3759-426b-abf3-9cb57deeaa5f None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:53.915681 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57fe402-3759-426b-abf3-9cb57deeaa5f None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:53.915960 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57fe402-3759-426b-abf3-9cb57deeaa5f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:53.916977 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57fe402-3759-426b-abf3-9cb57deeaa5f None admin] RBAC: Adding query filter params (role.id=2b061f334d51497f88c144fcf5764eeb, user.id=3c65c6b27f1d42b7b7a6c2af0d38c872, scope.system=all) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:36:53.917662 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57fe402-3759-426b-abf3-9cb57deeaa5f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:53.919423 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57fe402-3759-426b-abf3-9cb57deeaa5f None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:53.931221 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 156/312] 10.222.0.36 () {56 vars in 1308 bytes} [Tue Jun 14 17:36:53 2022] GET /identity/v3/role_assignments?user.id=3c65c6b27f1d42b7b7a6c2af0d38c872&scope.system=all&role.id=2b061f334d51497f88c144fcf5764eeb => generated 226 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:36:53.956532 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:53.974883 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b7c696-f71d-42cf-83d1-0a972b75b3d1 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:54.017422 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b971c227-c9da-4c0f-8734-993b78a1cf72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:54.021218 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b971c227-c9da-4c0f-8734-993b78a1cf72 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:54.021218 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b971c227-c9da-4c0f-8734-993b78a1cf72 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:54.021218 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b971c227-c9da-4c0f-8734-993b78a1cf72 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:54.033193 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b971c227-c9da-4c0f-8734-993b78a1cf72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:36:54.042500 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-b971c227-c9da-4c0f-8734-993b78a1cf72 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 14 17:36:54.042500 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:36:54.042500 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:36:54.042500 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:36:54.042500 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:36:54.042500 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:36:54.042500 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:36:54.042500 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:36:54.042500 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:36:54.042500 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:36:54.042500 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:36:54.042500 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:36:54.042500 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:36:54.042500 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:36:54.042500 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:36:54.042500 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:36:54.043519 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:36:54.043519 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:36:54.043519 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:36:54.043519 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:36:54.043519 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:36:54.043519 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:36:54.043519 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:36:54.043519 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:36:54.043519 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:36:54.043519 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:36:54.043519 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:36:54.043519 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:36:54.043519 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:36:54.043519 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:36:54.043519 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:36:54.043519 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:36:54.044401 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:36:54.044401 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:36:54.044401 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:36:54.044401 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:36:54.044401 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:36:54.044401 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:36:54.044401 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:36:54.044401 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:36:54.044401 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:36:54.044401 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:36:54.044401 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 14 17:36:54.044401 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:36:54.051569 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 157/313] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 14 17:36:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 17:36:54.054501 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57fe402-3759-426b-abf3-9cb57deeaa5f None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:54.170631 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57fe402-3759-426b-abf3-9cb57deeaa5f None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:54.208443 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cdf8f4-d8fc-4298-bd38-15d5e4f1b26f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:54.209489 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cdf8f4-d8fc-4298-bd38-15d5e4f1b26f None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:54.210023 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cdf8f4-d8fc-4298-bd38-15d5e4f1b26f None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:54.210512 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cdf8f4-d8fc-4298-bd38-15d5e4f1b26f None admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:54.211493 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cdf8f4-d8fc-4298-bd38-15d5e4f1b26f None admin] RBAC: Adding query filter params (name=reader) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:36:54.212071 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cdf8f4-d8fc-4298-bd38-15d5e4f1b26f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:54.213710 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cdf8f4-d8fc-4298-bd38-15d5e4f1b26f None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:54.227402 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 157/314] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Jun 14 17:36:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:36:54.229949 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b971c227-c9da-4c0f-8734-993b78a1cf72 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:54.341520 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b971c227-c9da-4c0f-8734-993b78a1cf72 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:54.378980 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe05f4a6-4f2a-414c-8dc4-c94250d7b74b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:54.381076 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe05f4a6-4f2a-414c-8dc4-c94250d7b74b None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:54.381619 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe05f4a6-4f2a-414c-8dc4-c94250d7b74b None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:54.382102 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe05f4a6-4f2a-414c-8dc4-c94250d7b74b None admin] PATH_INFO: `/v3/users/eb8cae07506d42619409ad147f4abbca` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:54.383586 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe05f4a6-4f2a-414c-8dc4-c94250d7b74b None admin] RBAC: Authorizing `identity:get_user(user_id=eb8cae07506d42619409ad147f4abbca)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:54.385356 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe05f4a6-4f2a-414c-8dc4-c94250d7b74b None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:54.387617 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 158/315] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 14 17:36:54 2022] GET /identity/v3/users/eb8cae07506d42619409ad147f4abbca => generated 297 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:36:54.393750 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cdf8f4-d8fc-4298-bd38-15d5e4f1b26f None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:54.408209 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:54.505707 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cdf8f4-d8fc-4298-bd38-15d5e4f1b26f None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:54.545100 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1aee50-c162-49ca-bdc4-f75de1309b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:54.546139 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1aee50-c162-49ca-bdc4-f75de1309b9b None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:54.546682 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1aee50-c162-49ca-bdc4-f75de1309b9b None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:54.547174 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1aee50-c162-49ca-bdc4-f75de1309b9b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:54.621815 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1aee50-c162-49ca-bdc4-f75de1309b9b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:54.623653 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1aee50-c162-49ca-bdc4-f75de1309b9b None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:54.636692 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:54.735328 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 158/316] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 14 17:36:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 14 17:36:54.741050 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe05f4a6-4f2a-414c-8dc4-c94250d7b74b None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:54.762865 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:54.850903 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe05f4a6-4f2a-414c-8dc4-c94250d7b74b None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:54.889517 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3f4f3d-2426-4a45-a33f-7eafca5e134e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:54.890792 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3f4f3d-2426-4a45-a33f-7eafca5e134e None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:54.891345 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3f4f3d-2426-4a45-a33f-7eafca5e134e None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:54.891834 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3f4f3d-2426-4a45-a33f-7eafca5e134e None admin] PATH_INFO: `/v3/projects/b16d781254d347058aede92d9bba41ee` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:54.893382 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3f4f3d-2426-4a45-a33f-7eafca5e134e None admin] RBAC: Authorizing `identity:get_project(project_id=b16d781254d347058aede92d9bba41ee)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:54.895830 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3f4f3d-2426-4a45-a33f-7eafca5e134e None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:54.902948 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 159/317] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 14 17:36:54 2022] GET /identity/v3/projects/b16d781254d347058aede92d9bba41ee => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:36:54.906174 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1aee50-c162-49ca-bdc4-f75de1309b9b None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:55.016180 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1aee50-c162-49ca-bdc4-f75de1309b9b None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:55.032007 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:55.053726 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8470fda-5999-4494-8940-e1fbb465ca57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:55.054424 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8470fda-5999-4494-8940-e1fbb465ca57 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:55.054721 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8470fda-5999-4494-8940-e1fbb465ca57 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:55.055005 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8470fda-5999-4494-8940-e1fbb465ca57 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:55.055941 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8470fda-5999-4494-8940-e1fbb465ca57 None admin] RBAC: Adding query filter params (role.id=2b061f334d51497f88c144fcf5764eeb, scope.project.id=b16d781254d347058aede92d9bba41ee, user.id=eb8cae07506d42619409ad147f4abbca) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:36:55.056264 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8470fda-5999-4494-8940-e1fbb465ca57 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:55.057790 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8470fda-5999-4494-8940-e1fbb465ca57 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:55.064878 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 159/318] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 14 17:36:54 2022] GET /identity/v3/role_assignments?user.id=eb8cae07506d42619409ad147f4abbca&scope.project.id=b16d781254d347058aede92d9bba41ee&role.id=2b061f334d51497f88c144fcf5764eeb => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:36:55.642803 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a0e5ca-50eb-4aa7-8873-fa7dae786b16 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:55.643203 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a0e5ca-50eb-4aa7-8873-fa7dae786b16 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:55.643409 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a0e5ca-50eb-4aa7-8873-fa7dae786b16 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:55.645513 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 160/319] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:36:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:36:55.650577 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bb4c64-8193-42a0-808f-314e1cf3b7a6 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:55.651061 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bb4c64-8193-42a0-808f-314e1cf3b7a6 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:55.651137 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bb4c64-8193-42a0-808f-314e1cf3b7a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:55.668359 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-08bb4c64-8193-42a0-808f-314e1cf3b7a6 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:36:55.669578 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-08bb4c64-8193-42a0-808f-314e1cf3b7a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:36:55.742132 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 160/320] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:36:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:36:55.765606 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a0e5ca-50eb-4aa7-8873-fa7dae786b16 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:55.856388 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:55.873258 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a0e5ca-50eb-4aa7-8873-fa7dae786b16 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:55.918964 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156a7747-d364-40b4-8111-a7a94485d853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:55.919803 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a7747-d364-40b4-8111-a7a94485d853 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:55.920084 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a7747-d364-40b4-8111-a7a94485d853 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:55.920370 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a7747-d364-40b4-8111-a7a94485d853 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:55.921548 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156a7747-d364-40b4-8111-a7a94485d853 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:55.923017 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156a7747-d364-40b4-8111-a7a94485d853 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:55.924978 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 161/321] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 14 17:36:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:36:55.930357 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bb4c64-8193-42a0-808f-314e1cf3b7a6 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:55.950527 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9d5288-ac96-46e1-a823-d72789b54b3a None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:55.951049 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9d5288-ac96-46e1-a823-d72789b54b3a None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:55.951591 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9d5288-ac96-46e1-a823-d72789b54b3a None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:55.952807 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 162/322] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:36:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 14 17:36:55.958751 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91a7cce-b663-44f8-b684-0120e5667f21 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:55.959049 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91a7cce-b663-44f8-b684-0120e5667f21 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:55.959366 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91a7cce-b663-44f8-b684-0120e5667f21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:55.976892 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-f91a7cce-b663-44f8-b684-0120e5667f21 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:36:55.978123 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-f91a7cce-b663-44f8-b684-0120e5667f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:36:56.042770 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bb4c64-8193-42a0-808f-314e1cf3b7a6 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:56.046036 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:56.050651 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 163/323] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:36:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 14 17:36:56.075681 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91a7cce-b663-44f8-b684-0120e5667f21 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:56.084732 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe2eeae-6f7f-45bb-9e3d-8e7eba13b122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:56.084732 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe2eeae-6f7f-45bb-9e3d-8e7eba13b122 None admin] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:56.084732 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe2eeae-6f7f-45bb-9e3d-8e7eba13b122 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:56.085009 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe2eeae-6f7f-45bb-9e3d-8e7eba13b122 None admin] PATH_INFO: `/v3/groups` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:56.085543 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe2eeae-6f7f-45bb-9e3d-8e7eba13b122 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:56.087019 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe2eeae-6f7f-45bb-9e3d-8e7eba13b122 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:56.233425 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 161/324] 10.222.0.36 () {60 vars in 1134 bytes} [Tue Jun 14 17:36:55 2022] POST /identity/v3/groups => generated 226 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:36:56.234993 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2137fcbb-3001-4d2e-b881-fa7fba7094e5 None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:56.235635 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2137fcbb-3001-4d2e-b881-fa7fba7094e5 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:56.235781 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2137fcbb-3001-4d2e-b881-fa7fba7094e5 None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:56.237346 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 162/325] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:36:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:36:56.244300 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd27e4-e3b5-498a-8638-48d523f26d27 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:56.244610 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd27e4-e3b5-498a-8638-48d523f26d27 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:56.244912 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd27e4-e3b5-498a-8638-48d523f26d27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:56.255875 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:56.259568 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91a7cce-b663-44f8-b684-0120e5667f21 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:56.264665 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-f5cd27e4-e3b5-498a-8638-48d523f26d27 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:36:56.266003 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-f5cd27e4-e3b5-498a-8638-48d523f26d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:36:56.302332 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061eb11c-e57a-4500-95aa-afbbaaeeac86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:56.319643 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061eb11c-e57a-4500-95aa-afbbaaeeac86 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:56.319643 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061eb11c-e57a-4500-95aa-afbbaaeeac86 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:56.319643 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061eb11c-e57a-4500-95aa-afbbaaeeac86 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:56.319643 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061eb11c-e57a-4500-95aa-afbbaaeeac86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:36:56.325836 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-061eb11c-e57a-4500-95aa-afbbaaeeac86 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 14 17:36:56.325836 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:36:56.325836 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:36:56.325836 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:36:56.325836 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:36:56.325836 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:36:56.325836 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:36:56.325836 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:36:56.325836 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:36:56.325836 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:36:56.325836 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:36:56.325836 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:36:56.325836 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:36:56.325836 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:36:56.325836 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:36:56.325836 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:36:56.326805 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:36:56.326805 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:36:56.326805 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:36:56.326805 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:36:56.326805 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:36:56.326805 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:36:56.326805 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:36:56.326805 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:36:56.326805 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:36:56.326805 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:36:56.326805 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:36:56.326805 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:36:56.326805 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:36:56.326805 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:36:56.326805 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:36:56.326805 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:36:56.327611 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:36:56.327611 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:36:56.327611 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:36:56.327611 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:36:56.327611 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:36:56.327611 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:36:56.327611 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:36:56.327611 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:36:56.327611 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:36:56.327611 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:36:56.327611 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 14 17:36:56.327611 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:36:56.327611 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 164/326] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 14 17:36:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 17:36:56.334911 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061eb11c-e57a-4500-95aa-afbbaaeeac86 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:56.353360 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 163/327] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:36:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 14 17:36:56.377046 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cd27e4-e3b5-498a-8638-48d523f26d27 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:56.461630 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061eb11c-e57a-4500-95aa-afbbaaeeac86 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:56.492661 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:56.501596 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cd27e4-e3b5-498a-8638-48d523f26d27 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:56.505303 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e640ec3f-16a7-4f4c-9286-272ce2cbf3f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:56.506176 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e640ec3f-16a7-4f4c-9286-272ce2cbf3f5 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:56.506457 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e640ec3f-16a7-4f4c-9286-272ce2cbf3f5 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:56.514266 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e640ec3f-16a7-4f4c-9286-272ce2cbf3f5 None admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:56.514266 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e640ec3f-16a7-4f4c-9286-272ce2cbf3f5 None admin] RBAC: Adding query filter params (name=member) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:36:56.514266 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e640ec3f-16a7-4f4c-9286-272ce2cbf3f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:56.514266 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e640ec3f-16a7-4f4c-9286-272ce2cbf3f5 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:56.518458 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 165/328] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Jun 14 17:36:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:36:56.526602 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e640ec3f-16a7-4f4c-9286-272ce2cbf3f5 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:56.536994 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:56.543562 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17878cfa-3177-4b84-8827-9a086872c47e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:56.544377 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17878cfa-3177-4b84-8827-9a086872c47e None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:56.544750 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17878cfa-3177-4b84-8827-9a086872c47e None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:56.545044 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17878cfa-3177-4b84-8827-9a086872c47e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:56.557580 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17878cfa-3177-4b84-8827-9a086872c47e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:36:56.565621 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-17878cfa-3177-4b84-8827-9a086872c47e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 14 17:36:56.565621 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:36:56.565621 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:36:56.565621 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:36:56.565621 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:36:56.565621 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:36:56.565621 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:36:56.565621 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:36:56.565621 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:36:56.565621 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:36:56.565621 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:36:56.565621 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:36:56.565621 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:36:56.565621 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:36:56.565621 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:36:56.565621 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:36:56.567233 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:36:56.567233 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:36:56.567233 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:36:56.567233 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:36:56.567233 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:36:56.567233 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:36:56.567233 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:36:56.567233 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:36:56.567233 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:36:56.567233 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:36:56.567233 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:36:56.567233 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:36:56.567233 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:36:56.567233 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:36:56.567233 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:36:56.567233 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:36:56.568642 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:36:56.568642 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:36:56.568642 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:36:56.568642 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:36:56.568642 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:36:56.568642 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:36:56.568642 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:36:56.568642 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:36:56.568642 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:36:56.568642 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:36:56.568642 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 14 17:36:56.568642 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:36:56.568642 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 164/329] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 14 17:36:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 17:36:56.575843 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17878cfa-3177-4b84-8827-9a086872c47e None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:56.663359 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e640ec3f-16a7-4f4c-9286-272ce2cbf3f5 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:56.708167 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480c6b72-74fc-4e66-83df-c0012b49c0b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:56.710181 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480c6b72-74fc-4e66-83df-c0012b49c0b8 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:56.711418 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480c6b72-74fc-4e66-83df-c0012b49c0b8 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:56.711712 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480c6b72-74fc-4e66-83df-c0012b49c0b8 None admin] PATH_INFO: `/v3/users/ba6c68b3d7dc42a1a07391d2e932326f` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:56.713337 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480c6b72-74fc-4e66-83df-c0012b49c0b8 None admin] RBAC: Authorizing `identity:get_user(user_id=ba6c68b3d7dc42a1a07391d2e932326f)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:56.715582 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480c6b72-74fc-4e66-83df-c0012b49c0b8 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:56.717921 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 166/330] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 14 17:36:56 2022] GET /identity/v3/users/ba6c68b3d7dc42a1a07391d2e932326f => generated 293 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:36:56.718108 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17878cfa-3177-4b84-8827-9a086872c47e None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:56.725410 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480c6b72-74fc-4e66-83df-c0012b49c0b8 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:56.768157 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eb27b3-5109-4890-b99e-a8fc5dbc0ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:56.768804 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eb27b3-5109-4890-b99e-a8fc5dbc0ec3 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:56.769098 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eb27b3-5109-4890-b99e-a8fc5dbc0ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:56.769390 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eb27b3-5109-4890-b99e-a8fc5dbc0ec3 None admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:56.771060 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25eb27b3-5109-4890-b99e-a8fc5dbc0ec3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:36:56.772363 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25eb27b3-5109-4890-b99e-a8fc5dbc0ec3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:56.773962 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25eb27b3-5109-4890-b99e-a8fc5dbc0ec3 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:56.786290 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 165/331] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Jun 14 17:36:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:36:56.793471 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eb27b3-5109-4890-b99e-a8fc5dbc0ec3 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:56.827260 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:56.834468 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:56.870002 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480c6b72-74fc-4e66-83df-c0012b49c0b8 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:56.913963 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1faad54-40f5-495a-a62a-37c13cbb5315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:56.915007 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1faad54-40f5-495a-a62a-37c13cbb5315 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:56.915501 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1faad54-40f5-495a-a62a-37c13cbb5315 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:56.915879 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1faad54-40f5-495a-a62a-37c13cbb5315 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:56.916836 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1faad54-40f5-495a-a62a-37c13cbb5315 None admin] RBAC: Adding query filter params (role.id=9ee80134743f4c2b88525b04df2facba, user.id=ba6c68b3d7dc42a1a07391d2e932326f, scope.system=all) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:36:56.917308 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1faad54-40f5-495a-a62a-37c13cbb5315 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:56.918983 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1faad54-40f5-495a-a62a-37c13cbb5315 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:56.934334 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eb27b3-5109-4890-b99e-a8fc5dbc0ec3 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:56.936642 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 167/332] 10.222.0.36 () {56 vars in 1308 bytes} [Tue Jun 14 17:36:56 2022] GET /identity/v3/role_assignments?user.id=ba6c68b3d7dc42a1a07391d2e932326f&scope.system=all&role.id=9ee80134743f4c2b88525b04df2facba => generated 510 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:36:56.989976 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a59cca-ff79-4ee4-a6ea-38184b564faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:56.990887 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a59cca-ff79-4ee4-a6ea-38184b564faf None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:56.991176 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a59cca-ff79-4ee4-a6ea-38184b564faf None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:56.991541 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a59cca-ff79-4ee4-a6ea-38184b564faf None admin] PATH_INFO: `/v3/users/3c65c6b27f1d42b7b7a6c2af0d38c872` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:56.992799 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a59cca-ff79-4ee4-a6ea-38184b564faf None admin] RBAC: Authorizing `identity:get_user(user_id=3c65c6b27f1d42b7b7a6c2af0d38c872)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:56.994260 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a59cca-ff79-4ee4-a6ea-38184b564faf None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:56.995990 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 166/333] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 14 17:36:56 2022] GET /identity/v3/users/3c65c6b27f1d42b7b7a6c2af0d38c872 => generated 293 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:36:57.001765 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1faad54-40f5-495a-a62a-37c13cbb5315 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:57.116451 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1faad54-40f5-495a-a62a-37c13cbb5315 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:57.148839 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:57.154587 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5894e747-9cdf-4ec6-b842-22c45fb9194d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:57.155508 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5894e747-9cdf-4ec6-b842-22c45fb9194d None admin] REQUEST_METHOD: `PUT` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:57.155799 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5894e747-9cdf-4ec6-b842-22c45fb9194d None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:57.156085 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5894e747-9cdf-4ec6-b842-22c45fb9194d None admin] PATH_INFO: `/v3/system/users/3c65c6b27f1d42b7b7a6c2af0d38c872/roles/2b061f334d51497f88c144fcf5764eeb` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:57.157686 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5894e747-9cdf-4ec6-b842-22c45fb9194d None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=3c65c6b27f1d42b7b7a6c2af0d38c872, role_id=2b061f334d51497f88c144fcf5764eeb)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:57.159086 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5894e747-9cdf-4ec6-b842-22c45fb9194d None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:57.228689 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 168/334] 10.222.0.36 () {58 vars in 1334 bytes} [Tue Jun 14 17:36:57 2022] PUT /identity/v3/system/users/3c65c6b27f1d42b7b7a6c2af0d38c872/roles/2b061f334d51497f88c144fcf5764eeb => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:36:59.102302 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08a2967-b9ed-47be-a698-e9ccf7cd5197 None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:59.102865 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08a2967-b9ed-47be-a698-e9ccf7cd5197 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:59.102865 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08a2967-b9ed-47be-a698-e9ccf7cd5197 None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:59.104586 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 167/335] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:36:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:36:59.110093 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643b0b7d-732e-4305-9830-d272263c27b8 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:59.110501 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643b0b7d-732e-4305-9830-d272263c27b8 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:59.110696 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643b0b7d-732e-4305-9830-d272263c27b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:59.136645 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-643b0b7d-732e-4305-9830-d272263c27b8 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:36:59.138187 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-643b0b7d-732e-4305-9830-d272263c27b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:36:59.226208 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 169/336] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:36:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:36:59.266182 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08a2967-b9ed-47be-a698-e9ccf7cd5197 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:59.276485 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af36ef30-8fe1-4508-a916-e8d9bce0f062 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:59.276769 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af36ef30-8fe1-4508-a916-e8d9bce0f062 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:59.277044 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af36ef30-8fe1-4508-a916-e8d9bce0f062 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:59.278451 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 170/337] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:36:59 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:36:59.286560 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e32a95-b884-4156-a2b8-a3a4b69d54ad None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:59.286871 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e32a95-b884-4156-a2b8-a3a4b69d54ad None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:59.287128 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e32a95-b884-4156-a2b8-a3a4b69d54ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:59.323018 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-34e32a95-b884-4156-a2b8-a3a4b69d54ad None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:36:59.324323 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-34e32a95-b884-4156-a2b8-a3a4b69d54ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:36:59.429022 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 171/338] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:36:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:36:59.463717 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:59.468586 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08a2967-b9ed-47be-a698-e9ccf7cd5197 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:59.480327 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e32a95-b884-4156-a2b8-a3a4b69d54ad None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:59.533320 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e180a59-ef35-40df-9409-b85e0b6a9c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:59.534524 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e180a59-ef35-40df-9409-b85e0b6a9c60 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:59.536011 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e180a59-ef35-40df-9409-b85e0b6a9c60 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:59.536594 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e180a59-ef35-40df-9409-b85e0b6a9c60 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:59.556496 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e180a59-ef35-40df-9409-b85e0b6a9c60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:36:59.567015 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-1e180a59-ef35-40df-9409-b85e0b6a9c60 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 14 17:36:59.567015 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:36:59.567015 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:36:59.567015 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:36:59.567015 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:36:59.567015 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:36:59.567015 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:36:59.567015 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:36:59.567015 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:36:59.567015 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:36:59.567015 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:36:59.567015 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:36:59.567015 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:36:59.567015 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:36:59.567015 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:36:59.567015 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:36:59.567986 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:36:59.567986 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:36:59.567986 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:36:59.567986 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:36:59.567986 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:36:59.567986 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:36:59.567986 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:36:59.567986 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:36:59.567986 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:36:59.567986 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:36:59.567986 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:36:59.567986 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:36:59.567986 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:36:59.567986 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:36:59.567986 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:36:59.567986 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:36:59.568758 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:36:59.568758 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:36:59.568758 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:36:59.568758 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:36:59.568758 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:36:59.568758 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:36:59.568758 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:36:59.568758 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:36:59.568758 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:36:59.568758 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:36:59.568758 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 14 17:36:59.568758 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:36:59.573658 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 168/339] 10.222.0.36 () {56 vars in 1114 bytes} [Tue Jun 14 17:36:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:36:59.574930 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e180a59-ef35-40df-9409-b85e0b6a9c60 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:59.616720 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:59.755662 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e32a95-b884-4156-a2b8-a3a4b69d54ad None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:59.792279 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e180a59-ef35-40df-9409-b85e0b6a9c60 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:36:59.831223 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5b8eea-3792-4af7-941e-47e8b9090a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:59.832806 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5b8eea-3792-4af7-941e-47e8b9090a58 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:59.833369 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5b8eea-3792-4af7-941e-47e8b9090a58 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:59.833369 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5b8eea-3792-4af7-941e-47e8b9090a58 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:59.849827 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5b8eea-3792-4af7-941e-47e8b9090a58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:36:59.857686 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-ea5b8eea-3792-4af7-941e-47e8b9090a58 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 14 17:36:59.857686 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:36:59.857686 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:36:59.857686 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:36:59.857686 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:36:59.857686 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:36:59.857686 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:36:59.857686 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:36:59.857686 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:36:59.857686 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:36:59.857686 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:36:59.857686 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:36:59.857686 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:36:59.857686 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:36:59.857686 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:36:59.857686 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:36:59.858583 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:36:59.858583 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:36:59.858583 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:36:59.858583 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:36:59.858583 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:36:59.858583 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:36:59.858583 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:36:59.858583 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:36:59.858583 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:36:59.858583 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:36:59.858583 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:36:59.858583 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:36:59.858583 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:36:59.858583 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:36:59.858583 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:36:59.858583 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:36:59.859386 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:36:59.859386 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:36:59.859386 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:36:59.859386 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:36:59.859386 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:36:59.859386 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:36:59.859386 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:36:59.859386 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:36:59.859386 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:36:59.859386 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:36:59.859386 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 14 17:36:59.859386 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:36:59.859980 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 172/340] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 14 17:36:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 380 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 17:36:59.861269 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee60de42-a239-4061-9933-086c673415fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:36:59.862009 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee60de42-a239-4061-9933-086c673415fa None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:59.862295 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee60de42-a239-4061-9933-086c673415fa None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:59.862573 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee60de42-a239-4061-9933-086c673415fa None admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:59.863619 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee60de42-a239-4061-9933-086c673415fa None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:36:59.864098 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee60de42-a239-4061-9933-086c673415fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:36:59.865319 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee60de42-a239-4061-9933-086c673415fa None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:36:59.868205 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9058454e-1ef7-452d-9550-585c74359e1f None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:59.868492 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9058454e-1ef7-452d-9550-585c74359e1f None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:59.868771 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9058454e-1ef7-452d-9550-585c74359e1f None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:59.870172 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 173/341] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:36:59 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:36:59.870908 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9058454e-1ef7-452d-9550-585c74359e1f None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:36:59.880388 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 169/342] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 14 17:36:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:36:59.881688 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c916c221-c5ed-401a-8e70-8c0efd4eca04 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:36:59.881983 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c916c221-c5ed-401a-8e70-8c0efd4eca04 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:36:59.882269 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c916c221-c5ed-401a-8e70-8c0efd4eca04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:36:59.903679 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:36:59.914802 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-c916c221-c5ed-401a-8e70-8c0efd4eca04 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:36:59.928070 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-c916c221-c5ed-401a-8e70-8c0efd4eca04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:37:00.043094 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 170/343] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:36:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:37:00.043900 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c916c221-c5ed-401a-8e70-8c0efd4eca04 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:00.073646 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9058454e-1ef7-452d-9550-585c74359e1f None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:00.101270 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:00.139309 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334a4139-ac3d-47ec-9845-3f6be2d8f0d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:00.140087 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a4139-ac3d-47ec-9845-3f6be2d8f0d7 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:00.140287 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a4139-ac3d-47ec-9845-3f6be2d8f0d7 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:00.140568 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a4139-ac3d-47ec-9845-3f6be2d8f0d7 None admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:00.141397 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334a4139-ac3d-47ec-9845-3f6be2d8f0d7 None admin] RBAC: Adding query filter params (name=member) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:00.141733 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334a4139-ac3d-47ec-9845-3f6be2d8f0d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:00.143156 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334a4139-ac3d-47ec-9845-3f6be2d8f0d7 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:00.157541 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 174/344] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Jun 14 17:36:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:00.158390 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334a4139-ac3d-47ec-9845-3f6be2d8f0d7 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:00.232816 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c916c221-c5ed-401a-8e70-8c0efd4eca04 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:00.296162 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a064ae18-282b-42ec-a6c3-9aa1f40a0dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:00.296748 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a064ae18-282b-42ec-a6c3-9aa1f40a0dca None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:00.297035 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a064ae18-282b-42ec-a6c3-9aa1f40a0dca None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:00.297318 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a064ae18-282b-42ec-a6c3-9aa1f40a0dca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:00.305183 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:00.340779 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334a4139-ac3d-47ec-9845-3f6be2d8f0d7 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:00.407152 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a064ae18-282b-42ec-a6c3-9aa1f40a0dca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:00.408718 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a064ae18-282b-42ec-a6c3-9aa1f40a0dca None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:00.409164 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f85371-5e07-4b3f-a6bf-bf97f10eade1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:00.410997 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f85371-5e07-4b3f-a6bf-bf97f10eade1 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:00.410997 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f85371-5e07-4b3f-a6bf-bf97f10eade1 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:00.411652 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f85371-5e07-4b3f-a6bf-bf97f10eade1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:00.438112 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f85371-5e07-4b3f-a6bf-bf97f10eade1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:37:00.446201 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-83f85371-5e07-4b3f-a6bf-bf97f10eade1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 14 17:37:00.446201 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:00.446201 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:00.446201 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:00.446201 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:00.446201 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:00.446201 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:00.446201 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:00.446201 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:00.446201 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:00.446201 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:00.446201 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:00.446201 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:37:00.446201 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:37:00.446201 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:37:00.446201 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:37:00.447185 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:37:00.447185 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:37:00.447185 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:37:00.447185 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:37:00.447185 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:00.447185 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:00.447185 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:00.447185 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:00.447185 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:00.447185 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:00.447185 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:00.447185 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:00.447185 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:00.447185 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:00.447185 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:00.447185 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:00.448025 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:00.448025 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:00.448025 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:00.448025 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:00.448025 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:37:00.448025 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:37:00.448025 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:37:00.448025 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:37:00.448025 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:37:00.448025 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:37:00.448025 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 14 17:37:00.448025 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:37:00.451809 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 175/345] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 14 17:37:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:37:00.452793 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f85371-5e07-4b3f-a6bf-bf97f10eade1 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:00.522069 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:00.573631 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 171/346] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 14 17:37:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 530 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 14 17:37:00.574978 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a064ae18-282b-42ec-a6c3-9aa1f40a0dca None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:00.636984 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f85371-5e07-4b3f-a6bf-bf97f10eade1 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:00.643807 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:00.682465 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3e7e05-75cb-4321-bb5d-f314550b478b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:00.683293 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3e7e05-75cb-4321-bb5d-f314550b478b None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:00.683737 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3e7e05-75cb-4321-bb5d-f314550b478b None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:00.684025 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3e7e05-75cb-4321-bb5d-f314550b478b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:00.757636 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a064ae18-282b-42ec-a6c3-9aa1f40a0dca None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:00.765892 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3e7e05-75cb-4321-bb5d-f314550b478b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:00.767434 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3e7e05-75cb-4321-bb5d-f314550b478b None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:00.810837 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67568e57-27e6-4110-9d45-69401faea3cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:00.811582 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67568e57-27e6-4110-9d45-69401faea3cf None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:00.811877 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67568e57-27e6-4110-9d45-69401faea3cf None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:00.812160 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67568e57-27e6-4110-9d45-69401faea3cf None admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:00.812935 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67568e57-27e6-4110-9d45-69401faea3cf None admin] RBAC: Adding query filter params (name=member) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:00.813254 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67568e57-27e6-4110-9d45-69401faea3cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:00.814739 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67568e57-27e6-4110-9d45-69401faea3cf None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:00.815968 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:00.833317 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 172/347] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Jun 14 17:37:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:00.834705 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e42c81-5583-4929-85eb-18c6de7dea14 None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:00.835003 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e42c81-5583-4929-85eb-18c6de7dea14 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:00.835292 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e42c81-5583-4929-85eb-18c6de7dea14 None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:00.840911 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 173/348] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:37:00 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:37:00.841713 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e42c81-5583-4929-85eb-18c6de7dea14 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:00.913802 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 176/349] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 14 17:37:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 14 17:37:00.914293 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3e7e05-75cb-4321-bb5d-f314550b478b None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:01.007213 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:01.014380 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e42c81-5583-4929-85eb-18c6de7dea14 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:01.065872 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3e7e05-75cb-4321-bb5d-f314550b478b None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:01.068932 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985cd881-ca38-4e13-9f5f-e08b6426ab3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:01.069827 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985cd881-ca38-4e13-9f5f-e08b6426ab3a None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:01.070114 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985cd881-ca38-4e13-9f5f-e08b6426ab3a None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:01.070396 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985cd881-ca38-4e13-9f5f-e08b6426ab3a None admin] PATH_INFO: `/v3/projects/b2d7081316264626896ee5ec5050f5de` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:01.072196 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985cd881-ca38-4e13-9f5f-e08b6426ab3a None admin] RBAC: Authorizing `identity:get_project(project_id=b2d7081316264626896ee5ec5050f5de)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:01.073665 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985cd881-ca38-4e13-9f5f-e08b6426ab3a None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:01.075773 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 174/350] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 14 17:37:00 2022] GET /identity/v3/projects/b2d7081316264626896ee5ec5050f5de => generated 298 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:01.077105 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acadef0e-4e69-4538-ad7f-2cbdef4eee88 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:01.077391 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acadef0e-4e69-4538-ad7f-2cbdef4eee88 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:01.077679 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acadef0e-4e69-4538-ad7f-2cbdef4eee88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:01.096793 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-acadef0e-4e69-4538-ad7f-2cbdef4eee88 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:37:01.098792 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-acadef0e-4e69-4538-ad7f-2cbdef4eee88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:37:01.113102 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6344e7-d669-4365-91a2-e7b347459044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:01.114312 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6344e7-d669-4365-91a2-e7b347459044 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:01.114732 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6344e7-d669-4365-91a2-e7b347459044 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:01.115023 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6344e7-d669-4365-91a2-e7b347459044 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:01.128250 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:01.185146 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 175/351] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:37:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:37:01.187556 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07ae7af-1ffb-447c-a601-8ba143a049ea None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:01.187556 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07ae7af-1ffb-447c-a601-8ba143a049ea None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:01.187736 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07ae7af-1ffb-447c-a601-8ba143a049ea None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:01.189447 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 176/352] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:37:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:37:01.189994 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07ae7af-1ffb-447c-a601-8ba143a049ea None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:01.213063 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6344e7-d669-4365-91a2-e7b347459044 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:01.214645 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6344e7-d669-4365-91a2-e7b347459044 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:01.326994 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:01.339642 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07ae7af-1ffb-447c-a601-8ba143a049ea None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:01.357276 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 177/353] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 14 17:37:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 14 17:37:01.358225 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6344e7-d669-4365-91a2-e7b347459044 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:01.384472 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bddf9ca-fa5e-4093-8d88-5ad0e052d08a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:01.385363 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bddf9ca-fa5e-4093-8d88-5ad0e052d08a None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:01.385647 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bddf9ca-fa5e-4093-8d88-5ad0e052d08a None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:01.385930 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bddf9ca-fa5e-4093-8d88-5ad0e052d08a None admin] PATH_INFO: `/v3/projects/b2d7081316264626896ee5ec5050f5de` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:01.388240 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bddf9ca-fa5e-4093-8d88-5ad0e052d08a None admin] RBAC: Authorizing `identity:get_project(project_id=b2d7081316264626896ee5ec5050f5de)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:01.391266 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bddf9ca-fa5e-4093-8d88-5ad0e052d08a None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:01.394025 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 177/354] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 14 17:37:01 2022] GET /identity/v3/projects/b2d7081316264626896ee5ec5050f5de => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:01.396699 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416423bb-4f20-410b-bdb2-1c286334428d None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:01.396991 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416423bb-4f20-410b-bdb2-1c286334428d None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:01.397273 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416423bb-4f20-410b-bdb2-1c286334428d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:01.413697 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:01.415668 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-416423bb-4f20-410b-bdb2-1c286334428d None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:37:01.416867 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-416423bb-4f20-410b-bdb2-1c286334428d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:37:01.489031 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6344e7-d669-4365-91a2-e7b347459044 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:01.497171 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 178/355] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:37:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:37:01.498066 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416423bb-4f20-410b-bdb2-1c286334428d None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:01.531601 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a773d836-4385-4446-b03d-a58c32fe98c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:01.532484 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a773d836-4385-4446-b03d-a58c32fe98c4 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:01.532890 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a773d836-4385-4446-b03d-a58c32fe98c4 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:01.533171 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a773d836-4385-4446-b03d-a58c32fe98c4 None admin] PATH_INFO: `/v3/groups/dcda01bd59bb4d09a5e63b76b41293b1` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:01.541706 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a773d836-4385-4446-b03d-a58c32fe98c4 None admin] RBAC: Authorizing `identity:get_group(group_id=dcda01bd59bb4d09a5e63b76b41293b1)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:01.543193 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a773d836-4385-4446-b03d-a58c32fe98c4 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:01.546169 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 178/356] 10.222.0.36 () {56 vars in 1180 bytes} [Tue Jun 14 17:37:01 2022] GET /identity/v3/groups/dcda01bd59bb4d09a5e63b76b41293b1 => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:01.547477 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea500655-ac58-43d7-ab73-b85524cf1b06 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:01.547777 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea500655-ac58-43d7-ab73-b85524cf1b06 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:01.548362 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea500655-ac58-43d7-ab73-b85524cf1b06 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:01.549936 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 179/357] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:37:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:37:01.550970 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea500655-ac58-43d7-ab73-b85524cf1b06 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:01.612324 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:01.619964 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416423bb-4f20-410b-bdb2-1c286334428d None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:01.664187 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6be544-1cc2-4827-9ec8-1402123978a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:01.665015 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6be544-1cc2-4827-9ec8-1402123978a9 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:01.667229 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6be544-1cc2-4827-9ec8-1402123978a9 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:01.667229 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6be544-1cc2-4827-9ec8-1402123978a9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:01.674693 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea500655-ac58-43d7-ab73-b85524cf1b06 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:01.676991 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:01.678897 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6be544-1cc2-4827-9ec8-1402123978a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:37:01.687201 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-dd6be544-1cc2-4827-9ec8-1402123978a9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 14 17:37:01.687201 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:01.687201 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:01.687201 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:01.687201 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:01.687201 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:01.687201 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:01.687201 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:01.687201 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:01.687201 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:01.687201 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:01.687201 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:01.687201 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:37:01.687201 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:37:01.687201 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:37:01.687201 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:37:01.688167 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:37:01.688167 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:37:01.688167 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:37:01.688167 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:37:01.688167 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:01.688167 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:01.688167 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:01.688167 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:01.688167 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:01.688167 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:01.688167 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:01.688167 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:01.688167 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:01.688167 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:01.688167 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:01.688167 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:01.689023 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:01.689023 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:01.689023 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:01.689023 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:01.689023 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:37:01.689023 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:37:01.689023 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:37:01.689023 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:37:01.689023 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:37:01.689023 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:37:01.689023 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 14 17:37:01.689023 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:37:01.689023 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 179/358] 10.222.0.36 () {56 vars in 1114 bytes} [Tue Jun 14 17:37:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:37:01.689676 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6be544-1cc2-4827-9ec8-1402123978a9 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:01.725371 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5832b9f1-9267-42c5-945d-fdfc2510ebd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:01.726522 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5832b9f1-9267-42c5-945d-fdfc2510ebd1 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:01.726522 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5832b9f1-9267-42c5-945d-fdfc2510ebd1 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:01.726797 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5832b9f1-9267-42c5-945d-fdfc2510ebd1 None admin] PATH_INFO: `/v3/projects/b16d781254d347058aede92d9bba41ee` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:01.728482 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5832b9f1-9267-42c5-945d-fdfc2510ebd1 None admin] RBAC: Authorizing `identity:get_project(project_id=b16d781254d347058aede92d9bba41ee)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:01.729497 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5832b9f1-9267-42c5-945d-fdfc2510ebd1 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:01.731203 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 180/359] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 14 17:37:01 2022] GET /identity/v3/projects/b16d781254d347058aede92d9bba41ee => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:01.731997 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5832b9f1-9267-42c5-945d-fdfc2510ebd1 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:01.815638 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6be544-1cc2-4827-9ec8-1402123978a9 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:01.850868 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5832b9f1-9267-42c5-945d-fdfc2510ebd1 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:01.859592 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b2580f-8137-4575-ab55-c71172cd0896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:01.860465 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b2580f-8137-4575-ab55-c71172cd0896 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:01.860755 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b2580f-8137-4575-ab55-c71172cd0896 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:01.861034 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b2580f-8137-4575-ab55-c71172cd0896 None admin] PATH_INFO: `/v3/groups/dcda01bd59bb4d09a5e63b76b41293b1` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:01.862232 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b2580f-8137-4575-ab55-c71172cd0896 None admin] RBAC: Authorizing `identity:get_group(group_id=dcda01bd59bb4d09a5e63b76b41293b1)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:01.864306 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b2580f-8137-4575-ab55-c71172cd0896 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:01.866007 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 180/360] 10.222.0.36 () {56 vars in 1180 bytes} [Tue Jun 14 17:37:01 2022] GET /identity/v3/groups/dcda01bd59bb4d09a5e63b76b41293b1 => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:01.868027 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b2580f-8137-4575-ab55-c71172cd0896 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:01.898752 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:01.900439 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3af76b7-ffc6-41df-a84b-9060dee07845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:01.901485 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3af76b7-ffc6-41df-a84b-9060dee07845 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:01.901960 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3af76b7-ffc6-41df-a84b-9060dee07845 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:01.902311 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3af76b7-ffc6-41df-a84b-9060dee07845 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:01.915747 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3af76b7-ffc6-41df-a84b-9060dee07845 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:37:01.923836 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-a3af76b7-ffc6-41df-a84b-9060dee07845 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 14 17:37:01.923836 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:01.923836 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:01.923836 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:01.923836 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:01.923836 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:01.923836 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:01.923836 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:01.923836 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:01.923836 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:01.923836 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:01.923836 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:01.923836 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:37:01.923836 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:37:01.923836 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:37:01.923836 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:37:01.924779 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:37:01.924779 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:37:01.924779 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:37:01.924779 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:37:01.924779 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:01.924779 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:01.924779 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:01.924779 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:01.924779 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:01.924779 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:01.924779 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:01.924779 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:01.924779 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:01.924779 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:01.924779 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:01.924779 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:01.925747 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:01.925747 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:01.925747 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:01.925747 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:01.925747 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:37:01.925747 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:37:01.925747 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:37:01.925747 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:37:01.925747 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:37:01.925747 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:37:01.925747 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 14 17:37:01.925747 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:37:01.928063 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 181/361] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 14 17:37:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:37:01.928063 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fdf3fb-41ba-42c3-9b48-07d304cc5d0a None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:01.928063 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fdf3fb-41ba-42c3-9b48-07d304cc5d0a None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:01.928063 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fdf3fb-41ba-42c3-9b48-07d304cc5d0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:01.948391 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-f7fdf3fb-41ba-42c3-9b48-07d304cc5d0a None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:37:01.949729 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-f7fdf3fb-41ba-42c3-9b48-07d304cc5d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:37:01.978987 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:02.005674 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b2580f-8137-4575-ab55-c71172cd0896 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:02.040838 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 182/362] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:37:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:37:02.042385 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fdf3fb-41ba-42c3-9b48-07d304cc5d0a None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:02.050196 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428ef914-ef06-4873-89d2-88319caafdd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:02.050937 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428ef914-ef06-4873-89d2-88319caafdd9 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:02.051752 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428ef914-ef06-4873-89d2-88319caafdd9 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:02.052153 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428ef914-ef06-4873-89d2-88319caafdd9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:02.053009 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428ef914-ef06-4873-89d2-88319caafdd9 None admin] RBAC: Adding query filter params (group.id=dcda01bd59bb4d09a5e63b76b41293b1, role.id=e41c4e25dfdf4810aab2231cf98c98a9, scope.project.id=b2d7081316264626896ee5ec5050f5de) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:02.053705 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428ef914-ef06-4873-89d2-88319caafdd9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:02.055626 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428ef914-ef06-4873-89d2-88319caafdd9 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:02.067654 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 181/363] 10.222.0.36 () {56 vars in 1376 bytes} [Tue Jun 14 17:37:01 2022] GET /identity/v3/role_assignments?group.id=dcda01bd59bb4d09a5e63b76b41293b1&scope.project.id=b2d7081316264626896ee5ec5050f5de&role.id=e41c4e25dfdf4810aab2231cf98c98a9 => generated 260 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:02.068705 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428ef914-ef06-4873-89d2-88319caafdd9 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:02.201023 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:02.218195 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428ef914-ef06-4873-89d2-88319caafdd9 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:02.219723 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fdf3fb-41ba-42c3-9b48-07d304cc5d0a None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:02.267032 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c35359-e904-48ec-a4e6-8f61611593b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:02.267990 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c35359-e904-48ec-a4e6-8f61611593b5 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:02.268098 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cf27b5-190f-4cb9-b652-54d637dcc7e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:02.268315 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c35359-e904-48ec-a4e6-8f61611593b5 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:02.268710 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c35359-e904-48ec-a4e6-8f61611593b5 None admin] PATH_INFO: `/v3/groups/dcda01bd59bb4d09a5e63b76b41293b1` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:02.268821 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cf27b5-190f-4cb9-b652-54d637dcc7e3 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:02.269055 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cf27b5-190f-4cb9-b652-54d637dcc7e3 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:02.269370 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cf27b5-190f-4cb9-b652-54d637dcc7e3 None admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:02.270863 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cf27b5-190f-4cb9-b652-54d637dcc7e3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:02.270974 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c35359-e904-48ec-a4e6-8f61611593b5 None admin] RBAC: Authorizing `identity:get_group(group_id=dcda01bd59bb4d09a5e63b76b41293b1)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:02.271178 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cf27b5-190f-4cb9-b652-54d637dcc7e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:02.272678 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c35359-e904-48ec-a4e6-8f61611593b5 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:02.273739 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cf27b5-190f-4cb9-b652-54d637dcc7e3 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:02.275386 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 182/364] 10.222.0.36 () {56 vars in 1180 bytes} [Tue Jun 14 17:37:02 2022] GET /identity/v3/groups/dcda01bd59bb4d09a5e63b76b41293b1 => generated 226 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:02.276254 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c35359-e904-48ec-a4e6-8f61611593b5 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:02.289081 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 183/365] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 14 17:37:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:02.289745 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cf27b5-190f-4cb9-b652-54d637dcc7e3 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:02.327505 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:02.431910 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c35359-e904-48ec-a4e6-8f61611593b5 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:02.460561 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cf27b5-190f-4cb9-b652-54d637dcc7e3 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:02.478068 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc4c0ec-5d41-4fe7-b630-ee94ffe3db8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:02.478734 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc4c0ec-5d41-4fe7-b630-ee94ffe3db8b None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:02.479030 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc4c0ec-5d41-4fe7-b630-ee94ffe3db8b None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:02.479425 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc4c0ec-5d41-4fe7-b630-ee94ffe3db8b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:02.480477 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc4c0ec-5d41-4fe7-b630-ee94ffe3db8b None admin] RBAC: Adding query filter params (group.id=dcda01bd59bb4d09a5e63b76b41293b1, role.id=9ee80134743f4c2b88525b04df2facba, scope.project.id=b2d7081316264626896ee5ec5050f5de) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:02.480795 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc4c0ec-5d41-4fe7-b630-ee94ffe3db8b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:02.482245 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc4c0ec-5d41-4fe7-b630-ee94ffe3db8b None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:02.499333 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 183/366] 10.222.0.36 () {56 vars in 1376 bytes} [Tue Jun 14 17:37:02 2022] GET /identity/v3/role_assignments?group.id=dcda01bd59bb4d09a5e63b76b41293b1&scope.project.id=b2d7081316264626896ee5ec5050f5de&role.id=9ee80134743f4c2b88525b04df2facba => generated 260 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:02.499333 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc4c0ec-5d41-4fe7-b630-ee94ffe3db8b None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:02.512839 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c26271-0ed4-41fd-88c7-92a170e25fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:02.513840 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c26271-0ed4-41fd-88c7-92a170e25fbe None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:02.514129 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c26271-0ed4-41fd-88c7-92a170e25fbe None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:02.514409 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c26271-0ed4-41fd-88c7-92a170e25fbe None admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:02.515586 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c26271-0ed4-41fd-88c7-92a170e25fbe None admin] RBAC: Adding query filter params (name=reader) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:02.515898 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c26271-0ed4-41fd-88c7-92a170e25fbe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:02.516723 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:02.518935 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c26271-0ed4-41fd-88c7-92a170e25fbe None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:02.533547 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 184/367] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Jun 14 17:37:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:02.534506 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c26271-0ed4-41fd-88c7-92a170e25fbe None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:02.617952 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc4c0ec-5d41-4fe7-b630-ee94ffe3db8b None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:02.655757 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:02.657198 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f581c710-d5b6-4ef1-9588-5ad9acabd01b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:02.658023 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f581c710-d5b6-4ef1-9588-5ad9acabd01b None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:02.658316 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f581c710-d5b6-4ef1-9588-5ad9acabd01b None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:02.658606 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f581c710-d5b6-4ef1-9588-5ad9acabd01b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:02.663948 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c26271-0ed4-41fd-88c7-92a170e25fbe None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:02.672002 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f581c710-d5b6-4ef1-9588-5ad9acabd01b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:37:02.681131 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-f581c710-d5b6-4ef1-9588-5ad9acabd01b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 17:37:02.681131 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:02.681131 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:02.681131 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:02.681131 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:02.681131 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:02.681131 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:02.681131 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:02.681131 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:02.681131 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:02.681131 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:02.681131 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:02.681131 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:37:02.681131 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:37:02.681131 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:37:02.681131 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:37:02.682080 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:37:02.682080 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:37:02.682080 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:37:02.682080 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:37:02.682080 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:02.682080 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:02.682080 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:02.682080 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:02.682080 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:02.682080 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:02.682080 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:02.682080 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:02.682080 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:02.682080 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:02.682080 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:02.682080 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:02.682898 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:02.682898 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:02.682898 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:02.682898 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:02.682898 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:37:02.682898 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:37:02.682898 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:37:02.682898 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:37:02.682898 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:37:02.682898 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:37:02.682898 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 17:37:02.682898 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:37:02.682898 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 184/368] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jun 14 17:37:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:37:02.683644 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f581c710-d5b6-4ef1-9588-5ad9acabd01b None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:02.709933 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcb7556-2435-4ebf-9da9-b892d04b21ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:02.710670 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcb7556-2435-4ebf-9da9-b892d04b21ff None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:02.710903 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcb7556-2435-4ebf-9da9-b892d04b21ff None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:02.711191 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcb7556-2435-4ebf-9da9-b892d04b21ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:02.712636 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcb7556-2435-4ebf-9da9-b892d04b21ff None admin] RBAC: Adding query filter params (group.id=dcda01bd59bb4d09a5e63b76b41293b1, role.id=9ee80134743f4c2b88525b04df2facba, scope.project.id=b16d781254d347058aede92d9bba41ee) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:02.712959 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcb7556-2435-4ebf-9da9-b892d04b21ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:02.714660 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcb7556-2435-4ebf-9da9-b892d04b21ff None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:02.725993 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 185/369] 10.222.0.36 () {56 vars in 1376 bytes} [Tue Jun 14 17:37:02 2022] GET /identity/v3/role_assignments?group.id=dcda01bd59bb4d09a5e63b76b41293b1&scope.project.id=b16d781254d347058aede92d9bba41ee&role.id=9ee80134743f4c2b88525b04df2facba => generated 260 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:02.727079 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcb7556-2435-4ebf-9da9-b892d04b21ff None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:02.830390 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:02.875026 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f581c710-d5b6-4ef1-9588-5ad9acabd01b None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:02.938558 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcb7556-2435-4ebf-9da9-b892d04b21ff None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:02.948557 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d220445b-afe0-42bf-a5e0-3901c9d04fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:02.949239 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d220445b-afe0-42bf-a5e0-3901c9d04fff None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:02.949532 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d220445b-afe0-42bf-a5e0-3901c9d04fff None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:02.949824 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d220445b-afe0-42bf-a5e0-3901c9d04fff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:03.022406 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0f4552-5dcc-4794-9044-790e6913eba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:03.023713 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0f4552-5dcc-4794-9044-790e6913eba6 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:03.024209 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0f4552-5dcc-4794-9044-790e6913eba6 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:03.024720 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0f4552-5dcc-4794-9044-790e6913eba6 None admin] PATH_INFO: `/v3/users/3c65c6b27f1d42b7b7a6c2af0d38c872` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:03.026369 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0f4552-5dcc-4794-9044-790e6913eba6 None admin] RBAC: Authorizing `identity:get_user(user_id=3c65c6b27f1d42b7b7a6c2af0d38c872)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:03.028131 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0f4552-5dcc-4794-9044-790e6913eba6 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:03.030455 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 186/370] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 14 17:37:02 2022] GET /identity/v3/users/3c65c6b27f1d42b7b7a6c2af0d38c872 => generated 293 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:03.031572 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0f4552-5dcc-4794-9044-790e6913eba6 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:03.075205 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:03.093385 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d220445b-afe0-42bf-a5e0-3901c9d04fff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:03.094899 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d220445b-afe0-42bf-a5e0-3901c9d04fff None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:03.223791 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:03.252119 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0f4552-5dcc-4794-9044-790e6913eba6 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:03.261430 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 185/371] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 14 17:37:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 578 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 14 17:37:03.262330 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d220445b-afe0-42bf-a5e0-3901c9d04fff None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:03.332355 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65c5b7e-77d9-4a51-8db8-6d25cd0ec50b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:03.333059 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65c5b7e-77d9-4a51-8db8-6d25cd0ec50b None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:03.333476 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65c5b7e-77d9-4a51-8db8-6d25cd0ec50b None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:03.333764 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65c5b7e-77d9-4a51-8db8-6d25cd0ec50b None admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:03.334557 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65c5b7e-77d9-4a51-8db8-6d25cd0ec50b None admin] RBAC: Adding query filter params (name=admin) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:03.334871 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65c5b7e-77d9-4a51-8db8-6d25cd0ec50b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:03.336312 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65c5b7e-77d9-4a51-8db8-6d25cd0ec50b None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:03.351697 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 187/372] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 14 17:37:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:03.352905 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65c5b7e-77d9-4a51-8db8-6d25cd0ec50b None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:03.419412 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d220445b-afe0-42bf-a5e0-3901c9d04fff None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:03.478028 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3136134a-4151-4ff2-baf6-ca4633ecd68e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:03.479532 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3136134a-4151-4ff2-baf6-ca4633ecd68e None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:03.480060 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3136134a-4151-4ff2-baf6-ca4633ecd68e None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:03.480550 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3136134a-4151-4ff2-baf6-ca4633ecd68e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:03.481596 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3136134a-4151-4ff2-baf6-ca4633ecd68e None admin] RBAC: Adding query filter params (role.id=2b061f334d51497f88c144fcf5764eeb, user.id=3c65c6b27f1d42b7b7a6c2af0d38c872, scope.system=all) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:03.482135 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3136134a-4151-4ff2-baf6-ca4633ecd68e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:03.483894 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3136134a-4151-4ff2-baf6-ca4633ecd68e None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:03.512804 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 186/373] 10.222.0.36 () {56 vars in 1308 bytes} [Tue Jun 14 17:37:03 2022] GET /identity/v3/role_assignments?user.id=3c65c6b27f1d42b7b7a6c2af0d38c872&scope.system=all&role.id=2b061f334d51497f88c144fcf5764eeb => generated 510 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:03.514006 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3136134a-4151-4ff2-baf6-ca4633ecd68e None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:03.520205 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:03.576070 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65c5b7e-77d9-4a51-8db8-6d25cd0ec50b None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:03.595787 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:03.652966 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e6abfa-d5bc-4c02-b5f7-4585247472a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:03.654238 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e6abfa-d5bc-4c02-b5f7-4585247472a4 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:03.654730 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e6abfa-d5bc-4c02-b5f7-4585247472a4 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:03.655244 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e6abfa-d5bc-4c02-b5f7-4585247472a4 None admin] PATH_INFO: `/v3/projects/b16d781254d347058aede92d9bba41ee` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:03.658827 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e6abfa-d5bc-4c02-b5f7-4585247472a4 None admin] RBAC: Authorizing `identity:get_project(project_id=b16d781254d347058aede92d9bba41ee)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:03.660912 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e6abfa-d5bc-4c02-b5f7-4585247472a4 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:03.666711 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 188/374] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 14 17:37:03 2022] GET /identity/v3/projects/b16d781254d347058aede92d9bba41ee => generated 302 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:03.675585 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e6abfa-d5bc-4c02-b5f7-4585247472a4 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:03.734047 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3136134a-4151-4ff2-baf6-ca4633ecd68e None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:03.784490 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23985259-f5d3-48ef-ac9f-3bda3941e082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:03.785802 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23985259-f5d3-48ef-ac9f-3bda3941e082 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:03.786294 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23985259-f5d3-48ef-ac9f-3bda3941e082 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:03.786791 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23985259-f5d3-48ef-ac9f-3bda3941e082 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:03.901462 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e6abfa-d5bc-4c02-b5f7-4585247472a4 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:03.914790 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23985259-f5d3-48ef-ac9f-3bda3941e082 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:03.916596 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23985259-f5d3-48ef-ac9f-3bda3941e082 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:03.967111 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:04.016544 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197deace-9e48-43c4-8ad6-e5af207ecf78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:04.017479 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197deace-9e48-43c4-8ad6-e5af207ecf78 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:04.017709 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197deace-9e48-43c4-8ad6-e5af207ecf78 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:04.017987 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197deace-9e48-43c4-8ad6-e5af207ecf78 None admin] PATH_INFO: `/v3/groups/dcda01bd59bb4d09a5e63b76b41293b1` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:04.019764 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197deace-9e48-43c4-8ad6-e5af207ecf78 None admin] RBAC: Authorizing `identity:get_group(group_id=dcda01bd59bb4d09a5e63b76b41293b1)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:04.022060 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197deace-9e48-43c4-8ad6-e5af207ecf78 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:04.024169 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 189/375] 10.222.0.36 () {56 vars in 1180 bytes} [Tue Jun 14 17:37:03 2022] GET /identity/v3/groups/dcda01bd59bb4d09a5e63b76b41293b1 => generated 226 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:04.029589 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197deace-9e48-43c4-8ad6-e5af207ecf78 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:04.033268 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 187/376] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 14 17:37:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 14 17:37:04.040421 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23985259-f5d3-48ef-ac9f-3bda3941e082 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:04.055557 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:04.170721 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23985259-f5d3-48ef-ac9f-3bda3941e082 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:04.172432 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197deace-9e48-43c4-8ad6-e5af207ecf78 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:04.212410 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a806cd-95a9-4194-8021-d90665b43254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:04.213811 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a806cd-95a9-4194-8021-d90665b43254 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:04.214312 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a806cd-95a9-4194-8021-d90665b43254 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:04.214864 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a806cd-95a9-4194-8021-d90665b43254 None admin] PATH_INFO: `/v3/projects/f37a5c2ee2664dafb5a29dda0a1fc6e2` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:04.217095 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a806cd-95a9-4194-8021-d90665b43254 None admin] RBAC: Authorizing `identity:get_project(project_id=f37a5c2ee2664dafb5a29dda0a1fc6e2)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:04.218790 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3294b719-1bf4-4d09-87bb-158c80b24ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:04.219159 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a806cd-95a9-4194-8021-d90665b43254 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:04.219517 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3294b719-1bf4-4d09-87bb-158c80b24ae9 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:04.219809 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3294b719-1bf4-4d09-87bb-158c80b24ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:04.220095 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3294b719-1bf4-4d09-87bb-158c80b24ae9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:04.220940 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3294b719-1bf4-4d09-87bb-158c80b24ae9 None admin] RBAC: Adding query filter params (group.id=dcda01bd59bb4d09a5e63b76b41293b1, role.id=e41c4e25dfdf4810aab2231cf98c98a9, scope.project.id=b16d781254d347058aede92d9bba41ee) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:04.221263 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3294b719-1bf4-4d09-87bb-158c80b24ae9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:04.223680 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3294b719-1bf4-4d09-87bb-158c80b24ae9 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:04.227500 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 188/377] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 14 17:37:04 2022] GET /identity/v3/projects/f37a5c2ee2664dafb5a29dda0a1fc6e2 => generated 344 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:37:04.230014 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a806cd-95a9-4194-8021-d90665b43254 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:04.230637 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 190/378] 10.222.0.36 () {56 vars in 1376 bytes} [Tue Jun 14 17:37:04 2022] GET /identity/v3/role_assignments?group.id=dcda01bd59bb4d09a5e63b76b41293b1&scope.project.id=b16d781254d347058aede92d9bba41ee&role.id=e41c4e25dfdf4810aab2231cf98c98a9 => generated 260 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:37:04.234431 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:04.351559 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a806cd-95a9-4194-8021-d90665b43254 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:04.391328 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e221b9f1-f67f-40cb-9ed7-184fbe8e734c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:04.392230 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e221b9f1-f67f-40cb-9ed7-184fbe8e734c None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:04.392688 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e221b9f1-f67f-40cb-9ed7-184fbe8e734c None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:04.393142 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e221b9f1-f67f-40cb-9ed7-184fbe8e734c None admin] PATH_INFO: `/v3/groups/91477abed46a4412a3c967a5aeb0417a` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:04.403166 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e221b9f1-f67f-40cb-9ed7-184fbe8e734c None admin] RBAC: Authorizing `identity:get_group(group_id=91477abed46a4412a3c967a5aeb0417a)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:04.404996 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e221b9f1-f67f-40cb-9ed7-184fbe8e734c None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:04.407246 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 189/379] 10.222.0.36 () {56 vars in 1180 bytes} [Tue Jun 14 17:37:04 2022] GET /identity/v3/groups/91477abed46a4412a3c967a5aeb0417a => generated 229 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:37:04.415474 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3294b719-1bf4-4d09-87bb-158c80b24ae9 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:04.503227 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:04.528755 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3294b719-1bf4-4d09-87bb-158c80b24ae9 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:04.570663 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0a0797-1049-45eb-958c-d928c28079dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:04.571366 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0a0797-1049-45eb-958c-d928c28079dd None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:04.571660 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0a0797-1049-45eb-958c-d928c28079dd None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:04.571948 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0a0797-1049-45eb-958c-d928c28079dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:04.572797 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0a0797-1049-45eb-958c-d928c28079dd None admin] RBAC: Adding query filter params (group.id=91477abed46a4412a3c967a5aeb0417a, role.id=1348580877d04014bfdec4d866b98a74, scope.project.id=f37a5c2ee2664dafb5a29dda0a1fc6e2) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:04.573122 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0a0797-1049-45eb-958c-d928c28079dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:04.574573 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0a0797-1049-45eb-958c-d928c28079dd None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:04.581031 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 191/380] 10.222.0.36 () {56 vars in 1376 bytes} [Tue Jun 14 17:37:04 2022] GET /identity/v3/role_assignments?group.id=91477abed46a4412a3c967a5aeb0417a&scope.project.id=f37a5c2ee2664dafb5a29dda0a1fc6e2&role.id=1348580877d04014bfdec4d866b98a74 => generated 260 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:04.835415 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edb1a06-bf64-4d6e-8ba6-612fb4e74b6c None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:04.836420 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edb1a06-bf64-4d6e-8ba6-612fb4e74b6c None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:04.836928 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edb1a06-bf64-4d6e-8ba6-612fb4e74b6c None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:04.838952 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 190/381] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:37:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:37:04.845098 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b75215-1ce1-4146-b4c3-1e2879c2e860 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:04.845703 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b75215-1ce1-4146-b4c3-1e2879c2e860 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:04.846202 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b75215-1ce1-4146-b4c3-1e2879c2e860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:04.866467 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-d1b75215-1ce1-4146-b4c3-1e2879c2e860 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:37:04.868065 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-d1b75215-1ce1-4146-b4c3-1e2879c2e860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:37:04.959439 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 192/382] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:37:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:37:04.982708 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edb1a06-bf64-4d6e-8ba6-612fb4e74b6c None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:05.062437 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f595be-2f0e-42e9-a0e7-53622d0a0115 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:05.062783 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f595be-2f0e-42e9-a0e7-53622d0a0115 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:05.063056 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f595be-2f0e-42e9-a0e7-53622d0a0115 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:05.064742 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 193/383] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:37:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:37:05.070950 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e050ba2-dcc6-48d9-b198-31c8c9846393 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:05.071251 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e050ba2-dcc6-48d9-b198-31c8c9846393 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:05.071563 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e050ba2-dcc6-48d9-b198-31c8c9846393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:05.083491 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:05.104125 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-3e050ba2-dcc6-48d9-b198-31c8c9846393 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:37:05.105256 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-3e050ba2-dcc6-48d9-b198-31c8c9846393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:37:05.123183 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edb1a06-bf64-4d6e-8ba6-612fb4e74b6c None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:05.172023 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd2f209-18fd-44b5-bb31-017f895d275c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:05.173213 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd2f209-18fd-44b5-bb31-017f895d275c None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:05.177026 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd2f209-18fd-44b5-bb31-017f895d275c None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:05.177608 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd2f209-18fd-44b5-bb31-017f895d275c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:05.200994 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd2f209-18fd-44b5-bb31-017f895d275c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:37:05.209788 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-5dd2f209-18fd-44b5-bb31-017f895d275c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 14 17:37:05.209788 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:05.209788 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:05.209788 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:05.209788 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:05.209788 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:05.209788 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:05.209788 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:05.209788 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:05.209788 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:05.209788 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:05.209788 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:05.209788 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:37:05.209788 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:37:05.209788 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:37:05.209788 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:37:05.210703 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:37:05.210703 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:37:05.210703 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:37:05.210703 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:37:05.210703 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:05.210703 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:05.210703 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:05.210703 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:05.210703 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:05.210703 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:05.210703 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:05.210703 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:05.210703 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:05.210703 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:05.210703 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:05.210703 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:05.211517 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:05.211517 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:05.211517 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:05.211517 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:05.211517 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:37:05.211517 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:37:05.211517 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:37:05.211517 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:37:05.211517 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:37:05.211517 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:37:05.211517 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 14 17:37:05.211517 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:37:05.211517 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 191/384] 10.222.0.36 () {56 vars in 1114 bytes} [Tue Jun 14 17:37:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:37:05.224555 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd2f209-18fd-44b5-bb31-017f895d275c None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:05.240384 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 194/385] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:37:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:37:05.267916 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e050ba2-dcc6-48d9-b198-31c8c9846393 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:05.270859 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:05.358510 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd2f209-18fd-44b5-bb31-017f895d275c None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:05.388345 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:05.401323 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6524a7d9-2b0d-446c-86da-29ad43d4bb4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:05.402584 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6524a7d9-2b0d-446c-86da-29ad43d4bb4f None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:05.404227 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6524a7d9-2b0d-446c-86da-29ad43d4bb4f None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:05.404717 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6524a7d9-2b0d-446c-86da-29ad43d4bb4f None admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:05.405665 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6524a7d9-2b0d-446c-86da-29ad43d4bb4f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:05.406869 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6524a7d9-2b0d-446c-86da-29ad43d4bb4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:05.408513 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6524a7d9-2b0d-446c-86da-29ad43d4bb4f None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:05.433900 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 192/386] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 14 17:37:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:05.436295 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6524a7d9-2b0d-446c-86da-29ad43d4bb4f None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:05.529213 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e050ba2-dcc6-48d9-b198-31c8c9846393 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:05.556141 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6524a7d9-2b0d-446c-86da-29ad43d4bb4f None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:05.598147 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9021553-c4db-4fba-9623-6f74e04ea4b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:05.599558 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9021553-c4db-4fba-9623-6f74e04ea4b6 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:05.600840 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9021553-c4db-4fba-9623-6f74e04ea4b6 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:05.601920 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9021553-c4db-4fba-9623-6f74e04ea4b6 None admin] PATH_INFO: `/v3/groups/dcda01bd59bb4d09a5e63b76b41293b1` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:05.604124 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9021553-c4db-4fba-9623-6f74e04ea4b6 None admin] RBAC: Authorizing `identity:get_group(group_id=dcda01bd59bb4d09a5e63b76b41293b1)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:05.606194 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9021553-c4db-4fba-9623-6f74e04ea4b6 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:05.609414 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 193/387] 10.222.0.36 () {56 vars in 1180 bytes} [Tue Jun 14 17:37:05 2022] GET /identity/v3/groups/dcda01bd59bb4d09a5e63b76b41293b1 => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:37:05.616928 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9021553-c4db-4fba-9623-6f74e04ea4b6 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:05.618358 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971c9ac3-ae8b-4437-b193-0ed3828878b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:05.619434 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971c9ac3-ae8b-4437-b193-0ed3828878b5 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:05.619947 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971c9ac3-ae8b-4437-b193-0ed3828878b5 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:05.620605 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971c9ac3-ae8b-4437-b193-0ed3828878b5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:05.651447 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971c9ac3-ae8b-4437-b193-0ed3828878b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:37:05.664472 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-971c9ac3-ae8b-4437-b193-0ed3828878b5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 14 17:37:05.664472 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:05.664472 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:05.664472 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:05.664472 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:05.664472 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:05.664472 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:05.664472 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:05.664472 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:05.664472 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:05.664472 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:05.664472 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:05.664472 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:37:05.664472 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:37:05.664472 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:37:05.664472 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:37:05.665535 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:37:05.665535 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:37:05.665535 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:37:05.665535 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:37:05.665535 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:05.665535 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:05.665535 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:05.665535 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:05.665535 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:05.665535 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:05.665535 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:05.665535 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:05.665535 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:05.665535 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:05.665535 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:05.665535 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:05.666525 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:05.666525 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:05.666525 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:05.666525 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:05.666525 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:37:05.666525 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:37:05.666525 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:37:05.666525 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:37:05.666525 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:37:05.666525 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:37:05.666525 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 14 17:37:05.666525 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:37:05.675114 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 195/388] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 14 17:37:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 402 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 17:37:05.676747 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971c9ac3-ae8b-4437-b193-0ed3828878b5 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:05.775625 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:05.797402 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:05.844072 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9021553-c4db-4fba-9623-6f74e04ea4b6 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:05.854014 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971c9ac3-ae8b-4437-b193-0ed3828878b5 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:05.883683 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4766f6-a930-46ef-a05d-e3b3b018b3b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:05.884493 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4766f6-a930-46ef-a05d-e3b3b018b3b7 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:05.884886 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4766f6-a930-46ef-a05d-e3b3b018b3b7 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:05.885056 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4766f6-a930-46ef-a05d-e3b3b018b3b7 None admin] PATH_INFO: `/v3/projects/b2d7081316264626896ee5ec5050f5de` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:05.886484 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4766f6-a930-46ef-a05d-e3b3b018b3b7 None admin] RBAC: Authorizing `identity:get_project(project_id=b2d7081316264626896ee5ec5050f5de)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:05.888470 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4766f6-a930-46ef-a05d-e3b3b018b3b7 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:05.894240 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 194/389] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 14 17:37:05 2022] GET /identity/v3/projects/b2d7081316264626896ee5ec5050f5de => generated 298 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:05.894240 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e3a24f-9e41-476e-97a6-a79f7c29dd4c None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:05.894240 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e3a24f-9e41-476e-97a6-a79f7c29dd4c None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:05.894240 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e3a24f-9e41-476e-97a6-a79f7c29dd4c None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:05.894240 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 195/390] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:37:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:37:05.906249 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0ba603-83ea-428d-bb9d-9a6988640a79 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:05.906249 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0ba603-83ea-428d-bb9d-9a6988640a79 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:05.906249 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0ba603-83ea-428d-bb9d-9a6988640a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:05.912514 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b822a933-ac1e-4c7b-ac73-fdb5f80602f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:05.913514 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b822a933-ac1e-4c7b-ac73-fdb5f80602f0 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:05.914006 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b822a933-ac1e-4c7b-ac73-fdb5f80602f0 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:05.914461 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b822a933-ac1e-4c7b-ac73-fdb5f80602f0 None admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:05.915516 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b822a933-ac1e-4c7b-ac73-fdb5f80602f0 None admin] RBAC: Adding query filter params (name=member) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:05.916012 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b822a933-ac1e-4c7b-ac73-fdb5f80602f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:05.917604 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b822a933-ac1e-4c7b-ac73-fdb5f80602f0 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:05.926333 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-3f0ba603-83ea-428d-bb9d-9a6988640a79 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:37:05.927713 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-3f0ba603-83ea-428d-bb9d-9a6988640a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:37:05.928804 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 196/391] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Jun 14 17:37:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:37:05.929839 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b822a933-ac1e-4c7b-ac73-fdb5f80602f0 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:06.007333 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 196/392] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:37:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:37:06.007333 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0ba603-83ea-428d-bb9d-9a6988640a79 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:06.062837 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b822a933-ac1e-4c7b-ac73-fdb5f80602f0 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:06.081451 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:06.091744 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:06.104161 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bbe5ba-4639-469e-ae00-1428536807eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:06.105283 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bbe5ba-4639-469e-ae00-1428536807eb None admin] REQUEST_METHOD: `PUT` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:06.105866 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bbe5ba-4639-469e-ae00-1428536807eb None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:06.106369 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bbe5ba-4639-469e-ae00-1428536807eb None admin] PATH_INFO: `/v3/projects/b2d7081316264626896ee5ec5050f5de/groups/dcda01bd59bb4d09a5e63b76b41293b1/roles/e41c4e25dfdf4810aab2231cf98c98a9` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:06.109165 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bbe5ba-4639-469e-ae00-1428536807eb None admin] RBAC: Authorizing `identity:create_grant(project_id=b2d7081316264626896ee5ec5050f5de, group_id=dcda01bd59bb4d09a5e63b76b41293b1, role_id=e41c4e25dfdf4810aab2231cf98c98a9)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:06.110827 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bbe5ba-4639-469e-ae00-1428536807eb None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:06.134292 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0ba603-83ea-428d-bb9d-9a6988640a79 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:06.170465 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3657dd17-fe34-47a8-88de-3521e1ada2bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:06.171348 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3657dd17-fe34-47a8-88de-3521e1ada2bb None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:06.171640 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3657dd17-fe34-47a8-88de-3521e1ada2bb None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:06.171920 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3657dd17-fe34-47a8-88de-3521e1ada2bb None admin] PATH_INFO: `/v3/groups/dcda01bd59bb4d09a5e63b76b41293b1` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:06.173095 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3657dd17-fe34-47a8-88de-3521e1ada2bb None admin] RBAC: Authorizing `identity:get_group(group_id=dcda01bd59bb4d09a5e63b76b41293b1)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:06.174518 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3657dd17-fe34-47a8-88de-3521e1ada2bb None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:06.180526 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 197/393] 10.222.0.36 () {56 vars in 1180 bytes} [Tue Jun 14 17:37:06 2022] GET /identity/v3/groups/dcda01bd59bb4d09a5e63b76b41293b1 => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:06.180526 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3657dd17-fe34-47a8-88de-3521e1ada2bb None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:06.201173 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 197/394] 10.222.0.36 () {58 vars in 1442 bytes} [Tue Jun 14 17:37:05 2022] PUT /identity/v3/projects/b2d7081316264626896ee5ec5050f5de/groups/dcda01bd59bb4d09a5e63b76b41293b1/roles/e41c4e25dfdf4810aab2231cf98c98a9 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:37:06.202902 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bbe5ba-4639-469e-ae00-1428536807eb None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:06.397300 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bbe5ba-4639-469e-ae00-1428536807eb None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:06.406985 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3657dd17-fe34-47a8-88de-3521e1ada2bb None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:06.455466 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ebb005-4362-40d1-a232-226446f9a608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:06.456787 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ebb005-4362-40d1-a232-226446f9a608 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:06.458600 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ebb005-4362-40d1-a232-226446f9a608 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:06.459084 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ebb005-4362-40d1-a232-226446f9a608 None admin] PATH_INFO: `/v3/projects/b2d7081316264626896ee5ec5050f5de` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:06.461179 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ebb005-4362-40d1-a232-226446f9a608 None admin] RBAC: Authorizing `identity:get_project(project_id=b2d7081316264626896ee5ec5050f5de)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:06.462060 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:06.464288 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ebb005-4362-40d1-a232-226446f9a608 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:06.471323 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 198/395] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 14 17:37:06 2022] GET /identity/v3/projects/b2d7081316264626896ee5ec5050f5de => generated 298 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:06.474179 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ebb005-4362-40d1-a232-226446f9a608 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:06.481487 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631ef0b1-9fbc-4991-904c-b7a42be18326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:06.482299 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631ef0b1-9fbc-4991-904c-b7a42be18326 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:06.482636 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631ef0b1-9fbc-4991-904c-b7a42be18326 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:06.482921 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631ef0b1-9fbc-4991-904c-b7a42be18326 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:06.508740 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631ef0b1-9fbc-4991-904c-b7a42be18326 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:37:06.518398 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-631ef0b1-9fbc-4991-904c-b7a42be18326 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 14 17:37:06.518398 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:06.518398 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:06.518398 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:06.518398 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:06.518398 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:06.518398 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:06.518398 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:06.518398 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:06.518398 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:06.518398 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:06.518398 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:06.518398 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:37:06.518398 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:37:06.518398 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:37:06.518398 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:37:06.519693 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:37:06.519693 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:37:06.519693 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:37:06.519693 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:37:06.519693 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:06.519693 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:06.519693 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:06.519693 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:06.519693 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:06.519693 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:06.519693 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:06.519693 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:06.519693 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:06.519693 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:06.519693 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:06.519693 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:06.521041 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:06.521041 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:06.521041 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:06.521041 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:06.521041 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:37:06.521041 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:37:06.521041 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:37:06.521041 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:37:06.521041 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:37:06.521041 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:37:06.521041 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 14 17:37:06.521041 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:37:06.521041 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 198/396] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 14 17:37:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:37:06.525367 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631ef0b1-9fbc-4991-904c-b7a42be18326 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:06.556140 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:06.622000 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ebb005-4362-40d1-a232-226446f9a608 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:06.697364 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631ef0b1-9fbc-4991-904c-b7a42be18326 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:06.710342 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca929b3-0a0f-4095-8cf1-b35186e84701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:06.711662 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca929b3-0a0f-4095-8cf1-b35186e84701 None admin] REQUEST_METHOD: `PUT` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:06.712340 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca929b3-0a0f-4095-8cf1-b35186e84701 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:06.712822 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca929b3-0a0f-4095-8cf1-b35186e84701 None admin] PATH_INFO: `/v3/projects/b2d7081316264626896ee5ec5050f5de/groups/dcda01bd59bb4d09a5e63b76b41293b1/roles/9ee80134743f4c2b88525b04df2facba` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:06.724968 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca929b3-0a0f-4095-8cf1-b35186e84701 None admin] RBAC: Authorizing `identity:create_grant(project_id=b2d7081316264626896ee5ec5050f5de, group_id=dcda01bd59bb4d09a5e63b76b41293b1, role_id=9ee80134743f4c2b88525b04df2facba)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:06.725969 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca929b3-0a0f-4095-8cf1-b35186e84701 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:06.762783 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e869b65c-ee36-4596-8470-b7853d543da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:06.764097 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e869b65c-ee36-4596-8470-b7853d543da7 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:06.764618 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e869b65c-ee36-4596-8470-b7853d543da7 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:06.765402 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e869b65c-ee36-4596-8470-b7853d543da7 None admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:06.766471 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e869b65c-ee36-4596-8470-b7853d543da7 None admin] RBAC: Adding query filter params (name=member) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:06.766989 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e869b65c-ee36-4596-8470-b7853d543da7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:06.768901 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e869b65c-ee36-4596-8470-b7853d543da7 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:06.789801 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 199/397] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Jun 14 17:37:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:37:06.794929 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e869b65c-ee36-4596-8470-b7853d543da7 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:06.827860 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 199/398] 10.222.0.36 () {58 vars in 1442 bytes} [Tue Jun 14 17:37:06 2022] PUT /identity/v3/projects/b2d7081316264626896ee5ec5050f5de/groups/dcda01bd59bb4d09a5e63b76b41293b1/roles/9ee80134743f4c2b88525b04df2facba => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 17:37:06.827860 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ce8dbd-6c73-4126-a9aa-b806439b85db None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:06.827860 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ce8dbd-6c73-4126-a9aa-b806439b85db None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:06.827860 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ce8dbd-6c73-4126-a9aa-b806439b85db None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:06.829584 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 200/399] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:37:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:37:06.844889 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b61bf1-ef67-4f4d-bd3e-b20975c42ab4 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:06.845082 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b61bf1-ef67-4f4d-bd3e-b20975c42ab4 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:06.845328 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b61bf1-ef67-4f4d-bd3e-b20975c42ab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:06.874966 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:06.893179 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-c8b61bf1-ef67-4f4d-bd3e-b20975c42ab4 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:37:06.895227 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-c8b61bf1-ef67-4f4d-bd3e-b20975c42ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:37:07.001435 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e869b65c-ee36-4596-8470-b7853d543da7 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:07.045109 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 201/400] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:37:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 14 17:37:07.060761 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0b0434-8a06-43ad-b734-b08f8e95b5a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:07.061644 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0b0434-8a06-43ad-b734-b08f8e95b5a6 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:07.061933 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0b0434-8a06-43ad-b734-b08f8e95b5a6 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:07.062217 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0b0434-8a06-43ad-b734-b08f8e95b5a6 None admin] PATH_INFO: `/v3/groups/dcda01bd59bb4d09a5e63b76b41293b1` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:07.063529 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0b0434-8a06-43ad-b734-b08f8e95b5a6 None admin] RBAC: Authorizing `identity:get_group(group_id=dcda01bd59bb4d09a5e63b76b41293b1)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:07.065023 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0b0434-8a06-43ad-b734-b08f8e95b5a6 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:07.068291 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 200/401] 10.222.0.36 () {56 vars in 1180 bytes} [Tue Jun 14 17:37:06 2022] GET /identity/v3/groups/dcda01bd59bb4d09a5e63b76b41293b1 => generated 226 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:07.073550 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b61bf1-ef67-4f4d-bd3e-b20975c42ab4 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:07.085573 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0b0434-8a06-43ad-b734-b08f8e95b5a6 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:07.133920 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:07.205867 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b61bf1-ef67-4f4d-bd3e-b20975c42ab4 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:07.255225 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0b0434-8a06-43ad-b734-b08f8e95b5a6 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:07.285281 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68338866-99bf-4b33-b98f-04828a0ba56f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:07.286548 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68338866-99bf-4b33-b98f-04828a0ba56f None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:07.287224 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68338866-99bf-4b33-b98f-04828a0ba56f None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:07.287715 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:07.287942 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68338866-99bf-4b33-b98f-04828a0ba56f None admin] PATH_INFO: `/v3/projects/b16d781254d347058aede92d9bba41ee` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:07.289425 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68338866-99bf-4b33-b98f-04828a0ba56f None admin] RBAC: Authorizing `identity:get_project(project_id=b16d781254d347058aede92d9bba41ee)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:07.292557 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68338866-99bf-4b33-b98f-04828a0ba56f None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:07.294599 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 202/402] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 14 17:37:07 2022] GET /identity/v3/projects/b16d781254d347058aede92d9bba41ee => generated 302 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:37:07.302808 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c85dcc-c851-4e6a-85d3-73501af8cb11 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:07.303245 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c85dcc-c851-4e6a-85d3-73501af8cb11 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:07.303672 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c85dcc-c851-4e6a-85d3-73501af8cb11 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:07.309233 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 203/403] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:37:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:37:07.310868 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e66459d-3d5d-4292-8c26-5c12743ea994 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:07.311261 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e66459d-3d5d-4292-8c26-5c12743ea994 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:07.311755 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e66459d-3d5d-4292-8c26-5c12743ea994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:07.323524 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270688ad-e34e-4102-b68c-b9d4990aab3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:07.325167 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270688ad-e34e-4102-b68c-b9d4990aab3f None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:07.325580 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270688ad-e34e-4102-b68c-b9d4990aab3f None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:07.325959 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270688ad-e34e-4102-b68c-b9d4990aab3f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:07.331167 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-2e66459d-3d5d-4292-8c26-5c12743ea994 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:37:07.333470 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-2e66459d-3d5d-4292-8c26-5c12743ea994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:37:07.344967 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270688ad-e34e-4102-b68c-b9d4990aab3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:37:07.360629 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-270688ad-e34e-4102-b68c-b9d4990aab3f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 14 17:37:07.360629 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:07.360629 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:07.360629 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:07.360629 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:07.360629 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:07.360629 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:07.360629 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:07.360629 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:07.360629 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:07.360629 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:07.360629 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:07.360629 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:37:07.360629 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:37:07.360629 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:37:07.360629 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:37:07.361740 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:37:07.361740 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:37:07.361740 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:37:07.361740 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:37:07.361740 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:07.361740 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:07.361740 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:07.361740 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:07.361740 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:07.361740 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:07.361740 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:07.361740 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:07.361740 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:07.361740 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:07.361740 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:07.361740 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:07.362816 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:07.362816 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:07.362816 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:07.362816 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:07.362816 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:37:07.362816 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:37:07.362816 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:37:07.362816 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:37:07.362816 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:37:07.362816 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:37:07.362816 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 14 17:37:07.362816 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:37:07.366553 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 201/404] 10.222.0.36 () {56 vars in 1114 bytes} [Tue Jun 14 17:37:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:37:07.375000 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270688ad-e34e-4102-b68c-b9d4990aab3f None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:07.427430 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 204/405] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:37:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:37:07.428584 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e66459d-3d5d-4292-8c26-5c12743ea994 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:07.495628 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:07.522335 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270688ad-e34e-4102-b68c-b9d4990aab3f None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:07.569933 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e66459d-3d5d-4292-8c26-5c12743ea994 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:07.576515 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07b5ea6-d260-4e87-964b-b1de6841904b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:07.577627 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07b5ea6-d260-4e87-964b-b1de6841904b None admin] REQUEST_METHOD: `PUT` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:07.578061 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07b5ea6-d260-4e87-964b-b1de6841904b None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:07.578488 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07b5ea6-d260-4e87-964b-b1de6841904b None admin] PATH_INFO: `/v3/projects/b16d781254d347058aede92d9bba41ee/groups/dcda01bd59bb4d09a5e63b76b41293b1/roles/9ee80134743f4c2b88525b04df2facba` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:07.581094 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07b5ea6-d260-4e87-964b-b1de6841904b None admin] RBAC: Authorizing `identity:create_grant(project_id=b16d781254d347058aede92d9bba41ee, group_id=dcda01bd59bb4d09a5e63b76b41293b1, role_id=9ee80134743f4c2b88525b04df2facba)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:07.583485 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07b5ea6-d260-4e87-964b-b1de6841904b None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:07.610011 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5a7daa-4f8a-4328-bb77-cacbe1d45856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:07.610694 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a7daa-4f8a-4328-bb77-cacbe1d45856 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:07.611039 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a7daa-4f8a-4328-bb77-cacbe1d45856 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:07.611345 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a7daa-4f8a-4328-bb77-cacbe1d45856 None admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:07.612392 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5a7daa-4f8a-4328-bb77-cacbe1d45856 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:07.612939 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5a7daa-4f8a-4328-bb77-cacbe1d45856 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:07.614304 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5a7daa-4f8a-4328-bb77-cacbe1d45856 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:07.630292 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 205/406] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 14 17:37:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:07.630292 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5a7daa-4f8a-4328-bb77-cacbe1d45856 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:07.693839 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 202/407] 10.222.0.36 () {58 vars in 1442 bytes} [Tue Jun 14 17:37:07 2022] PUT /identity/v3/projects/b16d781254d347058aede92d9bba41ee/groups/dcda01bd59bb4d09a5e63b76b41293b1/roles/9ee80134743f4c2b88525b04df2facba => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:37:07.695116 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07b5ea6-d260-4e87-964b-b1de6841904b None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:07.758005 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:07.799504 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5a7daa-4f8a-4328-bb77-cacbe1d45856 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:07.810184 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:07.895906 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc1aa83-e026-4e20-ba2f-2a105006744a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:07.896732 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc1aa83-e026-4e20-ba2f-2a105006744a None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:07.897164 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc1aa83-e026-4e20-ba2f-2a105006744a None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:07.897452 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc1aa83-e026-4e20-ba2f-2a105006744a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:07.902016 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07b5ea6-d260-4e87-964b-b1de6841904b None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:07.924237 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc1aa83-e026-4e20-ba2f-2a105006744a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:37:07.933975 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-fcc1aa83-e026-4e20-ba2f-2a105006744a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 17:37:07.933975 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:07.933975 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:07.933975 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:07.933975 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:07.933975 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:07.933975 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:07.933975 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:07.933975 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:07.933975 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:07.933975 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:07.933975 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:07.933975 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:37:07.933975 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:37:07.933975 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:37:07.933975 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:37:07.935077 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:37:07.935077 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:37:07.935077 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:37:07.935077 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:37:07.935077 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:07.935077 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:07.935077 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:07.935077 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:07.935077 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:07.935077 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:07.935077 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:07.935077 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:07.935077 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:07.935077 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:07.935077 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:07.935077 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:07.936199 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:07.936199 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:07.936199 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:07.936199 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:07.936199 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:37:07.936199 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:37:07.936199 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:37:07.936199 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:37:07.936199 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:37:07.936199 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:37:07.936199 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 17:37:07.936199 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:37:07.936199 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 206/408] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jun 14 17:37:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:37:07.942077 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc1aa83-e026-4e20-ba2f-2a105006744a None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:07.954309 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af729972-1027-4c25-b232-77047502529b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:07.955277 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af729972-1027-4c25-b232-77047502529b None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:07.955701 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af729972-1027-4c25-b232-77047502529b None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:07.956056 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af729972-1027-4c25-b232-77047502529b None admin] PATH_INFO: `/v3/groups/dcda01bd59bb4d09a5e63b76b41293b1` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:07.958352 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af729972-1027-4c25-b232-77047502529b None admin] RBAC: Authorizing `identity:get_group(group_id=dcda01bd59bb4d09a5e63b76b41293b1)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:07.959960 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af729972-1027-4c25-b232-77047502529b None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:07.962207 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 203/409] 10.222.0.36 () {56 vars in 1180 bytes} [Tue Jun 14 17:37:07 2022] GET /identity/v3/groups/dcda01bd59bb4d09a5e63b76b41293b1 => generated 226 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:07.967386 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af729972-1027-4c25-b232-77047502529b None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:08.090357 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc1aa83-e026-4e20-ba2f-2a105006744a None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:08.108867 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af729972-1027-4c25-b232-77047502529b None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:08.111479 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:08.155990 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0e9355-1d1a-4865-9ef8-02ff0d967146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:08.157649 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0e9355-1d1a-4865-9ef8-02ff0d967146 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:08.157949 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0e9355-1d1a-4865-9ef8-02ff0d967146 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:08.158233 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0e9355-1d1a-4865-9ef8-02ff0d967146 None admin] PATH_INFO: `/v3/projects/b16d781254d347058aede92d9bba41ee` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:08.160426 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0e9355-1d1a-4865-9ef8-02ff0d967146 None admin] RBAC: Authorizing `identity:get_project(project_id=b16d781254d347058aede92d9bba41ee)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:08.162412 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0e9355-1d1a-4865-9ef8-02ff0d967146 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:08.165285 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 204/410] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 14 17:37:07 2022] GET /identity/v3/projects/b16d781254d347058aede92d9bba41ee => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:37:08.170688 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0e9355-1d1a-4865-9ef8-02ff0d967146 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:08.176351 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722ae5f8-aa59-48aa-b1c8-a7c4d756a26e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:08.177060 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722ae5f8-aa59-48aa-b1c8-a7c4d756a26e None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:08.177345 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722ae5f8-aa59-48aa-b1c8-a7c4d756a26e None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:08.177624 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722ae5f8-aa59-48aa-b1c8-a7c4d756a26e None admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:08.178413 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722ae5f8-aa59-48aa-b1c8-a7c4d756a26e None admin] RBAC: Adding query filter params (name=admin) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:08.178728 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722ae5f8-aa59-48aa-b1c8-a7c4d756a26e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:08.180275 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722ae5f8-aa59-48aa-b1c8-a7c4d756a26e None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:08.204241 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 207/411] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 14 17:37:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:08.209954 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722ae5f8-aa59-48aa-b1c8-a7c4d756a26e None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:08.277749 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:08.313025 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0e9355-1d1a-4865-9ef8-02ff0d967146 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:08.359546 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8613f1-7b15-497e-8d0d-363d8f22ef31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:08.360711 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8613f1-7b15-497e-8d0d-363d8f22ef31 None admin] REQUEST_METHOD: `PUT` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:08.360996 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8613f1-7b15-497e-8d0d-363d8f22ef31 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:08.361278 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8613f1-7b15-497e-8d0d-363d8f22ef31 None admin] PATH_INFO: `/v3/projects/b16d781254d347058aede92d9bba41ee/groups/dcda01bd59bb4d09a5e63b76b41293b1/roles/e41c4e25dfdf4810aab2231cf98c98a9` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:08.365764 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8613f1-7b15-497e-8d0d-363d8f22ef31 None admin] RBAC: Authorizing `identity:create_grant(project_id=b16d781254d347058aede92d9bba41ee, group_id=dcda01bd59bb4d09a5e63b76b41293b1, role_id=e41c4e25dfdf4810aab2231cf98c98a9)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:08.367368 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8613f1-7b15-497e-8d0d-363d8f22ef31 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:08.408475 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722ae5f8-aa59-48aa-b1c8-a7c4d756a26e None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:08.422335 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 205/412] 10.222.0.36 () {58 vars in 1442 bytes} [Tue Jun 14 17:37:08 2022] PUT /identity/v3/projects/b16d781254d347058aede92d9bba41ee/groups/dcda01bd59bb4d09a5e63b76b41293b1/roles/e41c4e25dfdf4810aab2231cf98c98a9 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:37:08.457481 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0d796a-8bcc-4fff-a9e7-a71bf62f1874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:08.458434 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0d796a-8bcc-4fff-a9e7-a71bf62f1874 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:08.458775 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0d796a-8bcc-4fff-a9e7-a71bf62f1874 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:08.459056 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0d796a-8bcc-4fff-a9e7-a71bf62f1874 None admin] PATH_INFO: `/v3/groups/91477abed46a4412a3c967a5aeb0417a` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:08.460496 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0d796a-8bcc-4fff-a9e7-a71bf62f1874 None admin] RBAC: Authorizing `identity:get_group(group_id=91477abed46a4412a3c967a5aeb0417a)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:08.461972 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0d796a-8bcc-4fff-a9e7-a71bf62f1874 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:08.463896 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 208/413] 10.222.0.36 () {56 vars in 1180 bytes} [Tue Jun 14 17:37:08 2022] GET /identity/v3/groups/91477abed46a4412a3c967a5aeb0417a => generated 229 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:08.469743 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8613f1-7b15-497e-8d0d-363d8f22ef31 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:08.509725 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:08.608458 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8613f1-7b15-497e-8d0d-363d8f22ef31 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:08.647648 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805475d1-13d4-46ea-bd27-227c9a92e06a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:08.648438 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805475d1-13d4-46ea-bd27-227c9a92e06a None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:08.648725 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805475d1-13d4-46ea-bd27-227c9a92e06a None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:08.649002 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805475d1-13d4-46ea-bd27-227c9a92e06a None admin] PATH_INFO: `/v3/projects/f37a5c2ee2664dafb5a29dda0a1fc6e2` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:08.650214 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805475d1-13d4-46ea-bd27-227c9a92e06a None admin] RBAC: Authorizing `identity:get_project(project_id=f37a5c2ee2664dafb5a29dda0a1fc6e2)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:08.651687 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805475d1-13d4-46ea-bd27-227c9a92e06a None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:08.653399 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 206/414] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 14 17:37:08 2022] GET /identity/v3/projects/f37a5c2ee2664dafb5a29dda0a1fc6e2 => generated 344 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:08.659455 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0d796a-8bcc-4fff-a9e7-a71bf62f1874 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:08.767596 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:08.778107 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0d796a-8bcc-4fff-a9e7-a71bf62f1874 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:08.814375 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e75931-3c0d-47f9-8852-4179ec1741e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:08.815273 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e75931-3c0d-47f9-8852-4179ec1741e0 None admin] REQUEST_METHOD: `PUT` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:08.815599 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e75931-3c0d-47f9-8852-4179ec1741e0 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:08.816501 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e75931-3c0d-47f9-8852-4179ec1741e0 None admin] PATH_INFO: `/v3/projects/f37a5c2ee2664dafb5a29dda0a1fc6e2/groups/91477abed46a4412a3c967a5aeb0417a/roles/1348580877d04014bfdec4d866b98a74` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:08.818769 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e75931-3c0d-47f9-8852-4179ec1741e0 None admin] RBAC: Authorizing `identity:create_grant(project_id=f37a5c2ee2664dafb5a29dda0a1fc6e2, group_id=91477abed46a4412a3c967a5aeb0417a, role_id=1348580877d04014bfdec4d866b98a74)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:08.820431 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e75931-3c0d-47f9-8852-4179ec1741e0 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:08.892881 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 209/415] 10.222.0.36 () {58 vars in 1442 bytes} [Tue Jun 14 17:37:08 2022] PUT /identity/v3/projects/f37a5c2ee2664dafb5a29dda0a1fc6e2/groups/91477abed46a4412a3c967a5aeb0417a/roles/1348580877d04014bfdec4d866b98a74 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:37:09.070567 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6f73c9-50e5-49cb-9288-f047c642cee6 None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:09.071639 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6f73c9-50e5-49cb-9288-f047c642cee6 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:09.072159 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6f73c9-50e5-49cb-9288-f047c642cee6 None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:09.074172 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 207/416] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:37:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:37:09.080231 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b5da45-ad32-44a4-8db5-1a1068d89882 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:09.080780 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b5da45-ad32-44a4-8db5-1a1068d89882 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:09.081229 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b5da45-ad32-44a4-8db5-1a1068d89882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:09.100562 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-b9b5da45-ad32-44a4-8db5-1a1068d89882 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:37:09.102119 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-b9b5da45-ad32-44a4-8db5-1a1068d89882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:37:09.183003 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 210/417] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:37:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:37:09.225543 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6f73c9-50e5-49cb-9288-f047c642cee6 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:09.359607 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:09.365131 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6f73c9-50e5-49cb-9288-f047c642cee6 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:09.408468 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82e8fb0-ecbe-42cd-91ff-cac0f0a2605b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:09.409293 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82e8fb0-ecbe-42cd-91ff-cac0f0a2605b None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:09.409668 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82e8fb0-ecbe-42cd-91ff-cac0f0a2605b None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:09.410058 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82e8fb0-ecbe-42cd-91ff-cac0f0a2605b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:09.429228 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82e8fb0-ecbe-42cd-91ff-cac0f0a2605b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:37:09.437465 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-d82e8fb0-ecbe-42cd-91ff-cac0f0a2605b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 14 17:37:09.437465 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:09.437465 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:09.437465 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:09.437465 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:09.437465 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:09.437465 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:09.437465 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:09.437465 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:09.437465 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:09.437465 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:09.437465 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:09.437465 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:37:09.437465 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:37:09.437465 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:37:09.437465 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:37:09.438343 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:37:09.438343 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:37:09.438343 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:37:09.438343 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:37:09.438343 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:09.438343 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:09.438343 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:09.438343 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:09.438343 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:09.438343 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:09.438343 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:09.438343 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:09.438343 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:09.438343 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:09.438343 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:09.438343 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:09.439164 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:09.439164 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:09.439164 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:09.439164 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:09.439164 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:37:09.439164 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:37:09.439164 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:37:09.439164 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:37:09.439164 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:37:09.439164 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:37:09.439164 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 14 17:37:09.439164 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:37:09.443410 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 208/418] 10.222.0.36 () {56 vars in 1114 bytes} [Tue Jun 14 17:37:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:37:09.445606 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b5da45-ad32-44a4-8db5-1a1068d89882 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:09.563134 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ae5cb8-8e05-4896-b76b-9e4b7da5853e None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:09.563461 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ae5cb8-8e05-4896-b76b-9e4b7da5853e None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:09.563750 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ae5cb8-8e05-4896-b76b-9e4b7da5853e None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:09.565115 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 209/419] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:37:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 14 17:37:09.571253 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a211934-64d2-4abf-82d1-4438d16ca01e None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:09.571577 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a211934-64d2-4abf-82d1-4438d16ca01e None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:09.571865 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a211934-64d2-4abf-82d1-4438d16ca01e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:09.603923 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-6a211934-64d2-4abf-82d1-4438d16ca01e None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:37:09.606462 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-6a211934-64d2-4abf-82d1-4438d16ca01e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:37:09.613485 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:09.651953 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b5da45-ad32-44a4-8db5-1a1068d89882 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:09.725431 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaf4408-f3c3-4877-832c-23cf69887c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:09.726059 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaf4408-f3c3-4877-832c-23cf69887c40 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:09.728228 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaf4408-f3c3-4877-832c-23cf69887c40 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:09.728523 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaf4408-f3c3-4877-832c-23cf69887c40 None admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:09.729290 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaf4408-f3c3-4877-832c-23cf69887c40 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:09.729605 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaf4408-f3c3-4877-832c-23cf69887c40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:09.730991 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaf4408-f3c3-4877-832c-23cf69887c40 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:09.747022 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 210/420] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:37:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 14 17:37:09.749761 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 211/421] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 14 17:37:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:09.756023 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a211934-64d2-4abf-82d1-4438d16ca01e None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:09.803144 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaf4408-f3c3-4877-832c-23cf69887c40 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:09.914030 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:09.939448 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a211934-64d2-4abf-82d1-4438d16ca01e None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:09.992295 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaf4408-f3c3-4877-832c-23cf69887c40 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:10.006903 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c8bdc5-892c-4d3c-8c04-0aea9c98bc4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:10.007612 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c8bdc5-892c-4d3c-8c04-0aea9c98bc4e None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:10.007900 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c8bdc5-892c-4d3c-8c04-0aea9c98bc4e None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:10.008182 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c8bdc5-892c-4d3c-8c04-0aea9c98bc4e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:10.091592 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c8bdc5-892c-4d3c-8c04-0aea9c98bc4e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:10.093077 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c8bdc5-892c-4d3c-8c04-0aea9c98bc4e None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:10.101448 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4d7207-fcaa-4d15-888e-499f755189d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:10.102275 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4d7207-fcaa-4d15-888e-499f755189d3 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:10.102562 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4d7207-fcaa-4d15-888e-499f755189d3 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:10.102843 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4d7207-fcaa-4d15-888e-499f755189d3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:10.144095 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4d7207-fcaa-4d15-888e-499f755189d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:37:10.152138 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-5d4d7207-fcaa-4d15-888e-499f755189d3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 14 17:37:10.152138 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:10.152138 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:10.152138 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:10.152138 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:10.152138 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:10.152138 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:10.152138 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:10.152138 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:10.152138 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:10.152138 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:10.152138 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:10.152138 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:37:10.152138 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:37:10.152138 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:37:10.152138 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:37:10.159198 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:37:10.159198 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:37:10.159198 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:37:10.159198 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:37:10.159198 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:10.159198 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:10.159198 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:10.159198 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:10.159198 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:10.159198 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:10.159198 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:10.159198 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:10.159198 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:10.159198 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:10.159198 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:10.159198 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:10.160222 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:10.160222 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:10.160222 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:10.160222 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:10.160222 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:37:10.160222 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:37:10.160222 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:37:10.160222 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:37:10.160222 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:37:10.160222 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:37:10.160222 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 14 17:37:10.160222 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:37:10.160222 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 212/422] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 14 17:37:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 17:37:10.166407 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4d7207-fcaa-4d15-888e-499f755189d3 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:10.176469 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:10.203945 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:10.226883 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 211/423] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 14 17:37:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 14 17:37:10.232548 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c8bdc5-892c-4d3c-8c04-0aea9c98bc4e None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:10.374753 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4d7207-fcaa-4d15-888e-499f755189d3 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:10.429195 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75faeba1-0387-4eb5-ac4f-1a9a2f6a2ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:10.429882 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75faeba1-0387-4eb5-ac4f-1a9a2f6a2ab0 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:10.430170 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75faeba1-0387-4eb5-ac4f-1a9a2f6a2ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:10.430453 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75faeba1-0387-4eb5-ac4f-1a9a2f6a2ab0 None admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:10.431217 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75faeba1-0387-4eb5-ac4f-1a9a2f6a2ab0 None admin] RBAC: Adding query filter params (name=member) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:10.431584 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75faeba1-0387-4eb5-ac4f-1a9a2f6a2ab0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:10.432975 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75faeba1-0387-4eb5-ac4f-1a9a2f6a2ab0 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:10.454862 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 213/424] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Jun 14 17:37:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:37:10.455512 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c8bdc5-892c-4d3c-8c04-0aea9c98bc4e None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:10.458245 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75faeba1-0387-4eb5-ac4f-1a9a2f6a2ab0 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:10.512461 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e94f39-fd64-4827-8f33-ab7ad7bb63c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:10.513347 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e94f39-fd64-4827-8f33-ab7ad7bb63c9 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:10.513631 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e94f39-fd64-4827-8f33-ab7ad7bb63c9 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:10.513931 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e94f39-fd64-4827-8f33-ab7ad7bb63c9 None admin] PATH_INFO: `/v3/projects/b2d7081316264626896ee5ec5050f5de` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:10.518247 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e94f39-fd64-4827-8f33-ab7ad7bb63c9 None admin] RBAC: Authorizing `identity:get_project(project_id=b2d7081316264626896ee5ec5050f5de)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:10.519944 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e94f39-fd64-4827-8f33-ab7ad7bb63c9 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:10.527185 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 212/425] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 14 17:37:10 2022] GET /identity/v3/projects/b2d7081316264626896ee5ec5050f5de => generated 298 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:10.528067 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e94f39-fd64-4827-8f33-ab7ad7bb63c9 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:10.577585 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:10.595781 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:10.615202 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75faeba1-0387-4eb5-ac4f-1a9a2f6a2ab0 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:10.643400 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e94f39-fd64-4827-8f33-ab7ad7bb63c9 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:10.651784 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acf117a-4195-4d6c-8f2b-664aad6b21a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:10.652453 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acf117a-4195-4d6c-8f2b-664aad6b21a8 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:10.652744 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acf117a-4195-4d6c-8f2b-664aad6b21a8 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:10.653028 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acf117a-4195-4d6c-8f2b-664aad6b21a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:10.682856 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73769b7-74c0-482f-be5b-9ade6bc25a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:10.684724 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73769b7-74c0-482f-be5b-9ade6bc25a55 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:10.685199 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73769b7-74c0-482f-be5b-9ade6bc25a55 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:10.685870 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73769b7-74c0-482f-be5b-9ade6bc25a55 None admin] PATH_INFO: `/v3/groups/dcda01bd59bb4d09a5e63b76b41293b1` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:10.687901 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73769b7-74c0-482f-be5b-9ade6bc25a55 None admin] RBAC: Authorizing `identity:get_group(group_id=dcda01bd59bb4d09a5e63b76b41293b1)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:10.689801 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73769b7-74c0-482f-be5b-9ade6bc25a55 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:10.693416 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 213/426] 10.222.0.36 () {56 vars in 1180 bytes} [Tue Jun 14 17:37:10 2022] GET /identity/v3/groups/dcda01bd59bb4d09a5e63b76b41293b1 => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:10.695097 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7947a796-3e42-43a7-8ade-99386f19040e None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:10.695562 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7947a796-3e42-43a7-8ade-99386f19040e None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:10.695989 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7947a796-3e42-43a7-8ade-99386f19040e None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:10.698419 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 214/427] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:37:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:37:10.699330 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7947a796-3e42-43a7-8ade-99386f19040e None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:10.735649 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acf117a-4195-4d6c-8f2b-664aad6b21a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:10.737212 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acf117a-4195-4d6c-8f2b-664aad6b21a8 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:10.846415 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:10.852103 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7947a796-3e42-43a7-8ade-99386f19040e None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:10.908421 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:10.911808 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7622850c-2e31-4e73-bf92-f31c049a3e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:10.912940 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7622850c-2e31-4e73-bf92-f31c049a3e69 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:10.913534 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7622850c-2e31-4e73-bf92-f31c049a3e69 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:10.914001 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7622850c-2e31-4e73-bf92-f31c049a3e69 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:10.915022 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7622850c-2e31-4e73-bf92-f31c049a3e69 None admin] RBAC: Adding query filter params (group.id=dcda01bd59bb4d09a5e63b76b41293b1, role.id=e41c4e25dfdf4810aab2231cf98c98a9, scope.project.id=b2d7081316264626896ee5ec5050f5de) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:10.915605 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7622850c-2e31-4e73-bf92-f31c049a3e69 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:10.918217 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7622850c-2e31-4e73-bf92-f31c049a3e69 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:10.928098 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 215/428] 10.222.0.36 () {56 vars in 1376 bytes} [Tue Jun 14 17:37:10 2022] GET /identity/v3/role_assignments?group.id=dcda01bd59bb4d09a5e63b76b41293b1&scope.project.id=b2d7081316264626896ee5ec5050f5de&role.id=e41c4e25dfdf4810aab2231cf98c98a9 => generated 611 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:10.929311 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 214/429] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 14 17:37:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 14 17:37:10.930305 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e52fb8f-9dde-4178-a243-7e077b29e875 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:10.930837 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e52fb8f-9dde-4178-a243-7e077b29e875 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:10.931351 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e52fb8f-9dde-4178-a243-7e077b29e875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:10.938830 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acf117a-4195-4d6c-8f2b-664aad6b21a8 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:10.951269 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-5e52fb8f-9dde-4178-a243-7e077b29e875 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:37:10.953072 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-5e52fb8f-9dde-4178-a243-7e077b29e875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:37:11.138865 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 216/430] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:37:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:37:11.167586 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e52fb8f-9dde-4178-a243-7e077b29e875 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:11.245369 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acf117a-4195-4d6c-8f2b-664aad6b21a8 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:11.292825 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f72b31-658c-4c13-94b8-9a4057e7c11f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:11.294552 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f72b31-658c-4c13-94b8-9a4057e7c11f None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:11.295233 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f72b31-658c-4c13-94b8-9a4057e7c11f None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:11.295930 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f72b31-658c-4c13-94b8-9a4057e7c11f None admin] PATH_INFO: `/v3/projects/b2d7081316264626896ee5ec5050f5de` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:11.298115 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f72b31-658c-4c13-94b8-9a4057e7c11f None admin] RBAC: Authorizing `identity:get_project(project_id=b2d7081316264626896ee5ec5050f5de)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:11.301388 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f72b31-658c-4c13-94b8-9a4057e7c11f None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:11.304603 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 215/431] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 14 17:37:10 2022] GET /identity/v3/projects/b2d7081316264626896ee5ec5050f5de => generated 298 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:11.306986 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c9abad-22d0-418e-a2d4-83de3fff26a6 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:11.307782 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c9abad-22d0-418e-a2d4-83de3fff26a6 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:11.308879 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c9abad-22d0-418e-a2d4-83de3fff26a6 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:11.311868 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 216/432] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:37:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:37:11.319349 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c9abad-22d0-418e-a2d4-83de3fff26a6 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:11.339497 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e52fb8f-9dde-4178-a243-7e077b29e875 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:11.365633 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:11.390160 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edabb91-c31f-479c-a6fb-d7a78908b5ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:11.390375 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:11.390945 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edabb91-c31f-479c-a6fb-d7a78908b5ba None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:11.391822 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edabb91-c31f-479c-a6fb-d7a78908b5ba None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:11.392526 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edabb91-c31f-479c-a6fb-d7a78908b5ba None admin] PATH_INFO: `/v3/roles/member` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:11.408525 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edabb91-c31f-479c-a6fb-d7a78908b5ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:37:11.418957 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-5edabb91-c31f-479c-a6fb-d7a78908b5ba None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 14 17:37:11.418957 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:11.418957 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:11.418957 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:11.418957 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:11.418957 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:11.418957 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:11.418957 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:11.418957 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:11.418957 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:11.418957 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:11.418957 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:11.418957 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:37:11.418957 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:37:11.418957 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:37:11.418957 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:37:11.419882 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:37:11.419882 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:37:11.419882 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:37:11.419882 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:37:11.419882 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:11.419882 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:11.419882 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:11.419882 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:11.419882 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:11.419882 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:11.419882 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:11.419882 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:11.419882 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:11.419882 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:11.419882 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:11.419882 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:11.421315 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:11.421315 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:11.421315 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:11.421315 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:11.421315 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:37:11.421315 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:37:11.421315 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:37:11.421315 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:37:11.421315 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:37:11.421315 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:37:11.421315 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 14 17:37:11.421315 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:37:11.421315 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 217/433] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 14 17:37:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 17:37:11.422138 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b505d29-d686-453a-a1b5-35d6f2f0948a None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:11.422138 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b505d29-d686-453a-a1b5-35d6f2f0948a None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:11.422138 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b505d29-d686-453a-a1b5-35d6f2f0948a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:11.446710 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-8b505d29-d686-453a-a1b5-35d6f2f0948a None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:37:11.447962 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-8b505d29-d686-453a-a1b5-35d6f2f0948a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:37:11.490974 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c9abad-22d0-418e-a2d4-83de3fff26a6 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:11.516825 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 218/434] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:37:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:37:11.517757 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b505d29-d686-453a-a1b5-35d6f2f0948a None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:11.534184 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f999ca6f-1c52-4feb-8fd8-f4cfe4f7d0d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:11.535821 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f999ca6f-1c52-4feb-8fd8-f4cfe4f7d0d7 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:11.536108 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f999ca6f-1c52-4feb-8fd8-f4cfe4f7d0d7 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:11.536388 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f999ca6f-1c52-4feb-8fd8-f4cfe4f7d0d7 None admin] PATH_INFO: `/v3/groups/dcda01bd59bb4d09a5e63b76b41293b1` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:11.537652 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f999ca6f-1c52-4feb-8fd8-f4cfe4f7d0d7 None admin] RBAC: Authorizing `identity:get_group(group_id=dcda01bd59bb4d09a5e63b76b41293b1)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:11.539095 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f999ca6f-1c52-4feb-8fd8-f4cfe4f7d0d7 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:11.541143 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 217/435] 10.222.0.36 () {56 vars in 1180 bytes} [Tue Jun 14 17:37:11 2022] GET /identity/v3/groups/dcda01bd59bb4d09a5e63b76b41293b1 => generated 226 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:11.542729 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e8da35-e350-4d6a-a2b6-49c8cc976ca3 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:11.543014 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e8da35-e350-4d6a-a2b6-49c8cc976ca3 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:11.543292 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e8da35-e350-4d6a-a2b6-49c8cc976ca3 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:11.544531 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 218/436] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:37:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:37:11.545220 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e8da35-e350-4d6a-a2b6-49c8cc976ca3 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:11.628591 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b505d29-d686-453a-a1b5-35d6f2f0948a None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:11.638356 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:11.649806 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e8da35-e350-4d6a-a2b6-49c8cc976ca3 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:11.651413 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:11.664921 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d75f51b-96c4-48e3-ac6b-5b3007f5a4d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:11.665625 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d75f51b-96c4-48e3-ac6b-5b3007f5a4d3 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:11.665915 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d75f51b-96c4-48e3-ac6b-5b3007f5a4d3 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:11.666199 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d75f51b-96c4-48e3-ac6b-5b3007f5a4d3 None admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:11.666949 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d75f51b-96c4-48e3-ac6b-5b3007f5a4d3 None admin] RBAC: Adding query filter params (name=member) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:11.667284 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d75f51b-96c4-48e3-ac6b-5b3007f5a4d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:11.668718 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d75f51b-96c4-48e3-ac6b-5b3007f5a4d3 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:11.676991 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 219/437] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Jun 14 17:37:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:11.677748 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d75f51b-96c4-48e3-ac6b-5b3007f5a4d3 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:11.684619 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7292a232-56ee-4cd4-91c9-f75c7b1b799c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:11.685435 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7292a232-56ee-4cd4-91c9-f75c7b1b799c None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:11.685722 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7292a232-56ee-4cd4-91c9-f75c7b1b799c None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:11.686004 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7292a232-56ee-4cd4-91c9-f75c7b1b799c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:11.696683 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7292a232-56ee-4cd4-91c9-f75c7b1b799c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:37:11.704734 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-7292a232-56ee-4cd4-91c9-f75c7b1b799c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 14 17:37:11.704734 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:11.704734 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:11.704734 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:11.704734 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:11.704734 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:11.704734 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:11.704734 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:11.704734 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:11.704734 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:11.704734 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:11.704734 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:11.704734 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:37:11.704734 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:37:11.704734 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:37:11.704734 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:37:11.705912 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:37:11.705912 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:37:11.705912 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:37:11.705912 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:37:11.705912 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:11.705912 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:11.705912 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:11.705912 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:11.705912 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:11.705912 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:11.705912 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:11.705912 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:11.705912 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:11.705912 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:11.705912 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:11.705912 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:11.712438 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:11.712438 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:11.712438 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:11.712438 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:11.712438 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:37:11.712438 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:37:11.712438 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:37:11.712438 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:37:11.712438 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:37:11.712438 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:37:11.712438 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 14 17:37:11.712438 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:37:11.712438 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 219/438] 10.222.0.36 () {56 vars in 1114 bytes} [Tue Jun 14 17:37:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:37:11.712438 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e9ab4b-a33a-4144-bea5-d47497e337a7 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:11.713161 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e9ab4b-a33a-4144-bea5-d47497e337a7 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:11.713161 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e9ab4b-a33a-4144-bea5-d47497e337a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:11.724838 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-53e9ab4b-a33a-4144-bea5-d47497e337a7 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:37:11.726116 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-53e9ab4b-a33a-4144-bea5-d47497e337a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:37:11.781253 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d75f51b-96c4-48e3-ac6b-5b3007f5a4d3 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:11.794680 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 220/439] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:37:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:37:11.795574 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e9ab4b-a33a-4144-bea5-d47497e337a7 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:11.817333 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa38edf-977b-436a-bd49-2bb288fd17de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:11.818068 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa38edf-977b-436a-bd49-2bb288fd17de None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:11.818386 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa38edf-977b-436a-bd49-2bb288fd17de None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:11.818668 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa38edf-977b-436a-bd49-2bb288fd17de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:11.820003 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa38edf-977b-436a-bd49-2bb288fd17de None admin] RBAC: Adding query filter params (group.id=dcda01bd59bb4d09a5e63b76b41293b1, role.id=9ee80134743f4c2b88525b04df2facba, scope.project.id=b2d7081316264626896ee5ec5050f5de) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:11.820324 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa38edf-977b-436a-bd49-2bb288fd17de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:11.821781 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa38edf-977b-436a-bd49-2bb288fd17de None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:11.828128 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 220/440] 10.222.0.36 () {56 vars in 1376 bytes} [Tue Jun 14 17:37:11 2022] GET /identity/v3/role_assignments?group.id=dcda01bd59bb4d09a5e63b76b41293b1&scope.project.id=b2d7081316264626896ee5ec5050f5de&role.id=9ee80134743f4c2b88525b04df2facba => generated 611 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:11.829250 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa38edf-977b-436a-bd49-2bb288fd17de None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:11.880354 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:11.909151 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:11.918527 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e9ab4b-a33a-4144-bea5-d47497e337a7 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:11.965168 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a5fe93-c680-4c6d-b986-d2065ab5af72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:11.965764 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a5fe93-c680-4c6d-b986-d2065ab5af72 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:11.966062 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a5fe93-c680-4c6d-b986-d2065ab5af72 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:11.966325 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a5fe93-c680-4c6d-b986-d2065ab5af72 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:11.969914 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa38edf-977b-436a-bd49-2bb288fd17de None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:12.012664 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b8b3a4-697d-473f-b264-0e3f903ce809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:12.013755 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b8b3a4-697d-473f-b264-0e3f903ce809 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:12.013755 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b8b3a4-697d-473f-b264-0e3f903ce809 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:12.013919 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b8b3a4-697d-473f-b264-0e3f903ce809 None admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:12.015425 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b8b3a4-697d-473f-b264-0e3f903ce809 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:12.015553 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b8b3a4-697d-473f-b264-0e3f903ce809 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:12.017251 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b8b3a4-697d-473f-b264-0e3f903ce809 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:12.029409 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 221/441] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 14 17:37:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:12.029409 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b8b3a4-697d-473f-b264-0e3f903ce809 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:12.055701 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a5fe93-c680-4c6d-b986-d2065ab5af72 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:12.057180 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a5fe93-c680-4c6d-b986-d2065ab5af72 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:12.145516 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:12.152407 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b8b3a4-697d-473f-b264-0e3f903ce809 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:12.169744 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:12.180472 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 221/442] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 14 17:37:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 14 17:37:12.181638 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a5fe93-c680-4c6d-b986-d2065ab5af72 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:12.207154 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778f2267-939b-4e48-9ad8-b924b9f753bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:12.208798 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778f2267-939b-4e48-9ad8-b924b9f753bc None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:12.209241 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778f2267-939b-4e48-9ad8-b924b9f753bc None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:12.209525 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778f2267-939b-4e48-9ad8-b924b9f753bc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:12.228003 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778f2267-939b-4e48-9ad8-b924b9f753bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:37:12.236601 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-778f2267-939b-4e48-9ad8-b924b9f753bc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 17:37:12.236601 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:12.236601 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:12.236601 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:12.236601 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:12.236601 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:12.236601 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:12.236601 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:12.236601 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:12.236601 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:12.236601 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:12.236601 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:12.236601 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:37:12.236601 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:37:12.236601 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:37:12.236601 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:37:12.238678 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:37:12.238678 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:37:12.238678 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:37:12.238678 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:37:12.238678 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:12.238678 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:12.238678 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:12.238678 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:12.238678 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:12.238678 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:12.238678 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:12.238678 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:12.238678 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:12.238678 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:12.238678 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:12.238678 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:12.239732 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:12.239732 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:12.239732 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:12.239732 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:12.239732 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:37:12.239732 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:37:12.239732 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:37:12.239732 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:37:12.239732 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:37:12.239732 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:37:12.239732 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 17:37:12.239732 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:37:12.239732 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 222/443] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jun 14 17:37:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:37:12.239732 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778f2267-939b-4e48-9ad8-b924b9f753bc None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:12.314715 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a5fe93-c680-4c6d-b986-d2065ab5af72 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:12.352037 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96ccdda-cb9e-4e8c-b5da-78e25cbbdde7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:12.353008 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96ccdda-cb9e-4e8c-b5da-78e25cbbdde7 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:12.353301 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96ccdda-cb9e-4e8c-b5da-78e25cbbdde7 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:12.353998 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96ccdda-cb9e-4e8c-b5da-78e25cbbdde7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:12.360948 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778f2267-939b-4e48-9ad8-b924b9f753bc None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:12.401221 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc5c541-db58-44c9-9d5c-a42d1dd12994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:12.402100 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc5c541-db58-44c9-9d5c-a42d1dd12994 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:12.402388 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc5c541-db58-44c9-9d5c-a42d1dd12994 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:12.402664 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc5c541-db58-44c9-9d5c-a42d1dd12994 None admin] PATH_INFO: `/v3/projects/b16d781254d347058aede92d9bba41ee` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:12.403888 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc5c541-db58-44c9-9d5c-a42d1dd12994 None admin] RBAC: Authorizing `identity:get_project(project_id=b16d781254d347058aede92d9bba41ee)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:12.405316 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc5c541-db58-44c9-9d5c-a42d1dd12994 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:12.407022 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 223/444] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 14 17:37:12 2022] GET /identity/v3/projects/b16d781254d347058aede92d9bba41ee => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:12.408530 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc5c541-db58-44c9-9d5c-a42d1dd12994 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:12.428276 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:12.435781 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:12.437709 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96ccdda-cb9e-4e8c-b5da-78e25cbbdde7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:12.442793 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96ccdda-cb9e-4e8c-b5da-78e25cbbdde7 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:12.511311 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc5c541-db58-44c9-9d5c-a42d1dd12994 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:12.539677 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 222/445] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 14 17:37:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 14 17:37:12.540516 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96ccdda-cb9e-4e8c-b5da-78e25cbbdde7 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:12.548256 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cee20d-3ab3-493c-8d03-d5aca31877a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:12.548928 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cee20d-3ab3-493c-8d03-d5aca31877a2 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:12.549213 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cee20d-3ab3-493c-8d03-d5aca31877a2 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:12.549494 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cee20d-3ab3-493c-8d03-d5aca31877a2 None admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:12.551455 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cee20d-3ab3-493c-8d03-d5aca31877a2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:12.551775 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cee20d-3ab3-493c-8d03-d5aca31877a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:12.553173 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cee20d-3ab3-493c-8d03-d5aca31877a2 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:12.561512 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 224/446] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 14 17:37:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:12.562299 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cee20d-3ab3-493c-8d03-d5aca31877a2 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:12.635328 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:12.643690 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96ccdda-cb9e-4e8c-b5da-78e25cbbdde7 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:12.648813 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:12.663809 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cee20d-3ab3-493c-8d03-d5aca31877a2 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:12.678920 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9284ffa6-353d-4418-9206-9cee102bc774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:12.679817 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9284ffa6-353d-4418-9206-9cee102bc774 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:12.680099 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9284ffa6-353d-4418-9206-9cee102bc774 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:12.680373 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9284ffa6-353d-4418-9206-9cee102bc774 None admin] PATH_INFO: `/v3/groups/dcda01bd59bb4d09a5e63b76b41293b1` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:12.681566 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9284ffa6-353d-4418-9206-9cee102bc774 None admin] RBAC: Authorizing `identity:get_group(group_id=dcda01bd59bb4d09a5e63b76b41293b1)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:12.683043 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9284ffa6-353d-4418-9206-9cee102bc774 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:12.684673 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 223/447] 10.222.0.36 () {56 vars in 1180 bytes} [Tue Jun 14 17:37:12 2022] GET /identity/v3/groups/dcda01bd59bb4d09a5e63b76b41293b1 => generated 226 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:12.685434 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9284ffa6-353d-4418-9206-9cee102bc774 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:12.699653 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170d8379-d9cf-49ac-9ae0-57939513628a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:12.700527 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170d8379-d9cf-49ac-9ae0-57939513628a None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:12.700819 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170d8379-d9cf-49ac-9ae0-57939513628a None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:12.701097 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170d8379-d9cf-49ac-9ae0-57939513628a None admin] PATH_INFO: `/v3/projects/b16d781254d347058aede92d9bba41ee` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:12.702291 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170d8379-d9cf-49ac-9ae0-57939513628a None admin] RBAC: Authorizing `identity:get_project(project_id=b16d781254d347058aede92d9bba41ee)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:12.703791 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170d8379-d9cf-49ac-9ae0-57939513628a None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:12.705513 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 225/448] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 14 17:37:12 2022] GET /identity/v3/projects/b16d781254d347058aede92d9bba41ee => generated 302 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:12.706338 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170d8379-d9cf-49ac-9ae0-57939513628a None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:12.789093 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9284ffa6-353d-4418-9206-9cee102bc774 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:12.809473 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170d8379-d9cf-49ac-9ae0-57939513628a None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:12.823554 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21a9f80-2674-4901-b258-5e6b25a8627a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:12.824213 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21a9f80-2674-4901-b258-5e6b25a8627a None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:12.824503 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21a9f80-2674-4901-b258-5e6b25a8627a None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:12.824789 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21a9f80-2674-4901-b258-5e6b25a8627a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:12.845027 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559d581b-f53d-4dd9-ab2a-e7ec463d0502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:12.845691 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559d581b-f53d-4dd9-ab2a-e7ec463d0502 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:12.845984 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559d581b-f53d-4dd9-ab2a-e7ec463d0502 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:12.846270 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559d581b-f53d-4dd9-ab2a-e7ec463d0502 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:12.847684 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559d581b-f53d-4dd9-ab2a-e7ec463d0502 None admin] RBAC: Adding query filter params (group.id=dcda01bd59bb4d09a5e63b76b41293b1, role.id=9ee80134743f4c2b88525b04df2facba, scope.project.id=b16d781254d347058aede92d9bba41ee) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:12.848006 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559d581b-f53d-4dd9-ab2a-e7ec463d0502 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:12.849497 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559d581b-f53d-4dd9-ab2a-e7ec463d0502 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:12.853055 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:12.855670 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 226/449] 10.222.0.36 () {56 vars in 1376 bytes} [Tue Jun 14 17:37:12 2022] GET /identity/v3/role_assignments?group.id=dcda01bd59bb4d09a5e63b76b41293b1&scope.project.id=b16d781254d347058aede92d9bba41ee&role.id=9ee80134743f4c2b88525b04df2facba => generated 611 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:12.856463 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559d581b-f53d-4dd9-ab2a-e7ec463d0502 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:12.887653 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:12.911406 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21a9f80-2674-4901-b258-5e6b25a8627a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:12.912908 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21a9f80-2674-4901-b258-5e6b25a8627a None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:12.987311 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559d581b-f53d-4dd9-ab2a-e7ec463d0502 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:13.027176 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 224/450] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 14 17:37:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 14 17:37:13.027978 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d898c685-4f3b-4973-9d30-518113ae0e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:13.028856 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d898c685-4f3b-4973-9d30-518113ae0e3a None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:13.029142 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d898c685-4f3b-4973-9d30-518113ae0e3a None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:13.029421 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d898c685-4f3b-4973-9d30-518113ae0e3a None admin] PATH_INFO: `/v3/groups/dcda01bd59bb4d09a5e63b76b41293b1` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:13.030613 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d898c685-4f3b-4973-9d30-518113ae0e3a None admin] RBAC: Authorizing `identity:get_group(group_id=dcda01bd59bb4d09a5e63b76b41293b1)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:13.032315 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d898c685-4f3b-4973-9d30-518113ae0e3a None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:13.032744 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21a9f80-2674-4901-b258-5e6b25a8627a None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:13.033972 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 227/451] 10.222.0.36 () {56 vars in 1180 bytes} [Tue Jun 14 17:37:12 2022] GET /identity/v3/groups/dcda01bd59bb4d09a5e63b76b41293b1 => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:13.040439 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d898c685-4f3b-4973-9d30-518113ae0e3a None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:13.106160 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:13.147593 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:13.158295 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21a9f80-2674-4901-b258-5e6b25a8627a None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:13.167183 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d898c685-4f3b-4973-9d30-518113ae0e3a None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:13.203766 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263e1395-ee1f-4964-9a13-fc2889a58799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:13.204695 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263e1395-ee1f-4964-9a13-fc2889a58799 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:13.204992 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263e1395-ee1f-4964-9a13-fc2889a58799 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:13.205256 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263e1395-ee1f-4964-9a13-fc2889a58799 None admin] PATH_INFO: `/v3/projects/f37a5c2ee2664dafb5a29dda0a1fc6e2` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:13.207335 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263e1395-ee1f-4964-9a13-fc2889a58799 None admin] RBAC: Authorizing `identity:get_project(project_id=f37a5c2ee2664dafb5a29dda0a1fc6e2)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:13.209146 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263e1395-ee1f-4964-9a13-fc2889a58799 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:13.211394 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 225/452] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 14 17:37:13 2022] GET /identity/v3/projects/f37a5c2ee2664dafb5a29dda0a1fc6e2 => generated 344 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:37:13.216358 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8197fa9e-8d00-44db-974d-28ffa42f6763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:13.217057 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8197fa9e-8d00-44db-974d-28ffa42f6763 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:13.217333 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8197fa9e-8d00-44db-974d-28ffa42f6763 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:13.217614 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8197fa9e-8d00-44db-974d-28ffa42f6763 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:13.218470 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8197fa9e-8d00-44db-974d-28ffa42f6763 None admin] RBAC: Adding query filter params (group.id=dcda01bd59bb4d09a5e63b76b41293b1, role.id=e41c4e25dfdf4810aab2231cf98c98a9, scope.project.id=b16d781254d347058aede92d9bba41ee) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:13.218788 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8197fa9e-8d00-44db-974d-28ffa42f6763 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:13.219084 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263e1395-ee1f-4964-9a13-fc2889a58799 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:13.220308 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8197fa9e-8d00-44db-974d-28ffa42f6763 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:13.227820 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 228/453] 10.222.0.36 () {56 vars in 1376 bytes} [Tue Jun 14 17:37:13 2022] GET /identity/v3/role_assignments?group.id=dcda01bd59bb4d09a5e63b76b41293b1&scope.project.id=b16d781254d347058aede92d9bba41ee&role.id=e41c4e25dfdf4810aab2231cf98c98a9 => generated 611 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:37:13.348899 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263e1395-ee1f-4964-9a13-fc2889a58799 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:13.380819 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:13.390131 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7a983d-7871-455c-9454-a0a4a2c79c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:13.392082 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7a983d-7871-455c-9454-a0a4a2c79c39 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:13.392082 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7a983d-7871-455c-9454-a0a4a2c79c39 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:13.392082 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7a983d-7871-455c-9454-a0a4a2c79c39 None admin] PATH_INFO: `/v3/groups/91477abed46a4412a3c967a5aeb0417a` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:13.393306 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7a983d-7871-455c-9454-a0a4a2c79c39 None admin] RBAC: Authorizing `identity:get_group(group_id=91477abed46a4412a3c967a5aeb0417a)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:13.395502 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7a983d-7871-455c-9454-a0a4a2c79c39 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:13.397415 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 226/454] 10.222.0.36 () {56 vars in 1180 bytes} [Tue Jun 14 17:37:13 2022] GET /identity/v3/groups/91477abed46a4412a3c967a5aeb0417a => generated 229 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:13.403872 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8197fa9e-8d00-44db-974d-28ffa42f6763 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:13.522520 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8197fa9e-8d00-44db-974d-28ffa42f6763 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:13.559834 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca71fd1f-f97a-4dea-b01e-7f492d3ee997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:13.560502 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca71fd1f-f97a-4dea-b01e-7f492d3ee997 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:13.560786 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca71fd1f-f97a-4dea-b01e-7f492d3ee997 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:13.561071 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca71fd1f-f97a-4dea-b01e-7f492d3ee997 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:13.561908 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca71fd1f-f97a-4dea-b01e-7f492d3ee997 None admin] RBAC: Adding query filter params (group.id=91477abed46a4412a3c967a5aeb0417a, role.id=1348580877d04014bfdec4d866b98a74, scope.project.id=f37a5c2ee2664dafb5a29dda0a1fc6e2) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:13.562220 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca71fd1f-f97a-4dea-b01e-7f492d3ee997 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:13.563698 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca71fd1f-f97a-4dea-b01e-7f492d3ee997 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:13.572516 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 229/455] 10.222.0.36 () {56 vars in 1376 bytes} [Tue Jun 14 17:37:13 2022] GET /identity/v3/role_assignments?group.id=91477abed46a4412a3c967a5aeb0417a&scope.project.id=f37a5c2ee2664dafb5a29dda0a1fc6e2&role.id=1348580877d04014bfdec4d866b98a74 => generated 611 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:16.343807 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa3a194-775d-44c6-b652-b5dd27d6aaa3 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:16.344363 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa3a194-775d-44c6-b652-b5dd27d6aaa3 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:16.344363 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa3a194-775d-44c6-b652-b5dd27d6aaa3 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:16.345991 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 227/456] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:37:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:37:16.352078 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3460fd8-5b65-45fc-abf5-b7aa972c3921 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:16.352546 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3460fd8-5b65-45fc-abf5-b7aa972c3921 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:16.352653 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3460fd8-5b65-45fc-abf5-b7aa972c3921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:16.376891 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-f3460fd8-5b65-45fc-abf5-b7aa972c3921 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:37:16.378507 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-f3460fd8-5b65-45fc-abf5-b7aa972c3921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:37:16.391991 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:16.481261 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 230/457] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:37:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:37:16.524944 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa3a194-775d-44c6-b652-b5dd27d6aaa3 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:16.563285 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8171f4-25f8-4d42-9801-d12ec624e8e3 None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:16.563620 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8171f4-25f8-4d42-9801-d12ec624e8e3 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:16.563872 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8171f4-25f8-4d42-9801-d12ec624e8e3 None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:16.565358 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 231/458] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:37:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 14 17:37:16.572131 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8427e1e-4661-43ce-9732-b870067275b7 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:16.572443 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8427e1e-4661-43ce-9732-b870067275b7 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:16.572674 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8427e1e-4661-43ce-9732-b870067275b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:16.600496 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-e8427e1e-4661-43ce-9732-b870067275b7 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:37:16.601623 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-e8427e1e-4661-43ce-9732-b870067275b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:37:16.707866 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 232/459] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:37:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 14 17:37:16.708249 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa3a194-775d-44c6-b652-b5dd27d6aaa3 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:16.735990 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8427e1e-4661-43ce-9732-b870067275b7 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:16.764896 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1f4259-7388-4358-8937-f09643e8ab35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:16.766044 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1f4259-7388-4358-8937-f09643e8ab35 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:16.766503 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1f4259-7388-4358-8937-f09643e8ab35 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:16.766975 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1f4259-7388-4358-8937-f09643e8ab35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:16.781785 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1f4259-7388-4358-8937-f09643e8ab35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:16.783578 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1f4259-7388-4358-8937-f09643e8ab35 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:16.809731 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-fd1f4259-7388-4358-8937-f09643e8ab35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:37:16.809731 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:16.809731 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:16.809731 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:16.809731 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:16.809731 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:16.809731 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:16.809731 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:16.809731 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:16.809731 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:16.809731 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:16.809731 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:16.809731 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:37:16.809731 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:37:16.809731 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:37:16.810642 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:37:16.810642 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:16.810642 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:16.810642 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:16.810642 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:16.810642 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:16.810642 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:16.810642 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:16.810642 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:16.810642 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:16.810642 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:16.810642 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:16.810642 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:16.810642 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:16.810642 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:16.810642 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:16.810642 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:16.811515 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:37:16.811515 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:37:16.811515 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:37:16.811515 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:37:16.814415 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 228/460] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 14 17:37:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:37:16.816568 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e191abf1-0980-42d0-9093-6b1991bd4fe4 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:16.817132 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e191abf1-0980-42d0-9093-6b1991bd4fe4 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:16.817570 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e191abf1-0980-42d0-9093-6b1991bd4fe4 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:16.819431 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 229/461] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:37:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:37:16.820537 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e191abf1-0980-42d0-9093-6b1991bd4fe4 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:16.844142 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:16.871583 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8427e1e-4661-43ce-9732-b870067275b7 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:16.885966 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:16.912741 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea7ec00-dbda-49fe-b8d9-6ffaea295551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:16.913665 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea7ec00-dbda-49fe-b8d9-6ffaea295551 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:16.914051 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea7ec00-dbda-49fe-b8d9-6ffaea295551 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:16.914429 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea7ec00-dbda-49fe-b8d9-6ffaea295551 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:16.925871 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea7ec00-dbda-49fe-b8d9-6ffaea295551 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:16.927716 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea7ec00-dbda-49fe-b8d9-6ffaea295551 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:16.946270 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-2ea7ec00-dbda-49fe-b8d9-6ffaea295551 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:37:16.946270 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:16.946270 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:16.946270 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:16.946270 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:16.946270 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:16.946270 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:16.946270 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:16.946270 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:16.946270 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:16.946270 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:16.946270 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:16.946270 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:37:16.946270 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:37:16.946270 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:37:16.947160 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:37:16.947160 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:16.947160 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:16.947160 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:16.947160 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:16.947160 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:16.947160 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:16.947160 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:16.947160 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:16.947160 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:16.947160 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:16.947160 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:16.947160 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:16.947160 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:16.947160 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:16.947160 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:16.947160 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:16.948261 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:37:16.948261 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:37:16.948261 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:37:16.948261 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:37:16.949503 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 233/462] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 14 17:37:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 17:37:16.950870 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5ebd8f-9b9d-493b-9a45-264045a1ec25 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:16.951229 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5ebd8f-9b9d-493b-9a45-264045a1ec25 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:16.951609 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5ebd8f-9b9d-493b-9a45-264045a1ec25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:16.961946 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e191abf1-0980-42d0-9093-6b1991bd4fe4 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:16.971195 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-1c5ebd8f-9b9d-493b-9a45-264045a1ec25 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:37:16.973465 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-1c5ebd8f-9b9d-493b-9a45-264045a1ec25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:37:16.999971 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2542c300-bb0b-4607-aacd-90ba888116eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:17.000652 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2542c300-bb0b-4607-aacd-90ba888116eb None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:17.000941 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2542c300-bb0b-4607-aacd-90ba888116eb None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:17.001228 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2542c300-bb0b-4607-aacd-90ba888116eb None admin] PATH_INFO: `/v3/domains` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:17.002005 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2542c300-bb0b-4607-aacd-90ba888116eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:17.002390 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2542c300-bb0b-4607-aacd-90ba888116eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:17.003975 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2542c300-bb0b-4607-aacd-90ba888116eb None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:17.024433 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 230/463] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 14 17:37:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:17.025119 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2542c300-bb0b-4607-aacd-90ba888116eb None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:17.047595 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 234/464] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:37:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:37:17.048701 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5ebd8f-9b9d-493b-9a45-264045a1ec25 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:17.114401 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:17.150554 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2542c300-bb0b-4607-aacd-90ba888116eb None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:17.162488 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:17.171286 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5ebd8f-9b9d-493b-9a45-264045a1ec25 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:17.193755 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b7c7e8-85aa-4496-8428-800dae3ffba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:17.194445 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b7c7e8-85aa-4496-8428-800dae3ffba2 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:17.194770 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b7c7e8-85aa-4496-8428-800dae3ffba2 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:17.195005 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b7c7e8-85aa-4496-8428-800dae3ffba2 None admin] PATH_INFO: `/v3/domains` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:17.195806 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b7c7e8-85aa-4496-8428-800dae3ffba2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:17.196120 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b7c7e8-85aa-4496-8428-800dae3ffba2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:17.197901 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b7c7e8-85aa-4496-8428-800dae3ffba2 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:17.211413 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 231/465] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 14 17:37:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:17.212273 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b7c7e8-85aa-4496-8428-800dae3ffba2 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:17.219282 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf2e7f8-175a-4fe6-9d25-99160112db14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:17.219993 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf2e7f8-175a-4fe6-9d25-99160112db14 None admin] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:17.220281 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf2e7f8-175a-4fe6-9d25-99160112db14 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:17.220556 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf2e7f8-175a-4fe6-9d25-99160112db14 None admin] PATH_INFO: `/v3/users` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:17.221259 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf2e7f8-175a-4fe6-9d25-99160112db14 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:17.223258 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf2e7f8-175a-4fe6-9d25-99160112db14 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:17.320547 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b7c7e8-85aa-4496-8428-800dae3ffba2 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:17.355735 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e767cf6-585d-40fb-94a0-d55c4fa8a49e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:17.356530 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e767cf6-585d-40fb-94a0-d55c4fa8a49e None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:17.356815 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e767cf6-585d-40fb-94a0-d55c4fa8a49e None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:17.357196 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e767cf6-585d-40fb-94a0-d55c4fa8a49e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:17.367360 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 235/466] 10.222.0.36 () {60 vars in 1132 bytes} [Tue Jun 14 17:37:17 2022] POST /identity/v3/users => generated 246 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:37:17.367360 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12f9eb5-7f96-4bfe-a7c1-2fa7a602a01d None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:17.367360 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12f9eb5-7f96-4bfe-a7c1-2fa7a602a01d None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:17.367360 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12f9eb5-7f96-4bfe-a7c1-2fa7a602a01d None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:17.372803 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 236/467] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:37:17 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:37:17.373666 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12f9eb5-7f96-4bfe-a7c1-2fa7a602a01d None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:17.381458 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e767cf6-585d-40fb-94a0-d55c4fa8a49e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:17.383460 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e767cf6-585d-40fb-94a0-d55c4fa8a49e None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:17.414851 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-7e767cf6-585d-40fb-94a0-d55c4fa8a49e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:37:17.414851 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:17.414851 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:17.414851 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:17.414851 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:17.414851 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:17.414851 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:17.414851 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:17.414851 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:17.414851 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:17.414851 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:17.414851 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:17.414851 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:37:17.414851 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:37:17.414851 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:37:17.415882 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:37:17.415882 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:17.415882 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:17.415882 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:17.415882 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:17.415882 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:17.415882 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:17.415882 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:17.415882 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:17.415882 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:17.415882 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:17.415882 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:17.415882 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:17.415882 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:17.415882 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:17.415882 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:17.415882 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:17.416746 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:37:17.416746 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:37:17.416746 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:37:17.416746 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:37:17.416970 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 232/468] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 14 17:37:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:37:17.420192 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9501c51-762d-4e49-b6cb-251e5385e113 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:17.420726 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9501c51-762d-4e49-b6cb-251e5385e113 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:17.421064 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9501c51-762d-4e49-b6cb-251e5385e113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:17.449987 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-d9501c51-762d-4e49-b6cb-251e5385e113 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:37:17.451637 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-d9501c51-762d-4e49-b6cb-251e5385e113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:37:17.474618 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:17.523656 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12f9eb5-7f96-4bfe-a7c1-2fa7a602a01d None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:17.544859 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:17.557203 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 233/469] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:37:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:37:17.558244 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9501c51-762d-4e49-b6cb-251e5385e113 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:17.572323 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f357d97-33ff-4d01-b118-edb62c07749c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:17.573167 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f357d97-33ff-4d01-b118-edb62c07749c None admin] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:17.573562 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f357d97-33ff-4d01-b118-edb62c07749c None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:17.574000 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f357d97-33ff-4d01-b118-edb62c07749c None admin] PATH_INFO: `/v3/users` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:17.574824 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f357d97-33ff-4d01-b118-edb62c07749c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:17.576553 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f357d97-33ff-4d01-b118-edb62c07749c None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:17.669366 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 237/470] 10.222.0.36 () {60 vars in 1132 bytes} [Tue Jun 14 17:37:17 2022] POST /identity/v3/users => generated 248 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:37:17.670216 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f357d97-33ff-4d01-b118-edb62c07749c None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:17.692694 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9501c51-762d-4e49-b6cb-251e5385e113 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:17.739981 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b3f907-9c65-4bdc-8f29-142035d510bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:17.740957 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b3f907-9c65-4bdc-8f29-142035d510bc None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:17.741404 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b3f907-9c65-4bdc-8f29-142035d510bc None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:17.741871 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b3f907-9c65-4bdc-8f29-142035d510bc None admin] PATH_INFO: `/v3/domains` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:17.742902 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b3f907-9c65-4bdc-8f29-142035d510bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:17.743389 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b3f907-9c65-4bdc-8f29-142035d510bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:17.745024 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b3f907-9c65-4bdc-8f29-142035d510bc None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:17.760180 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 234/471] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 14 17:37:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:17.765653 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b3f907-9c65-4bdc-8f29-142035d510bc None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:17.783965 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:17.853393 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f357d97-33ff-4d01-b118-edb62c07749c None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:17.904188 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27ca6fd-0b10-491b-86a5-2ec6c6d7db18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:17.904703 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27ca6fd-0b10-491b-86a5-2ec6c6d7db18 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:17.904993 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27ca6fd-0b10-491b-86a5-2ec6c6d7db18 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:17.905277 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27ca6fd-0b10-491b-86a5-2ec6c6d7db18 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:17.905747 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b3f907-9c65-4bdc-8f29-142035d510bc None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:17.921862 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27ca6fd-0b10-491b-86a5-2ec6c6d7db18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:17.923790 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27ca6fd-0b10-491b-86a5-2ec6c6d7db18 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:17.943633 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-b27ca6fd-0b10-491b-86a5-2ec6c6d7db18 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:37:17.943633 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:17.943633 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:17.943633 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:17.943633 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:17.943633 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:17.943633 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:17.943633 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:17.943633 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:17.943633 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:17.943633 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:17.943633 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:17.943633 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:37:17.943633 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:37:17.943633 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:37:17.944584 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:37:17.944584 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:17.944584 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:17.944584 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:17.944584 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:17.944584 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:17.944584 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:17.944584 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:17.944584 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:17.944584 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:17.944584 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:17.944584 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:17.944584 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:17.944584 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:17.944584 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:17.944584 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:17.944584 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:17.945444 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:37:17.945444 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:37:17.945444 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:37:17.945444 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:37:17.945939 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 238/472] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 14 17:37:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:37:17.949770 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c62ec7e-1090-4c1a-967d-cb26a042318d None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:17.949770 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c62ec7e-1090-4c1a-967d-cb26a042318d None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:17.949770 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c62ec7e-1090-4c1a-967d-cb26a042318d None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:17.949770 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 239/473] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:37:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:37:17.952151 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c62ec7e-1090-4c1a-967d-cb26a042318d None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:17.960323 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc28770-3004-432b-84fc-cd35c8ab94e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:17.961022 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc28770-3004-432b-84fc-cd35c8ab94e7 None admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:17.961314 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc28770-3004-432b-84fc-cd35c8ab94e7 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:17.961600 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc28770-3004-432b-84fc-cd35c8ab94e7 None admin] PATH_INFO: `/v3/users` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:17.962360 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc28770-3004-432b-84fc-cd35c8ab94e7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:17.963935 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc28770-3004-432b-84fc-cd35c8ab94e7 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:17.982982 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:18.056314 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 235/474] 10.222.0.36 () {60 vars in 1132 bytes} [Tue Jun 14 17:37:17 2022] POST /identity/v3/users => generated 248 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:37:18.059042 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe4f789-e435-4e24-8dcf-b74f51fa30de None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:18.060990 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe4f789-e435-4e24-8dcf-b74f51fa30de None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:18.060990 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe4f789-e435-4e24-8dcf-b74f51fa30de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:18.090367 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-dfe4f789-e435-4e24-8dcf-b74f51fa30de None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:37:18.091613 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-dfe4f789-e435-4e24-8dcf-b74f51fa30de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:37:18.115464 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c62ec7e-1090-4c1a-967d-cb26a042318d None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:18.234335 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f20371-9166-47c4-bbf9-8b169d20ab49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:18.235473 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f20371-9166-47c4-bbf9-8b169d20ab49 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:18.235979 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f20371-9166-47c4-bbf9-8b169d20ab49 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:18.236485 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f20371-9166-47c4-bbf9-8b169d20ab49 None admin] PATH_INFO: `/v3/domains` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:18.238483 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f20371-9166-47c4-bbf9-8b169d20ab49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:18.239048 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f20371-9166-47c4-bbf9-8b169d20ab49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:18.241939 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f20371-9166-47c4-bbf9-8b169d20ab49 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:18.266246 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:18.269607 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 240/475] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 14 17:37:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:18.274882 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f20371-9166-47c4-bbf9-8b169d20ab49 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:18.287188 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 236/476] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:37:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:37:18.322206 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe4f789-e435-4e24-8dcf-b74f51fa30de None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:18.393029 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:18.427898 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f20371-9166-47c4-bbf9-8b169d20ab49 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:18.468850 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe4f789-e435-4e24-8dcf-b74f51fa30de None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:18.481464 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d39cb3-e779-416e-aea3-55bf6c8c796c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:18.482695 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d39cb3-e779-416e-aea3-55bf6c8c796c None admin] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:18.483061 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d39cb3-e779-416e-aea3-55bf6c8c796c None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:18.483464 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d39cb3-e779-416e-aea3-55bf6c8c796c None admin] PATH_INFO: `/v3/users` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:18.484726 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d39cb3-e779-416e-aea3-55bf6c8c796c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:18.486452 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d39cb3-e779-416e-aea3-55bf6c8c796c None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:18.513623 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273b7813-ec4f-4c4f-9de6-564d1e6c75ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:18.520851 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273b7813-ec4f-4c4f-9de6-564d1e6c75ee None admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:18.520851 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273b7813-ec4f-4c4f-9de6-564d1e6c75ee None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:18.520851 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273b7813-ec4f-4c4f-9de6-564d1e6c75ee None admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:18.520851 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273b7813-ec4f-4c4f-9de6-564d1e6c75ee None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:18.520851 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273b7813-ec4f-4c4f-9de6-564d1e6c75ee None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:18.587138 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.sql.core [None req-273b7813-ec4f-4c4f-9de6-564d1e6c75ee None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 14 17:37:18.587138 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 14 17:37:18.587138 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [parameters: {'id': '8f4b0b24194242838b244d68bb27a650', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 14 17:37:18.587138 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87019) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 14 17:37:18.595105 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 241/477] 10.222.0.36 () {60 vars in 1132 bytes} [Tue Jun 14 17:37:18 2022] POST /identity/v3/users => generated 249 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 17:37:18.610822 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-273b7813-ec4f-4c4f-9de6-564d1e6c75ee None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 14 17:37:18.610822 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:18.610822 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 14 17:37:18.610822 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 14 17:37:18.610822 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 14 17:37:18.610822 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 14 17:37:18.610822 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 14 17:37:18.610822 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application result = self._query(query) Jun 14 17:37:18.610822 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 14 17:37:18.610822 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application conn.query(q) Jun 14 17:37:18.610822 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 14 17:37:18.610822 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 14 17:37:18.610822 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 14 17:37:18.610822 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application result.read() Jun 14 17:37:18.610822 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 14 17:37:18.611780 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 14 17:37:18.611780 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 14 17:37:18.611780 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 14 17:37:18.611780 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 14 17:37:18.611780 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 14 17:37:18.611780 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 14 17:37:18.611780 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 14 17:37:18.611780 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 14 17:37:18.611780 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:37:18.611780 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 14 17:37:18.611780 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:37:18.611780 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:18.611780 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 14 17:37:18.611780 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 14 17:37:18.611780 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 14 17:37:18.611780 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return ref.to_dict() Jun 14 17:37:18.611780 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 14 17:37:18.611780 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application next(self.gen) Jun 14 17:37:18.613322 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 14 17:37:18.613322 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application yield resource Jun 14 17:37:18.613322 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 14 17:37:18.613322 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application next(self.gen) Jun 14 17:37:18.613322 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 14 17:37:18.613322 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application self.session.rollback() Jun 14 17:37:18.613322 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 14 17:37:18.613322 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application self.force_reraise() Jun 14 17:37:18.613322 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 14 17:37:18.613322 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise self.value Jun 14 17:37:18.613322 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 14 17:37:18.613322 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 14 17:37:18.613322 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 14 17:37:18.613322 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application session.commit() Jun 14 17:37:18.613322 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 14 17:37:18.613322 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 14 17:37:18.613322 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 14 17:37:18.614198 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application self._prepare_impl() Jun 14 17:37:18.614198 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 14 17:37:18.614198 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application self.session.flush() Jun 14 17:37:18.614198 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 14 17:37:18.614198 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application self._flush(objects) Jun 14 17:37:18.614198 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 14 17:37:18.614198 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 14 17:37:18.614198 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 14 17:37:18.614198 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application compat.raise_( Jun 14 17:37:18.614198 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 14 17:37:18.614198 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception Jun 14 17:37:18.614198 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 14 17:37:18.614198 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application flush_context.execute() Jun 14 17:37:18.614198 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 14 17:37:18.614198 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rec.execute(self) Jun 14 17:37:18.614198 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 14 17:37:18.614198 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 14 17:37:18.615158 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 14 17:37:18.615158 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 14 17:37:18.615158 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 14 17:37:18.615158 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 14 17:37:18.615158 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 14 17:37:18.615158 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 14 17:37:18.615158 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 14 17:37:18.615158 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 14 17:37:18.615158 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 14 17:37:18.615158 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 14 17:37:18.615158 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 14 17:37:18.615158 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 14 17:37:18.615158 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 14 17:37:18.615158 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 14 17:37:18.615158 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 14 17:37:18.615158 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception Jun 14 17:37:18.616284 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 14 17:37:18.616284 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 14 17:37:18.616284 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 14 17:37:18.616284 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 14 17:37:18.616284 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 14 17:37:18.616284 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application result = self._query(query) Jun 14 17:37:18.616284 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 14 17:37:18.616284 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application conn.query(q) Jun 14 17:37:18.616284 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 14 17:37:18.616284 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 14 17:37:18.616284 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 14 17:37:18.616284 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application result.read() Jun 14 17:37:18.616284 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 14 17:37:18.616284 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 14 17:37:18.616284 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 14 17:37:18.616284 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 14 17:37:18.618019 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 14 17:37:18.618019 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 14 17:37:18.618019 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 14 17:37:18.618019 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 14 17:37:18.618019 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 14 17:37:18.618019 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 14 17:37:18.618019 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [parameters: {'id': '8f4b0b24194242838b244d68bb27a650', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 14 17:37:18.618019 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 14 17:37:18.618019 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:37:18.618019 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 14 17:37:18.618019 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:37:18.618019 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:18.618019 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:18.618019 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:18.618019 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:18.618019 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:18.619847 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:18.619847 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:18.619847 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:18.619847 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:18.619847 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:18.619847 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:18.619847 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 14 17:37:18.619847 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 14 17:37:18.619847 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:18.619847 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:18.619847 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 14 17:37:18.619847 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 14 17:37:18.619847 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 14 17:37:18.619847 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 14 17:37:18.619847 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 14 17:37:18.619847 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:37:18.621673 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 237/478] 10.222.0.36 () {60 vars in 1131 bytes} [Tue Jun 14 17:37:18 2022] POST /identity/v3/roles => generated 144 bytes in 291 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 14 17:37:18.628387 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d39cb3-e779-416e-aea3-55bf6c8c796c None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:18.750143 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d39cb3-e779-416e-aea3-55bf6c8c796c None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:18.790543 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d256e2e-f42a-4a32-9f51-f6a780b1e033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:18.791860 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d256e2e-f42a-4a32-9f51-f6a780b1e033 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:18.792339 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d256e2e-f42a-4a32-9f51-f6a780b1e033 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:18.792799 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d256e2e-f42a-4a32-9f51-f6a780b1e033 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:18.796192 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:18.812408 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d256e2e-f42a-4a32-9f51-f6a780b1e033 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:37:18.826298 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-2d256e2e-f42a-4a32-9f51-f6a780b1e033 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 14 17:37:18.826298 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:18.826298 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:18.826298 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:18.826298 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:18.826298 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:18.826298 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:18.826298 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:18.826298 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:18.826298 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:18.826298 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:18.826298 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:18.826298 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:37:18.826298 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:37:18.826298 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:37:18.826298 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:37:18.827444 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:37:18.827444 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:37:18.827444 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:37:18.827444 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:37:18.827444 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:18.827444 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:18.827444 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:18.827444 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:18.827444 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:18.827444 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:18.827444 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:18.827444 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:18.827444 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:18.827444 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:18.827444 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:18.827444 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:18.828742 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:18.828742 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:18.828742 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:18.828742 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:18.828742 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:37:18.828742 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:37:18.828742 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:37:18.828742 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:37:18.828742 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:37:18.828742 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:37:18.828742 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 14 17:37:18.828742 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:37:18.828742 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 242/479] 10.222.0.36 () {56 vars in 1114 bytes} [Tue Jun 14 17:37:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:37:18.836299 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273b7813-ec4f-4c4f-9de6-564d1e6c75ee None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:18.937766 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:18.986409 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273b7813-ec4f-4c4f-9de6-564d1e6c75ee None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:19.022887 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74868d7-75c8-405b-adab-575699072595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:19.023523 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74868d7-75c8-405b-adab-575699072595 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:19.023821 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74868d7-75c8-405b-adab-575699072595 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:19.024113 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74868d7-75c8-405b-adab-575699072595 None admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:19.024955 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74868d7-75c8-405b-adab-575699072595 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:19.025275 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74868d7-75c8-405b-adab-575699072595 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:19.026691 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74868d7-75c8-405b-adab-575699072595 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:19.036384 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 238/480] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 14 17:37:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:19.940990 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f10a2c6-a75d-4c29-b2cc-e3e9263c2098 None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:19.941635 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f10a2c6-a75d-4c29-b2cc-e3e9263c2098 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:19.941635 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f10a2c6-a75d-4c29-b2cc-e3e9263c2098 None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:19.943292 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 243/481] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:37:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:37:19.948527 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa28ca7-53a4-4907-90aa-d33a98ffe30c None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:19.948926 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa28ca7-53a4-4907-90aa-d33a98ffe30c None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:19.949088 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa28ca7-53a4-4907-90aa-d33a98ffe30c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:19.976359 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-bfa28ca7-53a4-4907-90aa-d33a98ffe30c None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:37:19.977561 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-bfa28ca7-53a4-4907-90aa-d33a98ffe30c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:37:20.074290 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 239/482] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:37:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:37:20.110318 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f10a2c6-a75d-4c29-b2cc-e3e9263c2098 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:20.247980 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f10a2c6-a75d-4c29-b2cc-e3e9263c2098 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:20.292523 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedc8b86-a409-4535-91e7-8101e565c64e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:20.293428 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedc8b86-a409-4535-91e7-8101e565c64e None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:20.293716 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedc8b86-a409-4535-91e7-8101e565c64e None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:20.293996 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedc8b86-a409-4535-91e7-8101e565c64e None admin] PATH_INFO: `/v3/roles/service` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:20.318003 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedc8b86-a409-4535-91e7-8101e565c64e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:37:20.326153 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-eedc8b86-a409-4535-91e7-8101e565c64e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 14 17:37:20.326153 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:20.326153 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:20.326153 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:20.326153 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:20.326153 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:20.326153 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:20.326153 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:20.326153 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:20.326153 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:20.326153 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:20.326153 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:20.326153 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:37:20.326153 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:37:20.326153 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:37:20.326153 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:37:20.327106 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:37:20.327106 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:37:20.327106 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:37:20.327106 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:37:20.327106 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:20.327106 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:20.327106 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:20.327106 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:20.327106 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:20.327106 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:20.327106 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:20.327106 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:20.327106 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:20.327106 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:20.327106 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:20.327106 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:20.327928 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:20.327928 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:20.327928 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:20.327928 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:20.327928 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:37:20.327928 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:37:20.327928 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:37:20.327928 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:37:20.327928 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:37:20.327928 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:37:20.327928 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 14 17:37:20.327928 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:37:20.331420 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 244/483] 10.222.0.36 () {56 vars in 1102 bytes} [Tue Jun 14 17:37:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:37:20.333628 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa28ca7-53a4-4907-90aa-d33a98ffe30c None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:20.366275 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d4cda0-14ab-4fbb-beba-8af74f53bacb None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:20.366887 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d4cda0-14ab-4fbb-beba-8af74f53bacb None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:20.367395 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d4cda0-14ab-4fbb-beba-8af74f53bacb None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:20.369202 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 245/484] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:37:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 14 17:37:20.373854 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63d3c58-3570-4e19-9bbb-602e581565dd None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:20.374145 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63d3c58-3570-4e19-9bbb-602e581565dd None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:20.374431 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63d3c58-3570-4e19-9bbb-602e581565dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:20.393176 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-f63d3c58-3570-4e19-9bbb-602e581565dd None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:37:20.394756 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-f63d3c58-3570-4e19-9bbb-602e581565dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:37:20.431526 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:20.457266 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:20.476808 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 246/485] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:37:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 14 17:37:20.501716 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63d3c58-3570-4e19-9bbb-602e581565dd None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:20.515044 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa28ca7-53a4-4907-90aa-d33a98ffe30c None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:20.556860 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb0b99c-67e4-4983-bdd5-b15ff59d4302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:20.557953 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb0b99c-67e4-4983-bdd5-b15ff59d4302 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:20.558518 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb0b99c-67e4-4983-bdd5-b15ff59d4302 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:20.558806 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb0b99c-67e4-4983-bdd5-b15ff59d4302 None admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:20.559601 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb0b99c-67e4-4983-bdd5-b15ff59d4302 None admin] RBAC: Adding query filter params (name=service) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:20.560066 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb0b99c-67e4-4983-bdd5-b15ff59d4302 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:20.561758 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb0b99c-67e4-4983-bdd5-b15ff59d4302 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:20.574862 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 240/486] 10.222.0.36 () {56 vars in 1103 bytes} [Tue Jun 14 17:37:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:20.581565 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb0b99c-67e4-4983-bdd5-b15ff59d4302 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:20.646869 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63d3c58-3570-4e19-9bbb-602e581565dd None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:20.687076 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8a76a2-baa2-4a9a-9235-9a49437dd83d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:20.688283 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8a76a2-baa2-4a9a-9235-9a49437dd83d None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:20.688565 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8a76a2-baa2-4a9a-9235-9a49437dd83d None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:20.688843 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8a76a2-baa2-4a9a-9235-9a49437dd83d None admin] PATH_INFO: `/v3/roles/service` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:20.701883 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8a76a2-baa2-4a9a-9235-9a49437dd83d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:37:20.710835 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-1e8a76a2-baa2-4a9a-9235-9a49437dd83d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 14 17:37:20.710835 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:20.710835 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:20.710835 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:20.710835 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:20.710835 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:20.710835 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:20.710835 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:20.710835 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:20.710835 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:20.710835 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:20.710835 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:20.710835 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:37:20.710835 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:37:20.710835 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:37:20.710835 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:37:20.711781 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:37:20.711781 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:37:20.711781 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:37:20.711781 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:37:20.711781 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:20.711781 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:20.711781 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:20.711781 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:20.711781 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:20.711781 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:20.711781 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:20.711781 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:20.711781 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:20.711781 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:20.711781 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:20.711781 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:20.712553 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:20.712553 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:20.712553 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:20.712553 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:20.712553 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:37:20.712553 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:37:20.712553 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:37:20.712553 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:37:20.712553 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:37:20.712553 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:37:20.712553 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 14 17:37:20.712553 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:37:20.713152 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 247/487] 10.222.0.36 () {56 vars in 1102 bytes} [Tue Jun 14 17:37:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 17:37:20.720322 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8a76a2-baa2-4a9a-9235-9a49437dd83d None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:20.809172 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb0b99c-67e4-4983-bdd5-b15ff59d4302 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:20.823678 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:20.855753 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:20.887291 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbda8fb4-c124-4263-b4a0-e6155e3a6e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:20.888217 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda8fb4-c124-4263-b4a0-e6155e3a6e7c None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:20.888528 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda8fb4-c124-4263-b4a0-e6155e3a6e7c None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:20.888810 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda8fb4-c124-4263-b4a0-e6155e3a6e7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:20.916438 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbda8fb4-c124-4263-b4a0-e6155e3a6e7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:20.917905 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbda8fb4-c124-4263-b4a0-e6155e3a6e7c None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:20.934345 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8a76a2-baa2-4a9a-9235-9a49437dd83d None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:20.947231 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-cbda8fb4-c124-4263-b4a0-e6155e3a6e7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:37:20.947231 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:20.947231 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:20.947231 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:20.947231 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:20.947231 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:20.947231 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:20.947231 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:20.947231 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:20.947231 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:20.947231 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:20.947231 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:20.947231 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:37:20.947231 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:37:20.947231 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:37:20.949656 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:37:20.949656 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:20.949656 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:20.949656 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:20.949656 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:20.949656 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:20.949656 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:20.949656 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:20.949656 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:20.949656 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:20.949656 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:20.949656 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:20.949656 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:20.949656 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:20.949656 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:20.949656 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:20.949656 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:20.951725 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:37:20.951725 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:37:20.951725 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:37:20.951725 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:37:20.951725 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 241/488] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 14 17:37:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 368 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 17:37:20.951725 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa56979-91cf-4e2d-8f3a-5552bce277c6 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:20.951725 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa56979-91cf-4e2d-8f3a-5552bce277c6 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:20.951725 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa56979-91cf-4e2d-8f3a-5552bce277c6 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:20.952703 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 242/489] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:37:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:37:20.957175 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa56979-91cf-4e2d-8f3a-5552bce277c6 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:20.973101 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914e3516-e4d0-4291-a95e-9f03cd63dfcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:20.973779 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914e3516-e4d0-4291-a95e-9f03cd63dfcd None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:20.974069 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914e3516-e4d0-4291-a95e-9f03cd63dfcd None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:20.974348 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914e3516-e4d0-4291-a95e-9f03cd63dfcd None admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:20.975098 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914e3516-e4d0-4291-a95e-9f03cd63dfcd None admin] RBAC: Adding query filter params (name=service) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:20.975447 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914e3516-e4d0-4291-a95e-9f03cd63dfcd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:20.976841 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914e3516-e4d0-4291-a95e-9f03cd63dfcd None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:20.985489 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 248/490] 10.222.0.36 () {56 vars in 1103 bytes} [Tue Jun 14 17:37:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:20.986732 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b2d7d2-ae9d-4804-a7ae-8d8842f20d8c None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:20.987083 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b2d7d2-ae9d-4804-a7ae-8d8842f20d8c None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:20.992277 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b2d7d2-ae9d-4804-a7ae-8d8842f20d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:21.010077 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-07b2d7d2-ae9d-4804-a7ae-8d8842f20d8c None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:37:21.011392 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-07b2d7d2-ae9d-4804-a7ae-8d8842f20d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:37:21.095450 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 249/491] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:37:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:37:21.095450 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b2d7d2-ae9d-4804-a7ae-8d8842f20d8c None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:21.103983 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa56979-91cf-4e2d-8f3a-5552bce277c6 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:21.151837 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:21.153053 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d3d72d-471e-4f28-96dd-f81c320feb32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:21.153857 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d3d72d-471e-4f28-96dd-f81c320feb32 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:21.154249 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d3d72d-471e-4f28-96dd-f81c320feb32 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:21.155091 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d3d72d-471e-4f28-96dd-f81c320feb32 None admin] PATH_INFO: `/v3/domains` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:21.156013 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d3d72d-471e-4f28-96dd-f81c320feb32 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:21.156848 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d3d72d-471e-4f28-96dd-f81c320feb32 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:21.158631 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d3d72d-471e-4f28-96dd-f81c320feb32 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:21.177933 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 243/492] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 14 17:37:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:21.179131 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d3d72d-471e-4f28-96dd-f81c320feb32 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:21.217007 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:21.231644 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b2d7d2-ae9d-4804-a7ae-8d8842f20d8c None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:21.279079 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4ea46b-6251-44e2-a216-1cfbf856595d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:21.280160 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4ea46b-6251-44e2-a216-1cfbf856595d None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:21.280591 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4ea46b-6251-44e2-a216-1cfbf856595d None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:21.281009 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4ea46b-6251-44e2-a216-1cfbf856595d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:21.296691 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4ea46b-6251-44e2-a216-1cfbf856595d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:21.299096 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4ea46b-6251-44e2-a216-1cfbf856595d None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:21.318079 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d3d72d-471e-4f28-96dd-f81c320feb32 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:21.324689 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-9f4ea46b-6251-44e2-a216-1cfbf856595d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:37:21.324689 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:21.324689 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:21.324689 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:21.324689 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:21.324689 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:21.324689 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:21.324689 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:21.324689 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:21.324689 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:21.324689 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:21.324689 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:21.324689 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:37:21.324689 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:37:21.324689 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:37:21.325640 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:37:21.325640 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:21.325640 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:21.325640 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:21.325640 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:21.325640 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:21.325640 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:21.325640 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:21.325640 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:21.325640 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:21.325640 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:21.325640 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:21.325640 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:21.325640 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:21.325640 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:21.325640 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:21.325640 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:21.326486 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:37:21.326486 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:37:21.326486 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:37:21.326486 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:37:21.334452 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 250/493] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 14 17:37:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:37:21.334452 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4ea46b-6251-44e2-a216-1cfbf856595d None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:21.367780 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d76334-5175-4b06-bdc1-eb232b49f69c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:21.368954 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d76334-5175-4b06-bdc1-eb232b49f69c None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:21.369250 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d76334-5175-4b06-bdc1-eb232b49f69c None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:21.369539 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d76334-5175-4b06-bdc1-eb232b49f69c None admin] PATH_INFO: `/v3/roles/service` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:21.385132 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d76334-5175-4b06-bdc1-eb232b49f69c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:37:21.396394 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-69d76334-5175-4b06-bdc1-eb232b49f69c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 14 17:37:21.396394 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:21.396394 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:21.396394 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:21.396394 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:21.396394 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:21.396394 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:21.396394 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:21.396394 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:21.396394 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:21.396394 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:21.396394 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:21.396394 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:37:21.396394 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:37:21.396394 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:37:21.396394 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:37:21.397367 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:37:21.397367 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:37:21.397367 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:37:21.397367 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:37:21.397367 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:21.397367 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:21.397367 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:21.397367 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:21.397367 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:21.397367 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:21.397367 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:21.397367 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:21.397367 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:21.397367 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:21.397367 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:21.397367 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:21.398193 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:21.398193 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:21.398193 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:21.398193 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:21.398193 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:37:21.398193 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:37:21.398193 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:37:21.398193 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:37:21.398193 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:37:21.398193 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:37:21.398193 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 14 17:37:21.398193 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:37:21.403415 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 244/494] 10.222.0.36 () {56 vars in 1102 bytes} [Tue Jun 14 17:37:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:37:21.404578 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d76334-5175-4b06-bdc1-eb232b49f69c None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:21.462687 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:21.477475 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4ea46b-6251-44e2-a216-1cfbf856595d None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:21.515809 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:21.533448 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78a229d-7f9c-4390-8e2e-adb4abcde4de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:21.534876 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78a229d-7f9c-4390-8e2e-adb4abcde4de None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:21.535161 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78a229d-7f9c-4390-8e2e-adb4abcde4de None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:21.535464 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78a229d-7f9c-4390-8e2e-adb4abcde4de None admin] PATH_INFO: `/v3/users/nova` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:21.537817 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d76334-5175-4b06-bdc1-eb232b49f69c None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:21.546777 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78a229d-7f9c-4390-8e2e-adb4abcde4de None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:21.548326 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78a229d-7f9c-4390-8e2e-adb4abcde4de None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:21.564591 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-a78a229d-7f9c-4390-8e2e-adb4abcde4de None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 14 17:37:21.564591 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:21.564591 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:21.564591 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:21.564591 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:21.564591 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:21.564591 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:21.564591 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:21.564591 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:21.564591 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:21.564591 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:21.564591 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:21.564591 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 14 17:37:21.564591 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 14 17:37:21.564591 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 14 17:37:21.564591 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 14 17:37:21.566389 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:21.566389 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:21.566389 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 14 17:37:21.566389 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:37:21.566389 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 14 17:37:21.566389 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:37:21.566389 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:21.566389 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:21.566389 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:21.566389 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:21.566389 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:21.566389 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:21.566389 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:21.566389 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:21.566389 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:21.566389 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:21.566389 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:21.566389 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:21.567942 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:21.567942 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:21.567942 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 14 17:37:21.567942 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 14 17:37:21.567942 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 14 17:37:21.567942 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 14 17:37:21.567942 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 14 17:37:21.567942 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 14 17:37:21.567942 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 14 17:37:21.567942 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:37:21.567942 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 251/495] 10.222.0.36 () {56 vars in 1093 bytes} [Tue Jun 14 17:37:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:37:21.567942 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78a229d-7f9c-4390-8e2e-adb4abcde4de None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:21.587653 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968df213-81e6-4fd1-ad9f-53e437aa4a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:21.589406 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968df213-81e6-4fd1-ad9f-53e437aa4a8e None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:21.589922 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968df213-81e6-4fd1-ad9f-53e437aa4a8e None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:21.590447 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968df213-81e6-4fd1-ad9f-53e437aa4a8e None admin] PATH_INFO: `/v3/domains` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:21.591418 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968df213-81e6-4fd1-ad9f-53e437aa4a8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:21.592507 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968df213-81e6-4fd1-ad9f-53e437aa4a8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:21.594422 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968df213-81e6-4fd1-ad9f-53e437aa4a8e None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:21.612936 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 245/496] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 14 17:37:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:21.614485 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968df213-81e6-4fd1-ad9f-53e437aa4a8e None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:21.704104 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78a229d-7f9c-4390-8e2e-adb4abcde4de None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:21.731624 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968df213-81e6-4fd1-ad9f-53e437aa4a8e None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:21.745464 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47976167-9165-4bb1-aa57-2879561390cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:21.746147 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47976167-9165-4bb1-aa57-2879561390cf None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:21.746435 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47976167-9165-4bb1-aa57-2879561390cf None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:21.746718 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47976167-9165-4bb1-aa57-2879561390cf None admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:21.747504 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47976167-9165-4bb1-aa57-2879561390cf None admin] RBAC: Adding query filter params (name=service) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:21.747818 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47976167-9165-4bb1-aa57-2879561390cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:21.749206 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47976167-9165-4bb1-aa57-2879561390cf None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:21.758845 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 252/497] 10.222.0.36 () {56 vars in 1103 bytes} [Tue Jun 14 17:37:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:21.760358 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47976167-9165-4bb1-aa57-2879561390cf None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:21.773921 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cf40b1-1d37-400e-af2e-e97d24983e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:21.774627 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cf40b1-1d37-400e-af2e-e97d24983e4b None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:21.774917 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cf40b1-1d37-400e-af2e-e97d24983e4b None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:21.775202 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cf40b1-1d37-400e-af2e-e97d24983e4b None admin] PATH_INFO: `/v3/users` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:21.776084 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cf40b1-1d37-400e-af2e-e97d24983e4b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:21.776401 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cf40b1-1d37-400e-af2e-e97d24983e4b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:21.777730 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:21.777915 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cf40b1-1d37-400e-af2e-e97d24983e4b None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:21.823068 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 246/498] 10.222.0.36 () {56 vars in 1133 bytes} [Tue Jun 14 17:37:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:21.823068 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311a361b-79fe-47ab-855d-088f1befa8e2 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:21.823068 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311a361b-79fe-47ab-855d-088f1befa8e2 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:21.823068 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311a361b-79fe-47ab-855d-088f1befa8e2 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:21.823068 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 247/499] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:37:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:37:21.823068 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311a361b-79fe-47ab-855d-088f1befa8e2 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:21.830668 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:21.886945 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47976167-9165-4bb1-aa57-2879561390cf None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:21.926100 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3996c692-e41c-4de6-a884-b1e4caec3c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:21.926909 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3996c692-e41c-4de6-a884-b1e4caec3c51 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:21.927190 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3996c692-e41c-4de6-a884-b1e4caec3c51 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:21.927494 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3996c692-e41c-4de6-a884-b1e4caec3c51 None admin] PATH_INFO: `/v3/users/glance` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:21.935350 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3996c692-e41c-4de6-a884-b1e4caec3c51 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:21.936782 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3996c692-e41c-4de6-a884-b1e4caec3c51 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:21.938072 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311a361b-79fe-47ab-855d-088f1befa8e2 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:21.951984 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-3996c692-e41c-4de6-a884-b1e4caec3c51 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 14 17:37:21.951984 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:21.951984 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:21.951984 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:21.951984 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:21.951984 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:21.951984 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:21.951984 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:21.951984 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:21.951984 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:21.951984 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:21.951984 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:21.951984 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 14 17:37:21.951984 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 14 17:37:21.951984 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 14 17:37:21.951984 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 14 17:37:21.952991 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:21.952991 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:21.952991 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 14 17:37:21.952991 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:37:21.952991 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 14 17:37:21.952991 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:37:21.952991 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:21.952991 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:21.952991 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:21.952991 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:21.952991 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:21.952991 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:21.952991 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:21.952991 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:21.952991 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:21.952991 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:21.952991 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:21.952991 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:21.953883 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:21.953883 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:21.953883 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 14 17:37:21.953883 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 14 17:37:21.953883 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 14 17:37:21.953883 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 14 17:37:21.953883 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 14 17:37:21.953883 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 14 17:37:21.953883 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 14 17:37:21.953883 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:37:21.953883 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 253/500] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 14 17:37:21 2022] GET /identity/v3/users/glance => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:37:21.954500 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3996c692-e41c-4de6-a884-b1e4caec3c51 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:21.978823 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ac39f4-7665-41a7-a586-e4eb589521e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:21.979662 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac39f4-7665-41a7-a586-e4eb589521e1 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:21.979955 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac39f4-7665-41a7-a586-e4eb589521e1 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:21.980240 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac39f4-7665-41a7-a586-e4eb589521e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:21.991586 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ac39f4-7665-41a7-a586-e4eb589521e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:21.993131 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ac39f4-7665-41a7-a586-e4eb589521e1 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:22.011807 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-85ac39f4-7665-41a7-a586-e4eb589521e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:37:22.011807 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:22.011807 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:22.011807 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:22.011807 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:22.011807 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:22.011807 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:22.011807 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:22.011807 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:22.011807 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:22.011807 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:22.011807 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:22.011807 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:37:22.011807 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:37:22.011807 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:37:22.012849 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:37:22.012849 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:22.012849 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:22.012849 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:22.012849 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:22.012849 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:22.012849 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:22.012849 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:22.012849 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:22.012849 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:22.012849 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:22.012849 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:22.012849 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:22.012849 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:22.012849 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:22.012849 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:22.012849 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:22.013693 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:37:22.013693 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:37:22.013693 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:37:22.013693 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:37:22.013693 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 248/501] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 14 17:37:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:37:22.014354 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1063181-9dc8-42eb-af25-f30e665113e7 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:22.014579 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1063181-9dc8-42eb-af25-f30e665113e7 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:22.014857 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1063181-9dc8-42eb-af25-f30e665113e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:22.032239 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:22.032781 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-e1063181-9dc8-42eb-af25-f30e665113e7 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:37:22.033692 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-e1063181-9dc8-42eb-af25-f30e665113e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:37:22.064575 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3996c692-e41c-4de6-a884-b1e4caec3c51 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:22.089322 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:22.100947 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa42731-dd44-48ab-8bcc-d3a5f05ecf3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:22.101608 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa42731-dd44-48ab-8bcc-d3a5f05ecf3e None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:22.101895 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa42731-dd44-48ab-8bcc-d3a5f05ecf3e None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:22.102177 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa42731-dd44-48ab-8bcc-d3a5f05ecf3e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:22.107004 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 249/502] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:37:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:37:22.108210 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436ddd8d-482e-4b8c-8197-9593b3f17157 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:22.108500 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436ddd8d-482e-4b8c-8197-9593b3f17157 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:22.108776 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436ddd8d-482e-4b8c-8197-9593b3f17157 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:22.111345 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 250/503] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:37:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:37:22.111345 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436ddd8d-482e-4b8c-8197-9593b3f17157 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:22.181839 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa42731-dd44-48ab-8bcc-d3a5f05ecf3e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:22.183310 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa42731-dd44-48ab-8bcc-d3a5f05ecf3e None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:22.225584 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436ddd8d-482e-4b8c-8197-9593b3f17157 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:22.254818 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:22.260843 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d8aeb0-8188-413c-a033-0ce02d113023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:22.261527 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d8aeb0-8188-413c-a033-0ce02d113023 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:22.261814 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d8aeb0-8188-413c-a033-0ce02d113023 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:22.262100 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d8aeb0-8188-413c-a033-0ce02d113023 None admin] PATH_INFO: `/v3/users` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:22.267241 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d8aeb0-8188-413c-a033-0ce02d113023 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:22.267241 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d8aeb0-8188-413c-a033-0ce02d113023 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:22.267241 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d8aeb0-8188-413c-a033-0ce02d113023 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:22.282013 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 251/504] 10.222.0.36 () {56 vars in 1137 bytes} [Tue Jun 14 17:37:22 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:22.282837 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d8aeb0-8188-413c-a033-0ce02d113023 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:22.294519 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 254/505] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 14 17:37:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 14 17:37:22.294519 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d311fde2-da16-4fe2-be7b-552e39a41fbc None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:22.294519 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d311fde2-da16-4fe2-be7b-552e39a41fbc None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:22.294519 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d311fde2-da16-4fe2-be7b-552e39a41fbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:22.310123 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-d311fde2-da16-4fe2-be7b-552e39a41fbc None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:37:22.311374 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-d311fde2-da16-4fe2-be7b-552e39a41fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:37:22.334629 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:22.381495 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 255/506] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:37:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:37:22.382353 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d311fde2-da16-4fe2-be7b-552e39a41fbc None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:22.399089 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d8aeb0-8188-413c-a033-0ce02d113023 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:22.436193 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1d9e2c-709e-4b0a-9111-79a2d5f162a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:22.436901 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1d9e2c-709e-4b0a-9111-79a2d5f162a3 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:22.437223 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1d9e2c-709e-4b0a-9111-79a2d5f162a3 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:22.437943 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1d9e2c-709e-4b0a-9111-79a2d5f162a3 None admin] PATH_INFO: `/v3/domains` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:22.438542 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1d9e2c-709e-4b0a-9111-79a2d5f162a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:22.438859 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1d9e2c-709e-4b0a-9111-79a2d5f162a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:22.440417 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1d9e2c-709e-4b0a-9111-79a2d5f162a3 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:22.454150 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 252/507] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 14 17:37:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:22.454994 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1d9e2c-709e-4b0a-9111-79a2d5f162a3 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:22.526744 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d311fde2-da16-4fe2-be7b-552e39a41fbc None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:22.528722 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:22.571120 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c5e4b1-2105-412e-abbd-771efb71bb96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:22.571984 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c5e4b1-2105-412e-abbd-771efb71bb96 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:22.572274 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c5e4b1-2105-412e-abbd-771efb71bb96 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:22.572567 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c5e4b1-2105-412e-abbd-771efb71bb96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:22.575490 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1d9e2c-709e-4b0a-9111-79a2d5f162a3 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:22.578101 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:22.590134 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c5e4b1-2105-412e-abbd-771efb71bb96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:22.591655 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c5e4b1-2105-412e-abbd-771efb71bb96 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:22.611267 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-d7c5e4b1-2105-412e-abbd-771efb71bb96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:37:22.611267 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:22.611267 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:22.611267 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:22.611267 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:22.611267 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:22.611267 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:22.611267 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:22.611267 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:22.611267 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:22.611267 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:22.611267 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:22.611267 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:37:22.611267 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:37:22.611267 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:37:22.612690 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:37:22.612690 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:22.612690 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:22.612690 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:22.612690 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:22.612690 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:22.612690 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:22.612690 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:22.612690 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:22.612690 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:22.612690 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:22.612690 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:22.612690 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:22.612690 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:22.612690 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:22.612690 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:22.612690 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:22.616954 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:37:22.616954 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:37:22.616954 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:37:22.616954 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:37:22.616954 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 256/508] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 14 17:37:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:37:22.616954 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c5e4b1-2105-412e-abbd-771efb71bb96 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:22.621981 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e585018-209c-4f31-90ad-4c694cd26c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:22.624445 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e585018-209c-4f31-90ad-4c694cd26c5b None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:22.625588 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e585018-209c-4f31-90ad-4c694cd26c5b None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:22.626784 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e585018-209c-4f31-90ad-4c694cd26c5b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:22.728267 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e585018-209c-4f31-90ad-4c694cd26c5b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:22.729855 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e585018-209c-4f31-90ad-4c694cd26c5b None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:22.736325 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c5e4b1-2105-412e-abbd-771efb71bb96 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:22.774106 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d765d286-57a2-4f31-9a10-d166ad746c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:22.774921 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d765d286-57a2-4f31-9a10-d166ad746c2c None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:22.775203 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d765d286-57a2-4f31-9a10-d166ad746c2c None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:22.775509 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d765d286-57a2-4f31-9a10-d166ad746c2c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:22.786882 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d765d286-57a2-4f31-9a10-d166ad746c2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:22.788310 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d765d286-57a2-4f31-9a10-d166ad746c2c None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:22.808248 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-d765d286-57a2-4f31-9a10-d166ad746c2c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:37:22.808248 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:22.808248 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:22.808248 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:22.808248 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:22.808248 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:22.808248 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:22.808248 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:22.808248 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:22.808248 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:22.808248 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:22.808248 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:22.808248 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:37:22.808248 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:37:22.808248 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:37:22.809212 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:37:22.809212 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:22.809212 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:22.809212 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:22.809212 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:22.809212 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:22.809212 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:22.809212 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:22.809212 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:22.809212 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:22.809212 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:22.809212 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:22.809212 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:22.809212 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:22.809212 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:22.809212 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:22.809212 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:22.810073 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:37:22.810073 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:37:22.810073 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:37:22.810073 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:37:22.814346 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 257/509] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 14 17:37:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:37:22.815603 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d765d286-57a2-4f31-9a10-d166ad746c2c None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:22.826032 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:22.861835 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 253/510] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 14 17:37:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 14 17:37:22.863221 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e585018-209c-4f31-90ad-4c694cd26c5b None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:22.867256 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:22.935264 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d765d286-57a2-4f31-9a10-d166ad746c2c None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:22.976692 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e585018-209c-4f31-90ad-4c694cd26c5b None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:22.981919 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3719e0d-0c33-4f69-8624-07b6a6f8a34a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:22.982747 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3719e0d-0c33-4f69-8624-07b6a6f8a34a None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:22.983036 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3719e0d-0c33-4f69-8624-07b6a6f8a34a None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:22.983350 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3719e0d-0c33-4f69-8624-07b6a6f8a34a None admin] PATH_INFO: `/v3/roles/service` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:22.995487 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3719e0d-0c33-4f69-8624-07b6a6f8a34a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:37:23.003765 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-b3719e0d-0c33-4f69-8624-07b6a6f8a34a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 14 17:37:23.003765 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:23.003765 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:23.003765 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:23.003765 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:23.003765 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:23.003765 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:23.003765 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:23.003765 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:23.003765 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:23.003765 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:23.003765 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:23.003765 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:37:23.003765 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:37:23.003765 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:37:23.003765 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:37:23.005501 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:37:23.005501 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:37:23.005501 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:37:23.005501 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:37:23.005501 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:23.005501 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:23.005501 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:23.005501 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:23.005501 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:23.005501 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:23.005501 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:23.005501 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:23.005501 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:23.005501 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:23.005501 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:23.005501 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:23.007048 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:23.007048 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:23.007048 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:23.007048 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:23.007048 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:37:23.007048 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:37:23.007048 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:37:23.007048 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:37:23.007048 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:37:23.007048 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:37:23.007048 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 14 17:37:23.007048 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:37:23.007048 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 258/511] 10.222.0.36 () {56 vars in 1102 bytes} [Tue Jun 14 17:37:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:37:23.007048 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3719e0d-0c33-4f69-8624-07b6a6f8a34a None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:23.029212 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f89bc2c-124b-44fc-94d8-ab9f128e7fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:23.031588 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f89bc2c-124b-44fc-94d8-ab9f128e7fa5 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:23.032359 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f89bc2c-124b-44fc-94d8-ab9f128e7fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:23.033076 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f89bc2c-124b-44fc-94d8-ab9f128e7fa5 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:23.046017 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f89bc2c-124b-44fc-94d8-ab9f128e7fa5 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:23.046017 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f89bc2c-124b-44fc-94d8-ab9f128e7fa5 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:23.061677 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-4f89bc2c-124b-44fc-94d8-ab9f128e7fa5 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 14 17:37:23.061677 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:23.061677 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:23.061677 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:23.061677 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:23.061677 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:23.061677 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:23.061677 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:23.061677 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:23.061677 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:23.061677 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:23.061677 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:23.061677 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 14 17:37:23.061677 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 14 17:37:23.061677 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 14 17:37:23.061677 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 14 17:37:23.062593 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:23.062593 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:23.062593 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 14 17:37:23.062593 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:37:23.062593 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 14 17:37:23.062593 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:37:23.062593 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:23.062593 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:23.062593 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:23.062593 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:23.062593 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:23.062593 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:23.062593 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:23.062593 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:23.062593 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:23.062593 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:23.062593 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:23.062593 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:23.063551 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:23.063551 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:23.063551 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 14 17:37:23.063551 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 14 17:37:23.063551 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 14 17:37:23.063551 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 14 17:37:23.063551 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 14 17:37:23.063551 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 14 17:37:23.063551 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 14 17:37:23.063551 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:37:23.063551 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 254/512] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 14 17:37:22 2022] GET /identity/v3/users/cinder => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:37:23.064156 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f89bc2c-124b-44fc-94d8-ab9f128e7fa5 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:23.089288 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:23.127183 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3719e0d-0c33-4f69-8624-07b6a6f8a34a None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:23.131860 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:23.162382 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f77df1-7f91-42de-aff4-e009f7428fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:23.163045 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f77df1-7f91-42de-aff4-e009f7428fd5 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:23.163357 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f77df1-7f91-42de-aff4-e009f7428fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:23.163639 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f77df1-7f91-42de-aff4-e009f7428fd5 None admin] PATH_INFO: `/v3/domains` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:23.164363 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f77df1-7f91-42de-aff4-e009f7428fd5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:23.164667 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f77df1-7f91-42de-aff4-e009f7428fd5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:23.166040 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f77df1-7f91-42de-aff4-e009f7428fd5 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:23.169439 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f89bc2c-124b-44fc-94d8-ab9f128e7fa5 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:23.179258 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 259/513] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 14 17:37:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:23.180205 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f77df1-7f91-42de-aff4-e009f7428fd5 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:23.207782 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1678e19-5bdb-4017-b1d0-2347fd0ba4af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:23.208456 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1678e19-5bdb-4017-b1d0-2347fd0ba4af None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:23.208747 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1678e19-5bdb-4017-b1d0-2347fd0ba4af None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:23.209111 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1678e19-5bdb-4017-b1d0-2347fd0ba4af None admin] PATH_INFO: `/v3/domains` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:23.210079 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1678e19-5bdb-4017-b1d0-2347fd0ba4af None admin] RBAC: Adding query filter params (name=Default) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:23.210689 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1678e19-5bdb-4017-b1d0-2347fd0ba4af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:23.212568 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1678e19-5bdb-4017-b1d0-2347fd0ba4af None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:23.225398 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 255/514] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 14 17:37:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:23.226242 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1678e19-5bdb-4017-b1d0-2347fd0ba4af None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:23.292162 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f77df1-7f91-42de-aff4-e009f7428fd5 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:23.322633 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:23.332566 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba48d61-3d14-4db3-a2ea-ffe617cc728d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:23.333420 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba48d61-3d14-4db3-a2ea-ffe617cc728d None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:23.333754 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba48d61-3d14-4db3-a2ea-ffe617cc728d None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:23.334043 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba48d61-3d14-4db3-a2ea-ffe617cc728d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:23.334138 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1678e19-5bdb-4017-b1d0-2347fd0ba4af None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:23.346032 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba48d61-3d14-4db3-a2ea-ffe617cc728d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:23.348279 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba48d61-3d14-4db3-a2ea-ffe617cc728d None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:23.376666 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:23.383002 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-fba48d61-3d14-4db3-a2ea-ffe617cc728d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:37:23.383002 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:23.383002 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:23.383002 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:23.383002 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:23.383002 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:23.383002 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:23.383002 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:23.383002 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:23.383002 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:23.383002 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:23.383002 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:23.383002 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:37:23.383002 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:37:23.383002 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:37:23.383985 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:37:23.383985 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:23.383985 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:23.383985 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:23.383985 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:23.383985 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:23.383985 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:23.383985 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:23.383985 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:23.383985 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:23.383985 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:23.383985 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:23.383985 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:23.383985 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:23.383985 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:23.383985 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:23.383985 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:23.384831 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:37:23.384831 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:37:23.384831 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:37:23.384831 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:37:23.384831 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 260/515] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 14 17:37:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:37:23.385459 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba48d61-3d14-4db3-a2ea-ffe617cc728d None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:23.409745 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffd5309-ac00-4fcf-a093-cefc7efca14f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:23.411193 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffd5309-ac00-4fcf-a093-cefc7efca14f None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:23.412019 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffd5309-ac00-4fcf-a093-cefc7efca14f None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:23.412676 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffd5309-ac00-4fcf-a093-cefc7efca14f None admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:23.413569 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffd5309-ac00-4fcf-a093-cefc7efca14f None admin] RBAC: Adding query filter params (name=service) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:23.414324 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffd5309-ac00-4fcf-a093-cefc7efca14f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:23.415794 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffd5309-ac00-4fcf-a093-cefc7efca14f None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:23.426138 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 256/516] 10.222.0.36 () {56 vars in 1103 bytes} [Tue Jun 14 17:37:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:23.427182 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffd5309-ac00-4fcf-a093-cefc7efca14f None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:23.507707 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba48d61-3d14-4db3-a2ea-ffe617cc728d None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:23.533196 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffd5309-ac00-4fcf-a093-cefc7efca14f None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:23.544966 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68daf7b-b8a5-44f8-9192-d93242666683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:23.545648 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68daf7b-b8a5-44f8-9192-d93242666683 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:23.545943 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68daf7b-b8a5-44f8-9192-d93242666683 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:23.546225 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68daf7b-b8a5-44f8-9192-d93242666683 None admin] PATH_INFO: `/v3/users` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:23.547073 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68daf7b-b8a5-44f8-9192-d93242666683 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:23.547413 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68daf7b-b8a5-44f8-9192-d93242666683 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:23.548860 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68daf7b-b8a5-44f8-9192-d93242666683 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:23.568048 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda6c782-d723-4c7a-b819-ed813d0a455b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:23.568728 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda6c782-d723-4c7a-b819-ed813d0a455b None admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:23.569019 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda6c782-d723-4c7a-b819-ed813d0a455b None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:23.569304 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda6c782-d723-4c7a-b819-ed813d0a455b None admin] PATH_INFO: `/v3/users` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:23.570013 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda6c782-d723-4c7a-b819-ed813d0a455b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:23.571493 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda6c782-d723-4c7a-b819-ed813d0a455b None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:23.587780 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 261/517] 10.222.0.36 () {56 vars in 1137 bytes} [Tue Jun 14 17:37:23 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:23.590320 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68daf7b-b8a5-44f8-9192-d93242666683 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:23.633921 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:23.644503 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 257/518] 10.222.0.36 () {60 vars in 1132 bytes} [Tue Jun 14 17:37:23 2022] POST /identity/v3/users => generated 247 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:37:23.645352 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda6c782-d723-4c7a-b819-ed813d0a455b None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:23.697537 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:23.723978 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68daf7b-b8a5-44f8-9192-d93242666683 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:23.765607 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec4ec55-264d-4d88-8eed-ccef9ce8fac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:23.766430 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec4ec55-264d-4d88-8eed-ccef9ce8fac3 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:23.766717 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec4ec55-264d-4d88-8eed-ccef9ce8fac3 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:23.767047 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec4ec55-264d-4d88-8eed-ccef9ce8fac3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:23.769980 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda6c782-d723-4c7a-b819-ed813d0a455b None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:23.776061 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec4ec55-264d-4d88-8eed-ccef9ce8fac3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:23.777580 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec4ec55-264d-4d88-8eed-ccef9ce8fac3 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:23.793917 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-aec4ec55-264d-4d88-8eed-ccef9ce8fac3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:37:23.793917 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:23.793917 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:23.793917 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:23.793917 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:23.793917 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:23.793917 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:23.793917 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:23.793917 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:23.793917 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:23.793917 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:23.793917 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:23.793917 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 14 17:37:23.793917 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 14 17:37:23.793917 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 14 17:37:23.794858 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 14 17:37:23.794858 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:23.794858 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:23.794858 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:23.794858 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:23.794858 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:23.794858 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:23.794858 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:23.794858 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:23.794858 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:23.794858 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:23.794858 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:23.794858 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:23.794858 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:23.794858 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:23.794858 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:23.794858 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:23.795752 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 14 17:37:23.795752 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 14 17:37:23.795752 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 14 17:37:23.795752 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 14 17:37:23.795752 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 14 17:37:23.795752 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 14 17:37:23.795752 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:37:23.795752 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:37:23.795752 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 262/519] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 14 17:37:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:37:23.796227 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec4ec55-264d-4d88-8eed-ccef9ce8fac3 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:23.815873 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56ad3ff-a63b-4fbb-9eb0-a78bbfda4045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:23.816758 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56ad3ff-a63b-4fbb-9eb0-a78bbfda4045 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:23.817107 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56ad3ff-a63b-4fbb-9eb0-a78bbfda4045 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:23.817392 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56ad3ff-a63b-4fbb-9eb0-a78bbfda4045 None admin] PATH_INFO: `/v3/domains` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:23.818123 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56ad3ff-a63b-4fbb-9eb0-a78bbfda4045 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:23.818431 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56ad3ff-a63b-4fbb-9eb0-a78bbfda4045 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:23.819868 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56ad3ff-a63b-4fbb-9eb0-a78bbfda4045 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:23.834394 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 258/520] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 14 17:37:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:23.835383 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56ad3ff-a63b-4fbb-9eb0-a78bbfda4045 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:23.942003 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:23.954004 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec4ec55-264d-4d88-8eed-ccef9ce8fac3 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:23.975818 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56ad3ff-a63b-4fbb-9eb0-a78bbfda4045 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:23.977447 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:23.999959 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77228018-4e45-4ad9-b493-a83ea9b437fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:24.000771 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77228018-4e45-4ad9-b493-a83ea9b437fc None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:24.001058 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77228018-4e45-4ad9-b493-a83ea9b437fc None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:24.001335 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77228018-4e45-4ad9-b493-a83ea9b437fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:24.013355 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77228018-4e45-4ad9-b493-a83ea9b437fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:24.013561 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9135db-78ef-494d-8b9e-805aa437d772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:24.014123 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9135db-78ef-494d-8b9e-805aa437d772 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:24.014354 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9135db-78ef-494d-8b9e-805aa437d772 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:24.014718 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9135db-78ef-494d-8b9e-805aa437d772 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:24.014835 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77228018-4e45-4ad9-b493-a83ea9b437fc None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:24.032778 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-77228018-4e45-4ad9-b493-a83ea9b437fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:37:24.032778 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:24.032778 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:24.032778 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:24.032778 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:24.032778 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:24.032778 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:24.032778 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:24.032778 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:24.032778 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:24.032778 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:24.032778 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:24.032778 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:37:24.032778 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:37:24.032778 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:37:24.034617 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:37:24.034617 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:24.034617 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:24.034617 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:24.034617 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:24.034617 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:24.034617 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:24.034617 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:24.034617 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:24.034617 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:24.034617 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:24.034617 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:24.034617 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:24.034617 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:24.034617 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:24.034617 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:24.034617 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:24.035571 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:37:24.035571 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:37:24.035571 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:37:24.035571 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:37:24.035571 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 263/521] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 14 17:37:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:37:24.035571 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77228018-4e45-4ad9-b493-a83ea9b437fc None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:24.095527 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9135db-78ef-494d-8b9e-805aa437d772 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:24.098813 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9135db-78ef-494d-8b9e-805aa437d772 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:24.166879 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77228018-4e45-4ad9-b493-a83ea9b437fc None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:24.210788 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede77e12-ac83-407a-9aaf-0f1a5a07d23f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:24.211496 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede77e12-ac83-407a-9aaf-0f1a5a07d23f None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:24.211783 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede77e12-ac83-407a-9aaf-0f1a5a07d23f None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:24.212059 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede77e12-ac83-407a-9aaf-0f1a5a07d23f None admin] PATH_INFO: `/v3/projects` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:24.212855 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede77e12-ac83-407a-9aaf-0f1a5a07d23f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:24.213167 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede77e12-ac83-407a-9aaf-0f1a5a07d23f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:24.214661 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede77e12-ac83-407a-9aaf-0f1a5a07d23f None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:24.231643 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 259/522] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 14 17:37:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 14 17:37:24.231643 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9135db-78ef-494d-8b9e-805aa437d772 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:24.233493 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:24.241629 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 264/523] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jun 14 17:37:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:24.242309 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede77e12-ac83-407a-9aaf-0f1a5a07d23f None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:24.254315 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:24.354287 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede77e12-ac83-407a-9aaf-0f1a5a07d23f None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:24.356835 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9135db-78ef-494d-8b9e-805aa437d772 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:24.394017 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd58ce9-5f14-4b62-9f9e-f743a836aac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:24.394932 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd58ce9-5f14-4b62-9f9e-f743a836aac9 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:24.395227 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd58ce9-5f14-4b62-9f9e-f743a836aac9 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:24.395543 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd58ce9-5f14-4b62-9f9e-f743a836aac9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:24.399181 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf8afb9-6781-4f8f-8ece-6e188d4927a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:24.399932 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf8afb9-6781-4f8f-8ece-6e188d4927a0 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:24.400226 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf8afb9-6781-4f8f-8ece-6e188d4927a0 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:24.400512 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf8afb9-6781-4f8f-8ece-6e188d4927a0 None admin] PATH_INFO: `/v3/domains` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:24.401269 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf8afb9-6781-4f8f-8ece-6e188d4927a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:24.401582 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf8afb9-6781-4f8f-8ece-6e188d4927a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:24.402967 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf8afb9-6781-4f8f-8ece-6e188d4927a0 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:24.403144 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd58ce9-5f14-4b62-9f9e-f743a836aac9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:24.404581 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd58ce9-5f14-4b62-9f9e-f743a836aac9 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:24.419436 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 265/524] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 14 17:37:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:24.419436 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf8afb9-6781-4f8f-8ece-6e188d4927a0 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:24.419912 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-0dd58ce9-5f14-4b62-9f9e-f743a836aac9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:37:24.419912 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:24.419912 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:24.419912 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:24.419912 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:24.419912 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:24.419912 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:24.419912 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:24.419912 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:24.419912 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:24.419912 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:24.419912 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:24.419912 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 14 17:37:24.419912 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 14 17:37:24.419912 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 14 17:37:24.420770 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 14 17:37:24.420770 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:24.420770 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:24.420770 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:24.420770 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:24.420770 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:24.420770 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:24.420770 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:24.420770 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:24.420770 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:24.420770 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:24.420770 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:24.420770 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:24.420770 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:24.420770 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:24.420770 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:24.420770 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:24.421925 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 14 17:37:24.421925 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 14 17:37:24.421925 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 14 17:37:24.421925 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 14 17:37:24.421925 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 14 17:37:24.421925 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 14 17:37:24.421925 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:37:24.421925 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:37:24.421925 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 260/525] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 14 17:37:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:37:24.422569 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd58ce9-5f14-4b62-9f9e-f743a836aac9 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:24.491202 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:24.494974 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:24.531527 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf8afb9-6781-4f8f-8ece-6e188d4927a0 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:24.537112 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd58ce9-5f14-4b62-9f9e-f743a836aac9 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:24.570257 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdfd92f-d57b-4226-bb90-e5d668dc78a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:24.571096 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdfd92f-d57b-4226-bb90-e5d668dc78a3 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:24.571426 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdfd92f-d57b-4226-bb90-e5d668dc78a3 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:24.571724 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdfd92f-d57b-4226-bb90-e5d668dc78a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:24.573342 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee21b2d9-2525-4762-8050-3884e52c110d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:24.574030 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee21b2d9-2525-4762-8050-3884e52c110d None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:24.574319 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee21b2d9-2525-4762-8050-3884e52c110d None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:24.574597 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee21b2d9-2525-4762-8050-3884e52c110d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:24.575459 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee21b2d9-2525-4762-8050-3884e52c110d None admin] RBAC: Adding query filter params (role.id=ed6a4c87428044ddbc5199cfb05de27e, scope.project.id=f3e1d023a52c42b98d018617987ef83c, user.id=e4696d396adb495ab300a9a5a5727595) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:24.575782 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee21b2d9-2525-4762-8050-3884e52c110d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:24.577340 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee21b2d9-2525-4762-8050-3884e52c110d None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:24.583541 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 261/526] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 14 17:37:24 2022] GET /identity/v3/role_assignments?user.id=e4696d396adb495ab300a9a5a5727595&scope.project.id=f3e1d023a52c42b98d018617987ef83c&role.id=ed6a4c87428044ddbc5199cfb05de27e => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:24.584398 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee21b2d9-2525-4762-8050-3884e52c110d None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:24.593830 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdfd92f-d57b-4226-bb90-e5d668dc78a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:24.594838 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdfd92f-d57b-4226-bb90-e5d668dc78a3 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:24.620791 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-ccdfd92f-d57b-4226-bb90-e5d668dc78a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:37:24.620791 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:24.620791 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:24.620791 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:24.620791 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:24.620791 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:24.620791 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:24.620791 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:24.620791 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:24.620791 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:24.620791 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:24.620791 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:24.620791 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:37:24.620791 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:37:24.620791 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:37:24.621748 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:37:24.621748 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:24.621748 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:24.621748 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:24.621748 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:24.621748 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:24.621748 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:24.621748 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:24.621748 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:24.621748 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:24.621748 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:24.621748 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:24.621748 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:24.621748 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:24.621748 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:24.621748 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:24.621748 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:24.622622 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:37:24.622622 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:37:24.622622 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:37:24.622622 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:37:24.628194 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 266/527] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 14 17:37:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:37:24.630180 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdfd92f-d57b-4226-bb90-e5d668dc78a3 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:24.709226 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee21b2d9-2525-4762-8050-3884e52c110d None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:24.739214 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:24.749663 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd8f0e6-e645-4aae-8a89-f17b08eca761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:24.753378 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd8f0e6-e645-4aae-8a89-f17b08eca761 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:24.753378 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd8f0e6-e645-4aae-8a89-f17b08eca761 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:24.753378 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd8f0e6-e645-4aae-8a89-f17b08eca761 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:24.753643 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdfd92f-d57b-4226-bb90-e5d668dc78a3 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:24.761743 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd8f0e6-e645-4aae-8a89-f17b08eca761 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:24.763364 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd8f0e6-e645-4aae-8a89-f17b08eca761 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:24.781526 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:24.781717 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-2cd8f0e6-e645-4aae-8a89-f17b08eca761 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 14 17:37:24.781717 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:24.781717 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:24.781717 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:24.781717 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:24.781717 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:24.781717 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:24.781717 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:24.781717 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:24.781717 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:24.781717 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:24.781717 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:24.781717 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 14 17:37:24.781717 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 14 17:37:24.781717 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 14 17:37:24.781717 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 14 17:37:24.782592 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:24.782592 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:24.782592 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 14 17:37:24.782592 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:37:24.782592 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 14 17:37:24.782592 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:37:24.782592 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:24.782592 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:24.782592 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:24.782592 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:24.782592 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:24.782592 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:24.782592 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:24.782592 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:24.782592 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:24.782592 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:24.782592 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:24.782592 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:24.783980 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:24.783980 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:24.783980 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 14 17:37:24.783980 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 14 17:37:24.783980 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 14 17:37:24.783980 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 14 17:37:24.783980 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 14 17:37:24.783980 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 14 17:37:24.783980 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 14 17:37:24.783980 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:37:24.783980 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 262/528] 10.222.0.36 () {56 vars in 1102 bytes} [Tue Jun 14 17:37:24 2022] GET /identity/v3/users/neutron => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:37:24.783980 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd8f0e6-e645-4aae-8a89-f17b08eca761 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:24.809198 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043eaf82-d2f7-45d9-860d-7f2765a93d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:24.811875 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043eaf82-d2f7-45d9-860d-7f2765a93d77 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:24.812569 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043eaf82-d2f7-45d9-860d-7f2765a93d77 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:24.812989 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043eaf82-d2f7-45d9-860d-7f2765a93d77 None admin] PATH_INFO: `/v3/projects` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:24.814554 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043eaf82-d2f7-45d9-860d-7f2765a93d77 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:24.814954 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043eaf82-d2f7-45d9-860d-7f2765a93d77 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:24.817587 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043eaf82-d2f7-45d9-860d-7f2765a93d77 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:24.839390 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 267/529] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jun 14 17:37:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:24.840872 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043eaf82-d2f7-45d9-860d-7f2765a93d77 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:24.925064 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd8f0e6-e645-4aae-8a89-f17b08eca761 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:24.978003 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5680dbef-6a2a-4f83-a825-97e0ed23bd4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:24.978986 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5680dbef-6a2a-4f83-a825-97e0ed23bd4b None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:24.979331 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5680dbef-6a2a-4f83-a825-97e0ed23bd4b None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:24.979667 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5680dbef-6a2a-4f83-a825-97e0ed23bd4b None admin] PATH_INFO: `/v3/domains` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:24.980406 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5680dbef-6a2a-4f83-a825-97e0ed23bd4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:24.980987 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5680dbef-6a2a-4f83-a825-97e0ed23bd4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:24.983079 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5680dbef-6a2a-4f83-a825-97e0ed23bd4b None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:24.984858 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043eaf82-d2f7-45d9-860d-7f2765a93d77 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:25.003470 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 263/530] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 14 17:37:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:25.004850 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5680dbef-6a2a-4f83-a825-97e0ed23bd4b None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:25.051257 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3319b52f-ce6c-4f1a-b9a4-27c17cd392d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:25.052503 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3319b52f-ce6c-4f1a-b9a4-27c17cd392d6 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:25.052806 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3319b52f-ce6c-4f1a-b9a4-27c17cd392d6 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:25.053091 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3319b52f-ce6c-4f1a-b9a4-27c17cd392d6 None admin] PATH_INFO: `/v3/users` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:25.054267 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3319b52f-ce6c-4f1a-b9a4-27c17cd392d6 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:25.054590 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3319b52f-ce6c-4f1a-b9a4-27c17cd392d6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:25.056131 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3319b52f-ce6c-4f1a-b9a4-27c17cd392d6 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:25.073961 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:25.083556 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 268/531] 10.222.0.36 () {56 vars in 1139 bytes} [Tue Jun 14 17:37:24 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:25.084845 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3319b52f-ce6c-4f1a-b9a4-27c17cd392d6 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:25.132424 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:25.149278 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5680dbef-6a2a-4f83-a825-97e0ed23bd4b None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:25.195225 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7024287-9fe2-4442-a6a0-a0461eaa1628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:25.196232 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7024287-9fe2-4442-a6a0-a0461eaa1628 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:25.196529 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7024287-9fe2-4442-a6a0-a0461eaa1628 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:25.196826 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7024287-9fe2-4442-a6a0-a0461eaa1628 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:25.197947 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7024287-9fe2-4442-a6a0-a0461eaa1628 None admin] RBAC: Adding query filter params (role.id=ed6a4c87428044ddbc5199cfb05de27e, scope.project.id=f3e1d023a52c42b98d018617987ef83c, user.id=359f5ed4eb684e769f552484ca9a34c7) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:25.198267 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7024287-9fe2-4442-a6a0-a0461eaa1628 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:25.199742 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7024287-9fe2-4442-a6a0-a0461eaa1628 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:25.199890 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3319b52f-ce6c-4f1a-b9a4-27c17cd392d6 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:25.215522 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 264/532] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 14 17:37:25 2022] GET /identity/v3/role_assignments?user.id=359f5ed4eb684e769f552484ca9a34c7&scope.project.id=f3e1d023a52c42b98d018617987ef83c&role.id=ed6a4c87428044ddbc5199cfb05de27e => generated 259 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:25.216805 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7024287-9fe2-4442-a6a0-a0461eaa1628 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:25.305671 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8a678c-85c2-4833-bf91-22d423552a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:25.306744 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8a678c-85c2-4833-bf91-22d423552a89 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:25.307209 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8a678c-85c2-4833-bf91-22d423552a89 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:25.307984 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8a678c-85c2-4833-bf91-22d423552a89 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:25.326527 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8a678c-85c2-4833-bf91-22d423552a89 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:25.328375 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8a678c-85c2-4833-bf91-22d423552a89 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:25.354542 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-7c8a678c-85c2-4833-bf91-22d423552a89 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:37:25.354542 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:25.354542 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:25.354542 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:25.354542 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:25.354542 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:25.354542 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:25.354542 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:25.354542 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:25.354542 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:25.354542 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:25.354542 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:25.354542 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 14 17:37:25.354542 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 14 17:37:25.354542 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 14 17:37:25.355630 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 14 17:37:25.355630 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:25.355630 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:25.355630 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:25.355630 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:25.355630 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:25.355630 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:25.355630 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:25.355630 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:25.355630 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:25.355630 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:25.355630 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:25.355630 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:25.355630 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:25.355630 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:25.355630 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:25.355630 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:25.356489 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 14 17:37:25.356489 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 14 17:37:25.356489 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 14 17:37:25.356489 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 14 17:37:25.356489 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 14 17:37:25.356489 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 14 17:37:25.356489 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:37:25.356489 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:37:25.359039 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 269/533] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 14 17:37:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:37:25.364980 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8a678c-85c2-4833-bf91-22d423552a89 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:25.372178 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7024287-9fe2-4442-a6a0-a0461eaa1628 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:25.405635 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:25.451903 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5f0ba4-86ab-4466-b69f-7935b00b40aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:25.452603 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5f0ba4-86ab-4466-b69f-7935b00b40aa None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:25.452892 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5f0ba4-86ab-4466-b69f-7935b00b40aa None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:25.453173 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5f0ba4-86ab-4466-b69f-7935b00b40aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:25.498846 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:25.505442 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8a678c-85c2-4833-bf91-22d423552a89 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:25.546661 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88a6058-89a3-46ff-99fc-96d058d42b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:25.547726 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88a6058-89a3-46ff-99fc-96d058d42b3c None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:25.548242 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88a6058-89a3-46ff-99fc-96d058d42b3c None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:25.548794 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88a6058-89a3-46ff-99fc-96d058d42b3c None admin] PATH_INFO: `/v3/projects` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:25.550055 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88a6058-89a3-46ff-99fc-96d058d42b3c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:25.551191 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88a6058-89a3-46ff-99fc-96d058d42b3c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:25.553455 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88a6058-89a3-46ff-99fc-96d058d42b3c None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:25.569503 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 270/534] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jun 14 17:37:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:25.574811 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88a6058-89a3-46ff-99fc-96d058d42b3c None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:25.618541 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5f0ba4-86ab-4466-b69f-7935b00b40aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:25.620091 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5f0ba4-86ab-4466-b69f-7935b00b40aa None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:25.730618 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88a6058-89a3-46ff-99fc-96d058d42b3c None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:25.801974 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a029667-7e3d-4642-b272-9fbf78fff77b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:25.803205 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a029667-7e3d-4642-b272-9fbf78fff77b None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:25.803809 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a029667-7e3d-4642-b272-9fbf78fff77b None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:25.804294 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a029667-7e3d-4642-b272-9fbf78fff77b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:25.805433 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a029667-7e3d-4642-b272-9fbf78fff77b None admin] RBAC: Adding query filter params (role.id=ed6a4c87428044ddbc5199cfb05de27e, scope.project.id=f3e1d023a52c42b98d018617987ef83c, user.id=17945e7d72954b8787e0ba09a9903247) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:25.805957 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a029667-7e3d-4642-b272-9fbf78fff77b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:25.807677 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 265/535] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 14 17:37:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 591 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 14 17:37:25.807998 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a029667-7e3d-4642-b272-9fbf78fff77b None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:25.815219 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5f0ba4-86ab-4466-b69f-7935b00b40aa None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:25.820520 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 271/536] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 14 17:37:25 2022] GET /identity/v3/role_assignments?user.id=17945e7d72954b8787e0ba09a9903247&scope.project.id=f3e1d023a52c42b98d018617987ef83c&role.id=ed6a4c87428044ddbc5199cfb05de27e => generated 259 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:25.829201 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:25.966509 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5f0ba4-86ab-4466-b69f-7935b00b40aa None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:26.017391 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1265a4-caab-4f0c-8f96-3cd8e34891fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:26.018274 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1265a4-caab-4f0c-8f96-3cd8e34891fc None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:26.018606 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1265a4-caab-4f0c-8f96-3cd8e34891fc None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:26.018894 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1265a4-caab-4f0c-8f96-3cd8e34891fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:26.031937 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1265a4-caab-4f0c-8f96-3cd8e34891fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:26.034566 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1265a4-caab-4f0c-8f96-3cd8e34891fc None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:26.063283 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-fb1265a4-caab-4f0c-8f96-3cd8e34891fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:37:26.063283 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:26.063283 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:26.063283 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:26.063283 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:26.063283 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:26.063283 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:26.063283 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:26.063283 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:26.063283 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:26.063283 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:26.063283 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:26.063283 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:37:26.063283 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:37:26.063283 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:37:26.064229 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:37:26.064229 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:26.064229 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:26.064229 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:26.064229 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:26.064229 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:26.064229 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:26.064229 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:26.064229 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:26.064229 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:26.064229 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:26.064229 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:26.064229 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:26.064229 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:26.064229 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:26.064229 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:26.064229 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:26.065127 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:37:26.065127 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:37:26.065127 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:37:26.065127 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:37:26.065127 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 266/537] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 14 17:37:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 17:37:26.071622 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a029667-7e3d-4642-b272-9fbf78fff77b None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:26.108986 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:26.188552 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03451313-6f91-4870-bf15-326796f07c2c None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:26.189143 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03451313-6f91-4870-bf15-326796f07c2c None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:26.189259 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03451313-6f91-4870-bf15-326796f07c2c None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:26.192326 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 267/538] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:37:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:37:26.198458 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8942df4-d806-4c5b-a55e-ecbdd60c3bd6 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:26.198771 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8942df4-d806-4c5b-a55e-ecbdd60c3bd6 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:26.199028 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8942df4-d806-4c5b-a55e-ecbdd60c3bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:26.236184 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-c8942df4-d806-4c5b-a55e-ecbdd60c3bd6 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:37:26.238221 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-c8942df4-d806-4c5b-a55e-ecbdd60c3bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:37:26.280872 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a029667-7e3d-4642-b272-9fbf78fff77b None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:26.327031 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3394009-5f1b-430e-9937-0113a4720971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:26.328371 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3394009-5f1b-430e-9937-0113a4720971 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:26.328662 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3394009-5f1b-430e-9937-0113a4720971 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:26.328945 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3394009-5f1b-430e-9937-0113a4720971 None admin] PATH_INFO: `/v3/domains` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:26.329677 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3394009-5f1b-430e-9937-0113a4720971 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:26.329993 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3394009-5f1b-430e-9937-0113a4720971 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:26.332013 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3394009-5f1b-430e-9937-0113a4720971 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:26.345577 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 272/539] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 14 17:37:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:26.351057 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3394009-5f1b-430e-9937-0113a4720971 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:26.373953 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:26.409856 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 268/540] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:37:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 14 17:37:26.444361 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8942df4-d806-4c5b-a55e-ecbdd60c3bd6 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:26.515670 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:26.552615 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3394009-5f1b-430e-9937-0113a4720971 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:26.609274 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13e904e-a9a4-4132-b775-15e6735c6514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:26.610013 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13e904e-a9a4-4132-b775-15e6735c6514 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:26.610309 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13e904e-a9a4-4132-b775-15e6735c6514 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:26.610597 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13e904e-a9a4-4132-b775-15e6735c6514 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:26.619712 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13e904e-a9a4-4132-b775-15e6735c6514 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:26.621210 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13e904e-a9a4-4132-b775-15e6735c6514 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:26.638514 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-b13e904e-a9a4-4132-b775-15e6735c6514 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:37:26.638514 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:26.638514 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:26.638514 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:26.638514 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:26.638514 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:26.638514 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:26.638514 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:26.638514 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:26.638514 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:26.638514 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:26.638514 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:26.638514 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 14 17:37:26.638514 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 14 17:37:26.638514 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 14 17:37:26.639473 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 14 17:37:26.639473 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:26.639473 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:26.639473 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:26.639473 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:26.639473 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:26.639473 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:26.639473 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:26.639473 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:26.639473 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:26.639473 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:26.639473 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:26.639473 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:26.639473 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:26.639473 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:26.639473 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:26.639473 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:26.640318 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 14 17:37:26.640318 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 14 17:37:26.640318 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 14 17:37:26.640318 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 14 17:37:26.640318 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 14 17:37:26.640318 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 14 17:37:26.640318 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:37:26.640318 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:37:26.640318 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 273/541] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 14 17:37:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 17:37:26.647423 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13e904e-a9a4-4132-b775-15e6735c6514 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:26.665300 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8942df4-d806-4c5b-a55e-ecbdd60c3bd6 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:26.764980 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13e904e-a9a4-4132-b775-15e6735c6514 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:26.796889 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5179ab9-8529-4230-848a-ac4a0fc0f1d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:26.797710 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5179ab9-8529-4230-848a-ac4a0fc0f1d7 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:26.797998 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5179ab9-8529-4230-848a-ac4a0fc0f1d7 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:26.798282 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5179ab9-8529-4230-848a-ac4a0fc0f1d7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:26.814772 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a1cadb-9bc0-44c1-9089-7765fc83e85a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:26.816235 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a1cadb-9bc0-44c1-9089-7765fc83e85a None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:26.816899 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a1cadb-9bc0-44c1-9089-7765fc83e85a None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:26.817189 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a1cadb-9bc0-44c1-9089-7765fc83e85a None admin] PATH_INFO: `/v3/projects` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:26.817993 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a1cadb-9bc0-44c1-9089-7765fc83e85a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:26.818311 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a1cadb-9bc0-44c1-9089-7765fc83e85a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:26.819825 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a1cadb-9bc0-44c1-9089-7765fc83e85a None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:26.826191 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5179ab9-8529-4230-848a-ac4a0fc0f1d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:37:26.834870 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-b5179ab9-8529-4230-848a-ac4a0fc0f1d7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 14 17:37:26.834870 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:26.834870 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:26.834870 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:26.834870 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:26.834870 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:26.834870 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:26.834870 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:26.834870 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:26.834870 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:26.834870 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:26.834870 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:26.834870 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:37:26.834870 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:37:26.834870 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:37:26.834870 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:37:26.835851 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:37:26.835851 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:37:26.835851 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:37:26.835851 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:37:26.835851 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:26.835851 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:26.835851 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:26.835851 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:26.835851 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:26.835851 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:26.835851 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:26.835851 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:26.835851 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:26.835851 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:26.835851 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:26.835851 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:26.836654 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:26.836654 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:26.836654 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:26.836654 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:26.836654 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:37:26.836654 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:37:26.836654 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:37:26.836654 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:37:26.836654 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:37:26.836654 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:37:26.836654 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 14 17:37:26.836654 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:37:26.836654 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 269/542] 10.222.0.36 () {56 vars in 1102 bytes} [Tue Jun 14 17:37:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 393 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 17:37:26.848167 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5179ab9-8529-4230-848a-ac4a0fc0f1d7 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:26.850488 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 274/543] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jun 14 17:37:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:26.860777 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a1cadb-9bc0-44c1-9089-7765fc83e85a None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:26.877173 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:26.960991 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:27.046123 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5179ab9-8529-4230-848a-ac4a0fc0f1d7 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:27.090024 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a1cadb-9bc0-44c1-9089-7765fc83e85a None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:27.116473 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1638967-882e-4835-9f91-8b82dc4b51b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:27.117068 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1638967-882e-4835-9f91-8b82dc4b51b7 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:27.117347 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1638967-882e-4835-9f91-8b82dc4b51b7 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:27.117622 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1638967-882e-4835-9f91-8b82dc4b51b7 None admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:27.118419 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1638967-882e-4835-9f91-8b82dc4b51b7 None admin] RBAC: Adding query filter params (name=service) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:27.118727 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1638967-882e-4835-9f91-8b82dc4b51b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:27.120141 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1638967-882e-4835-9f91-8b82dc4b51b7 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:27.136728 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 270/544] 10.222.0.36 () {56 vars in 1103 bytes} [Tue Jun 14 17:37:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:27.140600 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1638967-882e-4835-9f91-8b82dc4b51b7 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:27.151925 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18fdac5-f4c3-45d7-a6ac-b3adbbbe6399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:27.153362 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18fdac5-f4c3-45d7-a6ac-b3adbbbe6399 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:27.154134 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18fdac5-f4c3-45d7-a6ac-b3adbbbe6399 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:27.154629 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18fdac5-f4c3-45d7-a6ac-b3adbbbe6399 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:27.156027 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18fdac5-f4c3-45d7-a6ac-b3adbbbe6399 None admin] RBAC: Adding query filter params (role.id=ed6a4c87428044ddbc5199cfb05de27e, scope.project.id=f3e1d023a52c42b98d018617987ef83c, user.id=5652329c71cd431fb579d69cef933b37) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:27.156855 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18fdac5-f4c3-45d7-a6ac-b3adbbbe6399 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:27.159503 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18fdac5-f4c3-45d7-a6ac-b3adbbbe6399 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:27.167385 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 275/545] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 14 17:37:26 2022] GET /identity/v3/role_assignments?user.id=5652329c71cd431fb579d69cef933b37&scope.project.id=f3e1d023a52c42b98d018617987ef83c&role.id=ed6a4c87428044ddbc5199cfb05de27e => generated 259 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:27.169013 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67db2a8d-9c33-41e6-a8c7-715cea0d529a None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:27.169508 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67db2a8d-9c33-41e6-a8c7-715cea0d529a None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:27.169989 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67db2a8d-9c33-41e6-a8c7-715cea0d529a None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:27.176832 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 276/546] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:37:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:37:27.178717 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b99ed-0b29-43b3-a43e-f0602fb89904 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:27.179253 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b99ed-0b29-43b3-a43e-f0602fb89904 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:27.180312 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b99ed-0b29-43b3-a43e-f0602fb89904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:27.200839 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-1f0b99ed-0b29-43b3-a43e-f0602fb89904 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:37:27.203127 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-1f0b99ed-0b29-43b3-a43e-f0602fb89904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:37:27.322063 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:27.344416 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 277/547] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:37:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 14 17:37:27.369150 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1638967-882e-4835-9f91-8b82dc4b51b7 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:27.391171 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0b99ed-0b29-43b3-a43e-f0602fb89904 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:27.394145 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:27.419324 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36270cb3-6357-4971-a01c-61c2b6d39adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:27.419324 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36270cb3-6357-4971-a01c-61c2b6d39adf None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:27.419324 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36270cb3-6357-4971-a01c-61c2b6d39adf None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:27.419324 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36270cb3-6357-4971-a01c-61c2b6d39adf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:27.432402 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36270cb3-6357-4971-a01c-61c2b6d39adf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:27.436167 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36270cb3-6357-4971-a01c-61c2b6d39adf None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:27.471253 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-36270cb3-6357-4971-a01c-61c2b6d39adf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:37:27.471253 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:27.471253 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:27.471253 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:27.471253 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:27.471253 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:27.471253 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:27.471253 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:27.471253 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:27.471253 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:27.471253 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:27.471253 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:27.471253 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:37:27.471253 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:37:27.471253 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:37:27.472193 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:37:27.472193 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:27.472193 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:27.472193 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:27.472193 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:27.472193 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:27.472193 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:27.472193 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:27.472193 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:27.472193 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:27.472193 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:27.472193 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:27.472193 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:27.472193 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:27.472193 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:27.472193 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:27.472193 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:27.473606 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:37:27.473606 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:37:27.473606 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:37:27.473606 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:37:27.473606 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 271/548] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 14 17:37:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:37:27.479980 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36270cb3-6357-4971-a01c-61c2b6d39adf None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:27.621952 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0b99ed-0b29-43b3-a43e-f0602fb89904 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:27.653491 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36270cb3-6357-4971-a01c-61c2b6d39adf None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:27.661586 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ef9900-0577-47a6-8b46-ca11dcc50bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:27.662410 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ef9900-0577-47a6-8b46-ca11dcc50bde None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:27.662691 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ef9900-0577-47a6-8b46-ca11dcc50bde None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:27.662983 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ef9900-0577-47a6-8b46-ca11dcc50bde None admin] PATH_INFO: `/v3/roles/service` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:27.674256 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ef9900-0577-47a6-8b46-ca11dcc50bde None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:37:27.682585 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-14ef9900-0577-47a6-8b46-ca11dcc50bde None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 14 17:37:27.682585 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:27.682585 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:27.682585 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:27.682585 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:27.682585 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:27.682585 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:27.682585 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:27.682585 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:27.682585 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:27.682585 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:27.682585 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:27.682585 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:37:27.682585 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:37:27.682585 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:37:27.682585 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:37:27.683559 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:37:27.683559 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:37:27.683559 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:37:27.683559 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:37:27.683559 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:27.683559 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:27.683559 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:27.683559 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:27.683559 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:27.683559 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:27.683559 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:27.683559 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:27.683559 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:27.683559 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:27.683559 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:27.683559 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:27.684373 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:27.684373 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:27.684373 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:27.684373 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:27.684373 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:37:27.684373 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:37:27.684373 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:37:27.684373 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:37:27.684373 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:37:27.684373 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:37:27.684373 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 14 17:37:27.684373 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:37:27.684373 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 278/549] 10.222.0.36 () {56 vars in 1102 bytes} [Tue Jun 14 17:37:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:37:27.691958 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ef9900-0577-47a6-8b46-ca11dcc50bde None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:27.728576 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cf6eb4-3820-42eb-b0cd-9f68bfbaa160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:27.729254 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cf6eb4-3820-42eb-b0cd-9f68bfbaa160 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:27.729535 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cf6eb4-3820-42eb-b0cd-9f68bfbaa160 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:27.729809 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cf6eb4-3820-42eb-b0cd-9f68bfbaa160 None admin] PATH_INFO: `/v3/domains` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:27.730540 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cf6eb4-3820-42eb-b0cd-9f68bfbaa160 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:27.730849 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cf6eb4-3820-42eb-b0cd-9f68bfbaa160 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:27.732251 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cf6eb4-3820-42eb-b0cd-9f68bfbaa160 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:27.752334 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 272/550] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 14 17:37:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:27.760212 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cf6eb4-3820-42eb-b0cd-9f68bfbaa160 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:27.808016 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:27.815731 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:27.890052 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ef9900-0577-47a6-8b46-ca11dcc50bde None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:27.921298 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cf6eb4-3820-42eb-b0cd-9f68bfbaa160 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:27.932448 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f251ea0-41e7-4614-92f8-8ae2bd089a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:27.933122 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f251ea0-41e7-4614-92f8-8ae2bd089a79 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:27.933407 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f251ea0-41e7-4614-92f8-8ae2bd089a79 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:27.933683 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f251ea0-41e7-4614-92f8-8ae2bd089a79 None admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:27.934803 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f251ea0-41e7-4614-92f8-8ae2bd089a79 None admin] RBAC: Adding query filter params (name=service) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:27.935116 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f251ea0-41e7-4614-92f8-8ae2bd089a79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:27.937101 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f251ea0-41e7-4614-92f8-8ae2bd089a79 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:27.952129 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 279/551] 10.222.0.36 () {56 vars in 1103 bytes} [Tue Jun 14 17:37:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:27.952129 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356e9c1c-c018-4ca0-ba8c-5376b4c0e1c1 None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:27.952129 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356e9c1c-c018-4ca0-ba8c-5376b4c0e1c1 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:27.952129 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356e9c1c-c018-4ca0-ba8c-5376b4c0e1c1 None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:27.952129 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 280/552] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:37:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:37:27.953791 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356e9c1c-c018-4ca0-ba8c-5376b4c0e1c1 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:27.974040 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495f3c48-7ed6-468a-a636-3bcfa16826e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:27.975358 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495f3c48-7ed6-468a-a636-3bcfa16826e1 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:27.975862 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495f3c48-7ed6-468a-a636-3bcfa16826e1 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:27.976351 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495f3c48-7ed6-468a-a636-3bcfa16826e1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:27.984736 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495f3c48-7ed6-468a-a636-3bcfa16826e1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:27.986816 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495f3c48-7ed6-468a-a636-3bcfa16826e1 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:28.003688 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-495f3c48-7ed6-468a-a636-3bcfa16826e1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 14 17:37:28.003688 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:28.003688 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:28.003688 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:28.003688 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:28.003688 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:28.003688 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:28.003688 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:28.003688 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:28.003688 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:28.003688 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:28.003688 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:28.003688 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 14 17:37:28.003688 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 14 17:37:28.003688 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 14 17:37:28.003688 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 14 17:37:28.004932 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:28.004932 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:28.004932 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 14 17:37:28.004932 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:37:28.004932 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 14 17:37:28.004932 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:37:28.004932 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:28.004932 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:28.004932 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:28.004932 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:28.004932 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:28.004932 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:28.004932 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:28.004932 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:28.004932 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:28.004932 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:28.004932 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:28.004932 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:28.005953 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:28.005953 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:28.005953 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 14 17:37:28.005953 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 14 17:37:28.005953 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 14 17:37:28.005953 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 14 17:37:28.005953 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 14 17:37:28.005953 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 14 17:37:28.005953 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 14 17:37:28.005953 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:37:28.013168 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 273/553] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jun 14 17:37:27 2022] GET /identity/v3/users/swift => generated 83 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:37:28.014928 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47da411-3042-40c5-9482-f89ea189f9f6 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:28.015597 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47da411-3042-40c5-9482-f89ea189f9f6 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:28.016089 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47da411-3042-40c5-9482-f89ea189f9f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:28.035414 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-b47da411-3042-40c5-9482-f89ea189f9f6 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:37:28.037090 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-b47da411-3042-40c5-9482-f89ea189f9f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:37:28.078040 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356e9c1c-c018-4ca0-ba8c-5376b4c0e1c1 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:28.104836 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:28.125657 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 274/554] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:37:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:37:28.126414 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de12e06-17c8-4ed8-b775-ad96c85f9b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:28.127195 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47da411-3042-40c5-9482-f89ea189f9f6 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:28.127353 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de12e06-17c8-4ed8-b775-ad96c85f9b49 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:28.127612 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de12e06-17c8-4ed8-b775-ad96c85f9b49 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:28.127943 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de12e06-17c8-4ed8-b775-ad96c85f9b49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:28.144237 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de12e06-17c8-4ed8-b775-ad96c85f9b49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:28.144237 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de12e06-17c8-4ed8-b775-ad96c85f9b49 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:28.149087 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:28.161639 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-3de12e06-17c8-4ed8-b775-ad96c85f9b49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:37:28.161639 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:28.161639 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:28.161639 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:28.161639 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:28.161639 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:28.161639 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:28.161639 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:28.161639 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:28.161639 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:28.161639 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:28.161639 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:28.161639 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:37:28.161639 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:37:28.161639 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:37:28.162590 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:37:28.162590 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:28.162590 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:28.162590 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:28.162590 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:28.162590 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:28.162590 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:28.162590 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:28.162590 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:28.162590 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:28.162590 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:28.162590 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:28.162590 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:28.162590 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:28.162590 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:28.162590 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:28.162590 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:28.163501 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:37:28.163501 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:37:28.163501 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:37:28.163501 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:37:28.163501 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 281/555] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 14 17:37:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 17:37:28.168355 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de12e06-17c8-4ed8-b775-ad96c85f9b49 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:28.242945 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47da411-3042-40c5-9482-f89ea189f9f6 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:28.280240 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de12e06-17c8-4ed8-b775-ad96c85f9b49 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:28.281800 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89efb39-af80-4510-b9b8-57dff287f810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:28.282837 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89efb39-af80-4510-b9b8-57dff287f810 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:28.283383 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89efb39-af80-4510-b9b8-57dff287f810 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:28.284683 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89efb39-af80-4510-b9b8-57dff287f810 None admin] PATH_INFO: `/v3/users` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:28.285743 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89efb39-af80-4510-b9b8-57dff287f810 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:28.286258 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89efb39-af80-4510-b9b8-57dff287f810 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:28.287978 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89efb39-af80-4510-b9b8-57dff287f810 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:28.312945 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 275/556] 10.222.0.36 () {56 vars in 1135 bytes} [Tue Jun 14 17:37:28 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:28.314240 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89efb39-af80-4510-b9b8-57dff287f810 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:28.318848 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08eaeab-6823-456c-a060-d0e9a0520915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:28.319228 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08eaeab-6823-456c-a060-d0e9a0520915 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:28.319541 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08eaeab-6823-456c-a060-d0e9a0520915 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:28.319817 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08eaeab-6823-456c-a060-d0e9a0520915 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:28.331210 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08eaeab-6823-456c-a060-d0e9a0520915 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:37:28.339745 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-b08eaeab-6823-456c-a060-d0e9a0520915 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 14 17:37:28.339745 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:28.339745 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:28.339745 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:28.339745 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:28.339745 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:28.339745 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:28.339745 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:28.339745 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:28.339745 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:28.339745 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:28.339745 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:28.339745 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:37:28.339745 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:37:28.339745 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:37:28.339745 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:37:28.340668 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:37:28.340668 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:37:28.340668 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:37:28.340668 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:37:28.340668 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:28.340668 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:28.340668 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:28.340668 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:28.340668 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:28.340668 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:28.340668 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:28.340668 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:28.340668 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:28.340668 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:28.340668 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:28.340668 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:28.341945 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:28.341945 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:28.341945 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:28.341945 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:28.341945 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:37:28.341945 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:37:28.341945 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:37:28.341945 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:37:28.341945 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:37:28.341945 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:37:28.341945 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 14 17:37:28.341945 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:37:28.341945 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 282/557] 10.222.0.36 () {56 vars in 1102 bytes} [Tue Jun 14 17:37:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:37:28.342623 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08eaeab-6823-456c-a060-d0e9a0520915 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:28.377236 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:28.407674 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:28.435803 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89efb39-af80-4510-b9b8-57dff287f810 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:28.468752 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08eaeab-6823-456c-a060-d0e9a0520915 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:28.477606 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86a4ad4-f8f0-4d9d-a434-109701d2d795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:28.478983 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86a4ad4-f8f0-4d9d-a434-109701d2d795 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:28.479279 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86a4ad4-f8f0-4d9d-a434-109701d2d795 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:28.479619 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86a4ad4-f8f0-4d9d-a434-109701d2d795 None admin] PATH_INFO: `/v3/domains` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:28.480843 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86a4ad4-f8f0-4d9d-a434-109701d2d795 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:28.481172 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86a4ad4-f8f0-4d9d-a434-109701d2d795 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:28.482987 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86a4ad4-f8f0-4d9d-a434-109701d2d795 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:28.496827 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 276/558] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 14 17:37:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:28.496827 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86a4ad4-f8f0-4d9d-a434-109701d2d795 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:28.517002 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58477dd3-65f1-4338-91e2-89301a565e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:28.517678 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58477dd3-65f1-4338-91e2-89301a565e67 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:28.517966 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58477dd3-65f1-4338-91e2-89301a565e67 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:28.518338 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58477dd3-65f1-4338-91e2-89301a565e67 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:28.592471 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58477dd3-65f1-4338-91e2-89301a565e67 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:28.593923 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58477dd3-65f1-4338-91e2-89301a565e67 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:28.611400 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86a4ad4-f8f0-4d9d-a434-109701d2d795 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:28.628280 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:28.649844 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee7f0e6-9eed-4458-a778-1e87e9744fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:28.650787 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee7f0e6-9eed-4458-a778-1e87e9744fb3 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:28.651242 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee7f0e6-9eed-4458-a778-1e87e9744fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:28.651694 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee7f0e6-9eed-4458-a778-1e87e9744fb3 None admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:28.652585 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee7f0e6-9eed-4458-a778-1e87e9744fb3 None admin] RBAC: Adding query filter params (name=service) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:28.653059 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee7f0e6-9eed-4458-a778-1e87e9744fb3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:28.654583 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee7f0e6-9eed-4458-a778-1e87e9744fb3 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:28.656185 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:28.665240 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 277/559] 10.222.0.36 () {56 vars in 1103 bytes} [Tue Jun 14 17:37:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:28.666543 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605f5436-98fe-4726-9375-e32fceafb5a9 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:28.666834 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605f5436-98fe-4726-9375-e32fceafb5a9 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:28.667114 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605f5436-98fe-4726-9375-e32fceafb5a9 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:28.668536 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 278/560] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:37:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:37:28.669066 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605f5436-98fe-4726-9375-e32fceafb5a9 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:28.715786 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 283/561] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 14 17:37:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 14 17:37:28.715786 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58477dd3-65f1-4338-91e2-89301a565e67 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:28.784805 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605f5436-98fe-4726-9375-e32fceafb5a9 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:28.822480 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7b6edc-4875-4677-93be-76f0906fe410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:28.823272 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7b6edc-4875-4677-93be-76f0906fe410 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:28.823585 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7b6edc-4875-4677-93be-76f0906fe410 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:28.823863 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7b6edc-4875-4677-93be-76f0906fe410 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:28.828241 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58477dd3-65f1-4338-91e2-89301a565e67 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:28.831627 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7b6edc-4875-4677-93be-76f0906fe410 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:28.833093 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7b6edc-4875-4677-93be-76f0906fe410 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:28.848108 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-0f7b6edc-4875-4677-93be-76f0906fe410 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 14 17:37:28.848108 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:28.848108 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:28.848108 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:28.848108 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:28.848108 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:28.848108 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:28.848108 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:28.848108 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:28.848108 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:28.848108 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:28.848108 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:28.848108 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 14 17:37:28.848108 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 14 17:37:28.848108 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 14 17:37:28.848108 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 14 17:37:28.849123 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:28.849123 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:28.849123 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 14 17:37:28.849123 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:37:28.849123 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 14 17:37:28.849123 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:37:28.849123 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:28.849123 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:28.849123 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:28.849123 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:28.849123 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:28.849123 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:28.849123 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:28.849123 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:28.849123 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:28.849123 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:28.849123 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:28.849123 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:28.850061 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:28.850061 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:28.850061 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 14 17:37:28.850061 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 14 17:37:28.850061 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 14 17:37:28.850061 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 14 17:37:28.850061 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 14 17:37:28.850061 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 14 17:37:28.850061 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 14 17:37:28.850061 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:37:28.850061 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 279/562] 10.222.0.36 () {56 vars in 1093 bytes} [Tue Jun 14 17:37:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:37:28.850729 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae44e25d-3bf0-4194-960f-af5852c6dd45 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:28.851326 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae44e25d-3bf0-4194-960f-af5852c6dd45 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:28.851326 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae44e25d-3bf0-4194-960f-af5852c6dd45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:28.868112 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:28.870290 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-ae44e25d-3bf0-4194-960f-af5852c6dd45 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:37:28.871517 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-ae44e25d-3bf0-4194-960f-af5852c6dd45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:37:28.875808 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdec2581-f155-4d12-8e17-b6e5f5857872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:28.876641 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdec2581-f155-4d12-8e17-b6e5f5857872 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:28.876991 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdec2581-f155-4d12-8e17-b6e5f5857872 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:28.877375 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdec2581-f155-4d12-8e17-b6e5f5857872 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:28.891875 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdec2581-f155-4d12-8e17-b6e5f5857872 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:28.893834 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdec2581-f155-4d12-8e17-b6e5f5857872 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:28.912993 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-fdec2581-f155-4d12-8e17-b6e5f5857872 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:37:28.912993 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:28.912993 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:28.912993 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:28.912993 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:28.912993 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:28.912993 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:28.912993 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:28.912993 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:28.912993 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:28.912993 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:28.912993 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:28.912993 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:37:28.912993 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:37:28.912993 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:37:28.914047 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:37:28.914047 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:28.914047 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:28.914047 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:28.914047 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:28.914047 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:28.914047 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:28.914047 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:28.914047 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:28.914047 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:28.914047 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:28.914047 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:28.914047 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:28.914047 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:28.914047 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:28.914047 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:28.914047 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:28.915047 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:37:28.915047 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:37:28.915047 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:37:28.915047 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:37:28.921623 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 284/563] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 14 17:37:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:37:28.921623 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdec2581-f155-4d12-8e17-b6e5f5857872 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:28.949688 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:28.966872 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 280/564] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:37:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:37:28.967876 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae44e25d-3bf0-4194-960f-af5852c6dd45 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:29.048846 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdec2581-f155-4d12-8e17-b6e5f5857872 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:29.087551 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae44e25d-3bf0-4194-960f-af5852c6dd45 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:29.088209 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06092c0a-05b1-43d6-a941-be3d2af79a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:29.089064 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06092c0a-05b1-43d6-a941-be3d2af79a10 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:29.089355 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06092c0a-05b1-43d6-a941-be3d2af79a10 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:29.089632 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06092c0a-05b1-43d6-a941-be3d2af79a10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:29.101135 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06092c0a-05b1-43d6-a941-be3d2af79a10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:29.102592 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06092c0a-05b1-43d6-a941-be3d2af79a10 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:29.121173 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-06092c0a-05b1-43d6-a941-be3d2af79a10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:37:29.121173 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:29.121173 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:29.121173 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:29.121173 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:29.121173 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:29.121173 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:29.121173 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:29.121173 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:29.121173 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:29.121173 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:29.121173 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:29.121173 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:37:29.121173 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:37:29.121173 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:37:29.122108 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:37:29.122108 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:29.122108 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:29.122108 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:29.122108 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:29.122108 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:29.122108 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:29.122108 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:29.122108 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:29.122108 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:29.122108 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:29.122108 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:29.122108 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:29.122108 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:29.122108 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:29.122108 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:29.122108 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:29.122980 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:37:29.122980 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:37:29.122980 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:37:29.122980 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:37:29.122980 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 285/565] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 14 17:37:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:37:29.123268 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06092c0a-05b1-43d6-a941-be3d2af79a10 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:29.132977 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c584d351-38ef-4ea5-86a1-caf5ebfebcd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:29.133730 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c584d351-38ef-4ea5-86a1-caf5ebfebcd0 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:29.134023 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c584d351-38ef-4ea5-86a1-caf5ebfebcd0 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:29.134360 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c584d351-38ef-4ea5-86a1-caf5ebfebcd0 None admin] PATH_INFO: `/v3/users` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:29.135248 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c584d351-38ef-4ea5-86a1-caf5ebfebcd0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:29.135589 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c584d351-38ef-4ea5-86a1-caf5ebfebcd0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:29.137076 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c584d351-38ef-4ea5-86a1-caf5ebfebcd0 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:29.161768 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 281/566] 10.222.0.36 () {56 vars in 1133 bytes} [Tue Jun 14 17:37:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:29.162728 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c584d351-38ef-4ea5-86a1-caf5ebfebcd0 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:29.168379 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:29.213266 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:29.248955 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06092c0a-05b1-43d6-a941-be3d2af79a10 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:29.275127 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c584d351-38ef-4ea5-86a1-caf5ebfebcd0 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:29.288802 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7634c9c9-4abc-416f-a3fe-8f3d1e6a2851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:29.289468 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7634c9c9-4abc-416f-a3fe-8f3d1e6a2851 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:29.289748 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7634c9c9-4abc-416f-a3fe-8f3d1e6a2851 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:29.290026 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7634c9c9-4abc-416f-a3fe-8f3d1e6a2851 None admin] PATH_INFO: `/v3/domains` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:29.290748 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7634c9c9-4abc-416f-a3fe-8f3d1e6a2851 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:29.291066 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7634c9c9-4abc-416f-a3fe-8f3d1e6a2851 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:29.292466 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7634c9c9-4abc-416f-a3fe-8f3d1e6a2851 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:29.310145 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 286/567] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 14 17:37:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:29.310145 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7634c9c9-4abc-416f-a3fe-8f3d1e6a2851 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:29.322193 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5710992e-ce8b-4bab-99ec-d04375c592f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:29.322993 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5710992e-ce8b-4bab-99ec-d04375c592f4 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:29.323473 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5710992e-ce8b-4bab-99ec-d04375c592f4 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:29.323580 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5710992e-ce8b-4bab-99ec-d04375c592f4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:29.334925 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5710992e-ce8b-4bab-99ec-d04375c592f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:37:29.343340 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-5710992e-ce8b-4bab-99ec-d04375c592f4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 14 17:37:29.343340 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:29.343340 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:29.343340 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:29.343340 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:29.343340 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:29.343340 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:29.343340 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:29.343340 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:29.343340 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:29.343340 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:29.343340 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:29.343340 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:37:29.343340 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:37:29.343340 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:37:29.343340 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:37:29.344459 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:37:29.344459 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:37:29.344459 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:37:29.344459 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:37:29.344459 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:29.344459 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:29.344459 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:29.344459 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:29.344459 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:29.344459 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:29.344459 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:29.344459 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:29.344459 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:29.344459 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:29.344459 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:29.344459 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:29.345298 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:29.345298 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:29.345298 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:29.345298 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:29.345298 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:37:29.345298 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:37:29.345298 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:37:29.345298 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:37:29.345298 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:37:29.345298 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:37:29.345298 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 14 17:37:29.345298 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:37:29.345298 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 282/568] 10.222.0.36 () {56 vars in 1102 bytes} [Tue Jun 14 17:37:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:37:29.347328 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5710992e-ce8b-4bab-99ec-d04375c592f4 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:29.413343 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:29.420869 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7634c9c9-4abc-416f-a3fe-8f3d1e6a2851 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:29.457793 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1433e8e5-507b-4696-9ce7-47c2b4d1fec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:29.458458 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1433e8e5-507b-4696-9ce7-47c2b4d1fec7 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:29.458746 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1433e8e5-507b-4696-9ce7-47c2b4d1fec7 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:29.459020 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1433e8e5-507b-4696-9ce7-47c2b4d1fec7 None admin] PATH_INFO: `/v3/domains` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:29.459787 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1433e8e5-507b-4696-9ce7-47c2b4d1fec7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:29.460163 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1433e8e5-507b-4696-9ce7-47c2b4d1fec7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:29.461527 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1433e8e5-507b-4696-9ce7-47c2b4d1fec7 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:29.462232 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5710992e-ce8b-4bab-99ec-d04375c592f4 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:29.465138 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:29.474955 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 287/569] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 14 17:37:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:29.475967 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1433e8e5-507b-4696-9ce7-47c2b4d1fec7 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:29.510528 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7f2735-ac0b-4f56-a4b9-5fcab9ad4ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:29.511379 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7f2735-ac0b-4f56-a4b9-5fcab9ad4ee3 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:29.511679 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7f2735-ac0b-4f56-a4b9-5fcab9ad4ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:29.512259 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7f2735-ac0b-4f56-a4b9-5fcab9ad4ee3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:29.524884 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7f2735-ac0b-4f56-a4b9-5fcab9ad4ee3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:29.526361 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7f2735-ac0b-4f56-a4b9-5fcab9ad4ee3 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:29.545350 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-3f7f2735-ac0b-4f56-a4b9-5fcab9ad4ee3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:37:29.545350 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:29.545350 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:29.545350 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:29.545350 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:29.545350 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:29.545350 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:29.545350 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:29.545350 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:29.545350 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:29.545350 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:29.545350 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:29.545350 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:37:29.545350 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:37:29.545350 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:37:29.546267 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:37:29.546267 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:29.546267 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:29.546267 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:29.546267 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:29.546267 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:29.546267 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:29.546267 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:29.546267 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:29.546267 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:29.546267 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:29.546267 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:29.546267 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:29.546267 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:29.546267 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:29.546267 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:29.546267 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:29.547169 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:37:29.547169 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:37:29.547169 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:37:29.547169 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:37:29.547169 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 283/570] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 14 17:37:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:37:29.547486 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7f2735-ac0b-4f56-a4b9-5fcab9ad4ee3 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:29.589347 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1433e8e5-507b-4696-9ce7-47c2b4d1fec7 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:29.624870 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ffbbcd-70ea-4a11-95b6-04ada5bdf150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:29.625715 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ffbbcd-70ea-4a11-95b6-04ada5bdf150 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:29.625999 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ffbbcd-70ea-4a11-95b6-04ada5bdf150 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:29.626281 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ffbbcd-70ea-4a11-95b6-04ada5bdf150 None admin] PATH_INFO: `/v3/users/glance` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:29.634175 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ffbbcd-70ea-4a11-95b6-04ada5bdf150 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:29.635640 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ffbbcd-70ea-4a11-95b6-04ada5bdf150 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:29.650609 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-14ffbbcd-70ea-4a11-95b6-04ada5bdf150 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 14 17:37:29.650609 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:29.650609 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:29.650609 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:29.650609 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:29.650609 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:29.650609 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:29.650609 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:29.650609 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:29.650609 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:29.650609 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:29.650609 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:29.650609 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 14 17:37:29.650609 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 14 17:37:29.650609 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 14 17:37:29.650609 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 14 17:37:29.651713 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:29.651713 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:29.651713 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 14 17:37:29.651713 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:37:29.651713 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 14 17:37:29.651713 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:37:29.651713 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:29.651713 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:29.651713 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:29.651713 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:29.651713 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:29.651713 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:29.651713 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:29.651713 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:29.651713 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:29.651713 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:29.651713 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:29.651713 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:29.652677 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:29.652677 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:29.652677 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 14 17:37:29.652677 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 14 17:37:29.652677 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 14 17:37:29.652677 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 14 17:37:29.652677 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 14 17:37:29.652677 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 14 17:37:29.652677 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 14 17:37:29.652677 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:37:29.652677 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 288/571] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 14 17:37:29 2022] GET /identity/v3/users/glance => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:37:29.652677 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ffbbcd-70ea-4a11-95b6-04ada5bdf150 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:29.660420 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7f2735-ac0b-4f56-a4b9-5fcab9ad4ee3 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:29.668875 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:29.695746 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db15c434-4b20-4955-b0d7-dd0fa838fb5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:29.696426 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db15c434-4b20-4955-b0d7-dd0fa838fb5e None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:29.696712 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db15c434-4b20-4955-b0d7-dd0fa838fb5e None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:29.696997 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db15c434-4b20-4955-b0d7-dd0fa838fb5e None admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:29.697800 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db15c434-4b20-4955-b0d7-dd0fa838fb5e None admin] RBAC: Adding query filter params (name=service) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:29.698114 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db15c434-4b20-4955-b0d7-dd0fa838fb5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:29.699530 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db15c434-4b20-4955-b0d7-dd0fa838fb5e None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:29.709206 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 284/572] 10.222.0.36 () {56 vars in 1103 bytes} [Tue Jun 14 17:37:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:29.710018 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db15c434-4b20-4955-b0d7-dd0fa838fb5e None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:29.730777 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:29.756639 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ffbbcd-70ea-4a11-95b6-04ada5bdf150 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:29.800853 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b771cb3-2240-4bb1-9766-92c8e107f381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:29.801658 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b771cb3-2240-4bb1-9766-92c8e107f381 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:29.801944 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b771cb3-2240-4bb1-9766-92c8e107f381 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:29.802233 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b771cb3-2240-4bb1-9766-92c8e107f381 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:29.809221 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b771cb3-2240-4bb1-9766-92c8e107f381 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:29.810678 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b771cb3-2240-4bb1-9766-92c8e107f381 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:29.821814 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db15c434-4b20-4955-b0d7-dd0fa838fb5e None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:29.825026 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-1b771cb3-2240-4bb1-9766-92c8e107f381 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:37:29.825026 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:29.825026 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:29.825026 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:29.825026 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:29.825026 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:29.825026 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:29.825026 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:29.825026 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:29.825026 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:29.825026 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:29.825026 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:29.825026 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 14 17:37:29.825026 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 14 17:37:29.825026 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 14 17:37:29.826217 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 14 17:37:29.826217 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:29.826217 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:29.826217 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:29.826217 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:29.826217 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:29.826217 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:29.826217 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:29.826217 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:29.826217 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:29.826217 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:29.826217 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:29.826217 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:29.826217 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:29.826217 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:29.826217 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:29.826217 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:29.827497 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 14 17:37:29.827497 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 14 17:37:29.827497 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 14 17:37:29.827497 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 14 17:37:29.827497 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 14 17:37:29.827497 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 14 17:37:29.827497 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:37:29.827497 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:37:29.827497 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 289/573] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 14 17:37:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:37:29.827978 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f9a4e-5495-4ac0-9403-0f2355945c3a None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:29.828045 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f9a4e-5495-4ac0-9403-0f2355945c3a None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:29.828305 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f9a4e-5495-4ac0-9403-0f2355945c3a None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:29.829556 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 290/574] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:37:29 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:37:29.830233 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3f9a4e-5495-4ac0-9403-0f2355945c3a None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:29.860980 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40de1eb-b62c-436e-acb8-084a22942778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:29.861643 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40de1eb-b62c-436e-acb8-084a22942778 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:29.861952 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40de1eb-b62c-436e-acb8-084a22942778 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:29.862297 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40de1eb-b62c-436e-acb8-084a22942778 None admin] PATH_INFO: `/v3/domains` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:29.863021 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40de1eb-b62c-436e-acb8-084a22942778 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:29.863357 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40de1eb-b62c-436e-acb8-084a22942778 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:29.864722 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40de1eb-b62c-436e-acb8-084a22942778 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:29.876448 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 285/575] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 14 17:37:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:29.877258 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40de1eb-b62c-436e-acb8-084a22942778 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:29.918938 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:29.944884 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3f9a4e-5495-4ac0-9403-0f2355945c3a None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:29.958150 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:29.979506 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3258601-e458-4eeb-9a66-cf2648f93999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:29.980128 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3258601-e458-4eeb-9a66-cf2648f93999 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:29.980413 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3258601-e458-4eeb-9a66-cf2648f93999 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:29.980510 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40de1eb-b62c-436e-acb8-084a22942778 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:29.980693 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3258601-e458-4eeb-9a66-cf2648f93999 None admin] PATH_INFO: `/v3/users` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:29.981578 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3258601-e458-4eeb-9a66-cf2648f93999 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:29.981848 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3258601-e458-4eeb-9a66-cf2648f93999 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:29.983318 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3258601-e458-4eeb-9a66-cf2648f93999 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:30.001016 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 291/576] 10.222.0.36 () {56 vars in 1137 bytes} [Tue Jun 14 17:37:29 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:30.001833 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3258601-e458-4eeb-9a66-cf2648f93999 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:30.015985 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f5a046-9648-41b1-b394-b300adf9daa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:30.016795 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f5a046-9648-41b1-b394-b300adf9daa4 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:30.017083 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f5a046-9648-41b1-b394-b300adf9daa4 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:30.017366 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f5a046-9648-41b1-b394-b300adf9daa4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:30.027956 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f5a046-9648-41b1-b394-b300adf9daa4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:30.029403 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f5a046-9648-41b1-b394-b300adf9daa4 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:30.047102 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-48f5a046-9648-41b1-b394-b300adf9daa4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:37:30.047102 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:30.047102 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:30.047102 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:30.047102 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:30.047102 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:30.047102 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:30.047102 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:30.047102 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:30.047102 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:30.047102 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:30.047102 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:30.047102 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:37:30.047102 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:37:30.047102 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:37:30.048048 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:37:30.048048 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:30.048048 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:30.048048 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:30.048048 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:30.048048 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:30.048048 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:30.048048 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:30.048048 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:30.048048 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:30.048048 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:30.048048 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:30.048048 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:30.048048 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:30.048048 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:30.048048 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:30.048048 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:30.048952 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:37:30.048952 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:37:30.048952 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:37:30.048952 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:37:30.051447 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 286/577] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 14 17:37:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:37:30.053026 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac14895b-e3ef-4a0c-b9c6-5c322fe220f9 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:30.053496 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac14895b-e3ef-4a0c-b9c6-5c322fe220f9 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:30.053784 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac14895b-e3ef-4a0c-b9c6-5c322fe220f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:30.069769 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-ac14895b-e3ef-4a0c-b9c6-5c322fe220f9 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:37:30.070961 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-ac14895b-e3ef-4a0c-b9c6-5c322fe220f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:37:30.104149 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3258601-e458-4eeb-9a66-cf2648f93999 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:30.135150 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:30.139965 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dc57b2-1df0-4661-88c1-393ab8255a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:30.140714 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dc57b2-1df0-4661-88c1-393ab8255a8e None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:30.140912 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dc57b2-1df0-4661-88c1-393ab8255a8e None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:30.141193 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dc57b2-1df0-4661-88c1-393ab8255a8e None admin] PATH_INFO: `/v3/projects` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:30.141984 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dc57b2-1df0-4661-88c1-393ab8255a8e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:30.142300 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dc57b2-1df0-4661-88c1-393ab8255a8e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:30.143984 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dc57b2-1df0-4661-88c1-393ab8255a8e None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:30.146068 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 287/578] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:37:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:37:30.146815 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac14895b-e3ef-4a0c-b9c6-5c322fe220f9 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:30.161373 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 292/579] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jun 14 17:37:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:30.161373 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dc57b2-1df0-4661-88c1-393ab8255a8e None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:30.208345 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:30.249984 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac14895b-e3ef-4a0c-b9c6-5c322fe220f9 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:30.266604 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dc57b2-1df0-4661-88c1-393ab8255a8e None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:30.286364 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978332d9-ffa6-4b8e-9bee-17ecfaa9853b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:30.287169 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978332d9-ffa6-4b8e-9bee-17ecfaa9853b None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:30.287491 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978332d9-ffa6-4b8e-9bee-17ecfaa9853b None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:30.287772 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978332d9-ffa6-4b8e-9bee-17ecfaa9853b None admin] PATH_INFO: `/v3/projects/service` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:30.294436 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978332d9-ffa6-4b8e-9bee-17ecfaa9853b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:30.295924 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978332d9-ffa6-4b8e-9bee-17ecfaa9853b None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:30.301424 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131f4480-6286-4637-82c6-12b639534513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:30.302264 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131f4480-6286-4637-82c6-12b639534513 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:30.302553 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131f4480-6286-4637-82c6-12b639534513 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:30.302832 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131f4480-6286-4637-82c6-12b639534513 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:30.310380 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-978332d9-ffa6-4b8e-9bee-17ecfaa9853b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:37:30.310380 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:30.310380 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:30.310380 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:30.310380 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:30.310380 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:30.310380 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:30.310380 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:30.310380 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:30.310380 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:30.310380 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:30.310380 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:30.310380 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 14 17:37:30.310380 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 14 17:37:30.310380 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 14 17:37:30.321334 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 14 17:37:30.321334 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:30.321334 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:30.321334 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:30.321334 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:30.321334 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:30.321334 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:30.321334 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:30.321334 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:30.321334 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:30.321334 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:30.321334 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:30.321334 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:30.321334 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:30.321334 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:30.321334 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:30.321334 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:30.322575 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 14 17:37:30.322575 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 14 17:37:30.322575 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 14 17:37:30.322575 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 14 17:37:30.322575 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 14 17:37:30.322575 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 14 17:37:30.322575 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:37:30.322575 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:37:30.322575 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 288/580] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 14 17:37:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:37:30.322575 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978332d9-ffa6-4b8e-9bee-17ecfaa9853b None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:30.324425 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131f4480-6286-4637-82c6-12b639534513 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:30.325893 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131f4480-6286-4637-82c6-12b639534513 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:30.343925 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-131f4480-6286-4637-82c6-12b639534513 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:37:30.343925 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:30.343925 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:30.343925 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:30.343925 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:30.343925 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:30.343925 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:30.343925 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:30.343925 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:30.343925 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:30.343925 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:30.343925 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:30.343925 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:37:30.343925 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:37:30.343925 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:37:30.344825 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:37:30.344825 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:30.344825 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:30.344825 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:30.344825 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:30.344825 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:30.344825 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:30.344825 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:30.344825 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:30.344825 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:30.344825 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:30.344825 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:30.344825 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:30.344825 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:30.344825 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:30.344825 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:30.344825 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:30.345719 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:37:30.345719 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:37:30.345719 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:37:30.345719 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:37:30.345719 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 293/581] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 14 17:37:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:37:30.345992 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131f4480-6286-4637-82c6-12b639534513 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:30.401658 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:30.422926 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978332d9-ffa6-4b8e-9bee-17ecfaa9853b None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:30.443631 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:30.456186 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131f4480-6286-4637-82c6-12b639534513 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:30.457952 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a5ba9e-805c-4294-be58-926f7928d77b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:30.458619 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a5ba9e-805c-4294-be58-926f7928d77b None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:30.458910 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a5ba9e-805c-4294-be58-926f7928d77b None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:30.459193 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a5ba9e-805c-4294-be58-926f7928d77b None admin] PATH_INFO: `/v3/domains` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:30.459954 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a5ba9e-805c-4294-be58-926f7928d77b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:30.460270 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a5ba9e-805c-4294-be58-926f7928d77b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:30.461646 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a5ba9e-805c-4294-be58-926f7928d77b None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:30.473370 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 289/582] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 14 17:37:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:30.474182 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a5ba9e-805c-4294-be58-926f7928d77b None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:30.492731 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526a4428-228d-4d10-aff0-4e58a878e2af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:30.493398 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526a4428-228d-4d10-aff0-4e58a878e2af None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:30.493687 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526a4428-228d-4d10-aff0-4e58a878e2af None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:30.493971 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526a4428-228d-4d10-aff0-4e58a878e2af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:30.494806 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526a4428-228d-4d10-aff0-4e58a878e2af None admin] RBAC: Adding query filter params (role.id=ed6a4c87428044ddbc5199cfb05de27e, scope.project.id=f3e1d023a52c42b98d018617987ef83c, user.id=ba38b47a31b14526be0aa2054841881b) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:30.495128 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526a4428-228d-4d10-aff0-4e58a878e2af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:30.496642 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526a4428-228d-4d10-aff0-4e58a878e2af None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:30.503558 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 294/583] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 14 17:37:30 2022] GET /identity/v3/role_assignments?user.id=ba38b47a31b14526be0aa2054841881b&scope.project.id=f3e1d023a52c42b98d018617987ef83c&role.id=ed6a4c87428044ddbc5199cfb05de27e => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:30.504212 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526a4428-228d-4d10-aff0-4e58a878e2af None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:30.600387 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a5ba9e-805c-4294-be58-926f7928d77b None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:30.642297 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526a4428-228d-4d10-aff0-4e58a878e2af None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:30.643592 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e172d8-5ac3-4bcd-8066-e780b48d63bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:30.644540 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e172d8-5ac3-4bcd-8066-e780b48d63bd None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:30.644833 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e172d8-5ac3-4bcd-8066-e780b48d63bd None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:30.645393 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e172d8-5ac3-4bcd-8066-e780b48d63bd None admin] PATH_INFO: `/v3/roles/service` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:30.656397 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:30.662108 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e172d8-5ac3-4bcd-8066-e780b48d63bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:37:30.670043 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-11e172d8-5ac3-4bcd-8066-e780b48d63bd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 14 17:37:30.670043 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:30.670043 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:30.670043 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:30.670043 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:30.670043 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:30.670043 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:30.670043 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:30.670043 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:30.670043 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:30.670043 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:30.670043 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:30.670043 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:37:30.670043 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:37:30.670043 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:37:30.670043 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:37:30.671094 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:37:30.671094 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:37:30.671094 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:37:30.671094 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:37:30.671094 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:30.671094 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:30.671094 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:30.671094 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:30.671094 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:30.671094 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:30.671094 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:30.671094 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:30.671094 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:30.671094 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:30.671094 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:30.671094 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:30.671976 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:30.671976 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:30.671976 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:30.671976 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:30.671976 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:37:30.671976 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:37:30.671976 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:37:30.671976 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:37:30.671976 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:37:30.671976 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:37:30.671976 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 14 17:37:30.671976 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:37:30.671976 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 290/584] 10.222.0.36 () {56 vars in 1102 bytes} [Tue Jun 14 17:37:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:37:30.672678 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e172d8-5ac3-4bcd-8066-e780b48d63bd None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:30.691665 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b41bec-5a2b-4fd5-a562-d188ba2f0738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:30.692360 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b41bec-5a2b-4fd5-a562-d188ba2f0738 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:30.692931 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b41bec-5a2b-4fd5-a562-d188ba2f0738 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:30.692931 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b41bec-5a2b-4fd5-a562-d188ba2f0738 None admin] PATH_INFO: `/v3/projects` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:30.693727 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b41bec-5a2b-4fd5-a562-d188ba2f0738 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:30.694138 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b41bec-5a2b-4fd5-a562-d188ba2f0738 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:30.696009 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b41bec-5a2b-4fd5-a562-d188ba2f0738 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:30.719228 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 295/585] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jun 14 17:37:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:30.719228 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b41bec-5a2b-4fd5-a562-d188ba2f0738 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:30.730167 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:30.797427 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e172d8-5ac3-4bcd-8066-e780b48d63bd None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:30.833421 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b41bec-5a2b-4fd5-a562-d188ba2f0738 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:30.836272 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b21a45-60cb-4fb6-a267-5361d337c03b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:30.836966 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b21a45-60cb-4fb6-a267-5361d337c03b None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:30.837361 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b21a45-60cb-4fb6-a267-5361d337c03b None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:30.837647 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b21a45-60cb-4fb6-a267-5361d337c03b None admin] PATH_INFO: `/v3/domains` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:30.838402 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b21a45-60cb-4fb6-a267-5361d337c03b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:30.838716 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b21a45-60cb-4fb6-a267-5361d337c03b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:30.840175 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b21a45-60cb-4fb6-a267-5361d337c03b None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:30.860149 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 291/586] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 14 17:37:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:30.860149 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b21a45-60cb-4fb6-a267-5361d337c03b None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:30.882064 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a4f580-af76-466c-aec1-1560ae94aeab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:30.882893 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a4f580-af76-466c-aec1-1560ae94aeab None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:30.883176 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a4f580-af76-466c-aec1-1560ae94aeab None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:30.883887 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a4f580-af76-466c-aec1-1560ae94aeab None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:30.892278 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a4f580-af76-466c-aec1-1560ae94aeab None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:30.894508 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a4f580-af76-466c-aec1-1560ae94aeab None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:30.913795 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-36a4f580-af76-466c-aec1-1560ae94aeab None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 14 17:37:30.913795 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:30.913795 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:30.913795 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:30.913795 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:30.913795 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:30.913795 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:30.913795 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:30.913795 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:30.913795 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:30.913795 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:30.913795 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:30.913795 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 14 17:37:30.913795 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 14 17:37:30.913795 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 14 17:37:30.913795 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 14 17:37:30.914997 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:30.914997 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:30.914997 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 14 17:37:30.914997 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:37:30.914997 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 14 17:37:30.914997 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:37:30.914997 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:30.914997 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:30.914997 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:30.914997 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:30.914997 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:30.914997 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:30.914997 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:30.914997 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:30.914997 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:30.914997 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:30.914997 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:30.914997 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:30.916161 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:30.916161 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:30.916161 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 14 17:37:30.916161 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 14 17:37:30.916161 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 14 17:37:30.916161 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 14 17:37:30.916161 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 14 17:37:30.916161 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 14 17:37:30.916161 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 14 17:37:30.916161 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:37:30.916161 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 296/587] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 14 17:37:30 2022] GET /identity/v3/users/cinder => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:37:30.916796 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a4f580-af76-466c-aec1-1560ae94aeab None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:30.951374 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:30.992938 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:30.996295 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b21a45-60cb-4fb6-a267-5361d337c03b None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:31.037215 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a4f580-af76-466c-aec1-1560ae94aeab None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:31.045356 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e53ed2-3923-4316-be11-6a5c1bbcaea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:31.046220 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e53ed2-3923-4316-be11-6a5c1bbcaea4 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:31.048367 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e53ed2-3923-4316-be11-6a5c1bbcaea4 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:31.048367 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e53ed2-3923-4316-be11-6a5c1bbcaea4 None admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:31.048367 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e53ed2-3923-4316-be11-6a5c1bbcaea4 None admin] RBAC: Adding query filter params (name=service) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:31.049110 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e53ed2-3923-4316-be11-6a5c1bbcaea4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:31.051614 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e53ed2-3923-4316-be11-6a5c1bbcaea4 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:31.067707 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 292/588] 10.222.0.36 () {56 vars in 1103 bytes} [Tue Jun 14 17:37:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:31.068662 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e53ed2-3923-4316-be11-6a5c1bbcaea4 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:31.075532 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8563ac49-6891-4023-ac82-e1df8f27365a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:31.076652 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8563ac49-6891-4023-ac82-e1df8f27365a None admin] REQUEST_METHOD: `PUT` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:31.077083 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8563ac49-6891-4023-ac82-e1df8f27365a None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:31.077508 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8563ac49-6891-4023-ac82-e1df8f27365a None admin] PATH_INFO: `/v3/projects/f3e1d023a52c42b98d018617987ef83c/users/e4696d396adb495ab300a9a5a5727595/roles/ed6a4c87428044ddbc5199cfb05de27e` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:31.095631 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8563ac49-6891-4023-ac82-e1df8f27365a None admin] RBAC: Authorizing `identity:create_grant(project_id=f3e1d023a52c42b98d018617987ef83c, user_id=e4696d396adb495ab300a9a5a5727595, role_id=ed6a4c87428044ddbc5199cfb05de27e)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:31.098352 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8563ac49-6891-4023-ac82-e1df8f27365a None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:31.174394 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e53ed2-3923-4316-be11-6a5c1bbcaea4 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:31.182292 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 297/589] 10.222.0.36 () {58 vars in 1439 bytes} [Tue Jun 14 17:37:30 2022] PUT /identity/v3/projects/f3e1d023a52c42b98d018617987ef83c/users/e4696d396adb495ab300a9a5a5727595/roles/ed6a4c87428044ddbc5199cfb05de27e => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:37:31.183690 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8563ac49-6891-4023-ac82-e1df8f27365a None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:31.219362 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d98fb7d-67fa-4183-8f8f-ca3394e7b395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:31.221929 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d98fb7d-67fa-4183-8f8f-ca3394e7b395 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:31.222859 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d98fb7d-67fa-4183-8f8f-ca3394e7b395 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:31.223473 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d98fb7d-67fa-4183-8f8f-ca3394e7b395 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:31.234519 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d98fb7d-67fa-4183-8f8f-ca3394e7b395 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:31.237366 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d98fb7d-67fa-4183-8f8f-ca3394e7b395 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:31.258214 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-2d98fb7d-67fa-4183-8f8f-ca3394e7b395 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:37:31.258214 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:31.258214 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:31.258214 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:31.258214 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:31.258214 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:31.258214 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:31.258214 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:31.258214 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:31.258214 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:31.258214 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:31.258214 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:31.258214 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 14 17:37:31.258214 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 14 17:37:31.258214 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 14 17:37:31.259183 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 14 17:37:31.259183 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:31.259183 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:31.259183 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:31.259183 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:31.259183 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:31.259183 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:31.259183 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:31.259183 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:31.259183 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:31.259183 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:31.259183 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:31.259183 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:31.259183 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:31.259183 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:31.259183 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:31.259183 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:31.260123 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 14 17:37:31.260123 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 14 17:37:31.260123 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 14 17:37:31.260123 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 14 17:37:31.260123 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 14 17:37:31.260123 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 14 17:37:31.260123 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:37:31.260123 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:37:31.261345 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 293/590] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 14 17:37:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:37:31.263573 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d98fb7d-67fa-4183-8f8f-ca3394e7b395 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:31.292539 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:31.303387 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:31.333164 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8563ac49-6891-4023-ac82-e1df8f27365a None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:31.375348 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1a0d90-ac0c-42e7-9451-d83818a1d259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:31.376442 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a0d90-ac0c-42e7-9451-d83818a1d259 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:31.376955 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a0d90-ac0c-42e7-9451-d83818a1d259 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:31.378435 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a0d90-ac0c-42e7-9451-d83818a1d259 None admin] PATH_INFO: `/v3/users` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:31.380000 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1a0d90-ac0c-42e7-9451-d83818a1d259 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:31.380370 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1a0d90-ac0c-42e7-9451-d83818a1d259 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:31.381954 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1a0d90-ac0c-42e7-9451-d83818a1d259 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:31.390473 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d98fb7d-67fa-4183-8f8f-ca3394e7b395 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:31.403045 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 298/591] 10.222.0.36 () {56 vars in 1137 bytes} [Tue Jun 14 17:37:31 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:31.408006 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1a0d90-ac0c-42e7-9451-d83818a1d259 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:31.439026 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735d90b7-739f-4f64-b678-3227d21e349b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:31.440879 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735d90b7-739f-4f64-b678-3227d21e349b None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:31.442332 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735d90b7-739f-4f64-b678-3227d21e349b None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:31.443091 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735d90b7-739f-4f64-b678-3227d21e349b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:31.457510 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735d90b7-739f-4f64-b678-3227d21e349b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:31.459468 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735d90b7-739f-4f64-b678-3227d21e349b None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:31.484477 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-735d90b7-739f-4f64-b678-3227d21e349b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:37:31.484477 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:31.484477 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:31.484477 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:31.484477 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:31.484477 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:31.484477 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:31.484477 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:31.484477 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:31.484477 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:31.484477 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:31.484477 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:31.484477 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:37:31.484477 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:37:31.484477 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:37:31.485868 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:37:31.485868 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:31.485868 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:31.485868 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:31.485868 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:31.485868 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:31.485868 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:31.485868 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:31.485868 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:31.485868 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:31.485868 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:31.485868 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:31.485868 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:31.485868 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:31.485868 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:31.485868 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:31.485868 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:31.486841 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:37:31.486841 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:37:31.486841 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:37:31.486841 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:37:31.486841 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 294/592] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 14 17:37:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:37:31.489237 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735d90b7-739f-4f64-b678-3227d21e349b None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:31.528571 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1a0d90-ac0c-42e7-9451-d83818a1d259 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:31.568068 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2549256e-db73-4647-a22e-29f9fa46d8ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:31.568668 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2549256e-db73-4647-a22e-29f9fa46d8ef None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:31.568953 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2549256e-db73-4647-a22e-29f9fa46d8ef None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:31.569232 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2549256e-db73-4647-a22e-29f9fa46d8ef None admin] PATH_INFO: `/v3/projects` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:31.570045 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2549256e-db73-4647-a22e-29f9fa46d8ef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:31.570387 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2549256e-db73-4647-a22e-29f9fa46d8ef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:31.572132 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:31.572417 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2549256e-db73-4647-a22e-29f9fa46d8ef None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:31.576178 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:31.587577 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 299/593] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jun 14 17:37:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:31.588769 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2549256e-db73-4647-a22e-29f9fa46d8ef None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:31.600594 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735d90b7-739f-4f64-b678-3227d21e349b None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:31.638216 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe9c40b-4f06-4a9a-965e-3c0fb3765660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:31.639047 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe9c40b-4f06-4a9a-965e-3c0fb3765660 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:31.639351 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe9c40b-4f06-4a9a-965e-3c0fb3765660 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:31.639632 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe9c40b-4f06-4a9a-965e-3c0fb3765660 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:31.651546 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe9c40b-4f06-4a9a-965e-3c0fb3765660 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:31.653034 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe9c40b-4f06-4a9a-965e-3c0fb3765660 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:31.672874 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-7fe9c40b-4f06-4a9a-965e-3c0fb3765660 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:37:31.672874 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:31.672874 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:31.672874 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:31.672874 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:31.672874 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:31.672874 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:31.672874 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:31.672874 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:31.672874 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:31.672874 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:31.672874 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:31.672874 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:37:31.672874 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:37:31.672874 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:37:31.674047 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:37:31.674047 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:31.674047 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:31.674047 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:31.674047 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:31.674047 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:31.674047 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:31.674047 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:31.674047 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:31.674047 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:31.674047 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:31.674047 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:31.674047 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:31.674047 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:31.674047 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:31.674047 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:31.674047 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:31.676429 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:37:31.676429 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:37:31.676429 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:37:31.676429 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:37:31.679429 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 295/594] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 14 17:37:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:37:31.680842 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe9c40b-4f06-4a9a-965e-3c0fb3765660 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:31.715871 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2549256e-db73-4647-a22e-29f9fa46d8ef None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:31.757269 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c75e7f8-3953-4e0f-a2be-5daaed23495b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:31.758187 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c75e7f8-3953-4e0f-a2be-5daaed23495b None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:31.758667 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c75e7f8-3953-4e0f-a2be-5daaed23495b None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:31.759189 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c75e7f8-3953-4e0f-a2be-5daaed23495b None admin] PATH_INFO: `/v3/domains` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:31.760096 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c75e7f8-3953-4e0f-a2be-5daaed23495b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:31.760547 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c75e7f8-3953-4e0f-a2be-5daaed23495b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:31.762081 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c75e7f8-3953-4e0f-a2be-5daaed23495b None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:31.776972 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 300/595] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 14 17:37:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:31.778279 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c75e7f8-3953-4e0f-a2be-5daaed23495b None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:31.791928 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe9c40b-4f06-4a9a-965e-3c0fb3765660 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:31.818944 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:31.827470 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c764e5-dd71-4537-b8a8-f8a1262a30d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:31.828372 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c764e5-dd71-4537-b8a8-f8a1262a30d8 None admin] REQUEST_METHOD: `PUT` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:31.828656 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c764e5-dd71-4537-b8a8-f8a1262a30d8 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:31.828935 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c764e5-dd71-4537-b8a8-f8a1262a30d8 None admin] PATH_INFO: `/v3/projects/f3e1d023a52c42b98d018617987ef83c/users/359f5ed4eb684e769f552484ca9a34c7/roles/ed6a4c87428044ddbc5199cfb05de27e` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:31.844588 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:31.844903 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c764e5-dd71-4537-b8a8-f8a1262a30d8 None admin] RBAC: Authorizing `identity:create_grant(project_id=f3e1d023a52c42b98d018617987ef83c, user_id=359f5ed4eb684e769f552484ca9a34c7, role_id=ed6a4c87428044ddbc5199cfb05de27e)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:31.846811 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c764e5-dd71-4537-b8a8-f8a1262a30d8 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:31.894293 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c75e7f8-3953-4e0f-a2be-5daaed23495b None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:31.931416 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 296/596] 10.222.0.36 () {58 vars in 1439 bytes} [Tue Jun 14 17:37:31 2022] PUT /identity/v3/projects/f3e1d023a52c42b98d018617987ef83c/users/359f5ed4eb684e769f552484ca9a34c7/roles/ed6a4c87428044ddbc5199cfb05de27e => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:37:31.931648 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e8f208-dd30-4a1c-aa98-15b6531ca0c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:31.932468 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e8f208-dd30-4a1c-aa98-15b6531ca0c7 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:31.932855 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e8f208-dd30-4a1c-aa98-15b6531ca0c7 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:31.933032 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c764e5-dd71-4537-b8a8-f8a1262a30d8 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:31.933327 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e8f208-dd30-4a1c-aa98-15b6531ca0c7 None admin] PATH_INFO: `/v3/domains` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:31.937784 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e8f208-dd30-4a1c-aa98-15b6531ca0c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:31.937784 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e8f208-dd30-4a1c-aa98-15b6531ca0c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:31.937784 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e8f208-dd30-4a1c-aa98-15b6531ca0c7 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:31.951369 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 301/597] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 14 17:37:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:31.957489 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e8f208-dd30-4a1c-aa98-15b6531ca0c7 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:32.154788 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c764e5-dd71-4537-b8a8-f8a1262a30d8 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:32.168028 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e8f208-dd30-4a1c-aa98-15b6531ca0c7 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:32.190899 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:32.208369 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3081c9-1058-4c9a-a948-f6d82fc17f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:32.209196 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3081c9-1058-4c9a-a948-f6d82fc17f54 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:32.209749 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3081c9-1058-4c9a-a948-f6d82fc17f54 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:32.210032 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3081c9-1058-4c9a-a948-f6d82fc17f54 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:32.214490 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730d0bdc-c37c-4855-8496-4550cbef003c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:32.215319 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730d0bdc-c37c-4855-8496-4550cbef003c None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:32.215616 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730d0bdc-c37c-4855-8496-4550cbef003c None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:32.215898 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730d0bdc-c37c-4855-8496-4550cbef003c None admin] PATH_INFO: `/v3/projects/service` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:32.217874 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3081c9-1058-4c9a-a948-f6d82fc17f54 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:32.219859 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3081c9-1058-4c9a-a948-f6d82fc17f54 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:32.226015 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730d0bdc-c37c-4855-8496-4550cbef003c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:32.227571 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730d0bdc-c37c-4855-8496-4550cbef003c None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:32.240762 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-0d3081c9-1058-4c9a-a948-f6d82fc17f54 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 14 17:37:32.240762 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:32.240762 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:32.240762 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:32.240762 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:32.240762 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:32.240762 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:32.240762 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:32.240762 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:32.240762 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:32.240762 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:32.240762 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:32.240762 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 14 17:37:32.240762 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 14 17:37:32.240762 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 14 17:37:32.240762 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 14 17:37:32.241767 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:32.241767 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:32.241767 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 14 17:37:32.241767 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:37:32.241767 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 14 17:37:32.241767 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:37:32.241767 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:32.241767 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:32.241767 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:32.241767 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:32.241767 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:32.241767 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:32.241767 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:32.241767 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:32.241767 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:32.241767 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:32.241767 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:32.241767 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:32.242769 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:32.242769 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:32.242769 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 14 17:37:32.242769 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 14 17:37:32.242769 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 14 17:37:32.242769 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 14 17:37:32.242769 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 14 17:37:32.242769 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 14 17:37:32.242769 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 14 17:37:32.242769 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:37:32.242769 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 297/598] 10.222.0.36 () {56 vars in 1102 bytes} [Tue Jun 14 17:37:31 2022] GET /identity/v3/users/neutron => generated 85 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:37:32.244079 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-730d0bdc-c37c-4855-8496-4550cbef003c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:37:32.244079 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:32.244079 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:32.244079 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:32.244079 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:32.244079 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:32.244079 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:32.244079 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:32.244079 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:32.244079 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:32.244079 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:32.244079 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:32.244079 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 14 17:37:32.244079 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 14 17:37:32.244079 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 14 17:37:32.244915 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 14 17:37:32.244915 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:32.244915 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:32.244915 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:32.244915 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:32.244915 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:32.244915 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:32.244915 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:32.244915 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:32.244915 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:32.244915 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:32.244915 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:32.244915 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:32.244915 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:32.244915 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:32.244915 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:32.244915 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:32.245786 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 14 17:37:32.245786 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 14 17:37:32.245786 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 14 17:37:32.245786 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 14 17:37:32.245786 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 14 17:37:32.245786 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 14 17:37:32.245786 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:37:32.245786 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:37:32.251253 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 302/599] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 14 17:37:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:37:32.251517 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3081c9-1058-4c9a-a948-f6d82fc17f54 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:32.252281 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730d0bdc-c37c-4855-8496-4550cbef003c None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:32.323345 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:32.450694 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3081c9-1058-4c9a-a948-f6d82fc17f54 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:32.463135 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730d0bdc-c37c-4855-8496-4550cbef003c None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:32.511335 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8198fd9-7bd8-4142-a568-f337b3808f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:32.511335 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8198fd9-7bd8-4142-a568-f337b3808f46 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:32.511335 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8198fd9-7bd8-4142-a568-f337b3808f46 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:32.511335 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8198fd9-7bd8-4142-a568-f337b3808f46 None admin] PATH_INFO: `/v3/projects` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:32.512073 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8198fd9-7bd8-4142-a568-f337b3808f46 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:32.512073 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8198fd9-7bd8-4142-a568-f337b3808f46 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:32.512073 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8198fd9-7bd8-4142-a568-f337b3808f46 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:32.532073 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d13f28-ea3c-4a67-8f24-cd3d35b36543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:32.533460 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d13f28-ea3c-4a67-8f24-cd3d35b36543 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:32.534572 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d13f28-ea3c-4a67-8f24-cd3d35b36543 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:32.535076 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d13f28-ea3c-4a67-8f24-cd3d35b36543 None admin] PATH_INFO: `/v3/users` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:32.535441 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 298/600] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jun 14 17:37:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:32.536386 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d13f28-ea3c-4a67-8f24-cd3d35b36543 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:32.536902 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d13f28-ea3c-4a67-8f24-cd3d35b36543 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:32.537796 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8198fd9-7bd8-4142-a568-f337b3808f46 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:32.538839 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d13f28-ea3c-4a67-8f24-cd3d35b36543 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:32.570601 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 303/601] 10.222.0.36 () {56 vars in 1139 bytes} [Tue Jun 14 17:37:32 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:37:32.575785 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d13f28-ea3c-4a67-8f24-cd3d35b36543 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:32.617309 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:32.647723 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:32.651965 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8198fd9-7bd8-4142-a568-f337b3808f46 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:32.719533 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a70c23a-a08f-4af7-9b7c-16e875c11f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:32.720377 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a70c23a-a08f-4af7-9b7c-16e875c11f58 None admin] REQUEST_METHOD: `PUT` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:32.720676 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a70c23a-a08f-4af7-9b7c-16e875c11f58 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:32.720968 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a70c23a-a08f-4af7-9b7c-16e875c11f58 None admin] PATH_INFO: `/v3/projects/f3e1d023a52c42b98d018617987ef83c/users/17945e7d72954b8787e0ba09a9903247/roles/ed6a4c87428044ddbc5199cfb05de27e` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:32.738553 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a70c23a-a08f-4af7-9b7c-16e875c11f58 None admin] RBAC: Authorizing `identity:create_grant(project_id=f3e1d023a52c42b98d018617987ef83c, user_id=17945e7d72954b8787e0ba09a9903247, role_id=ed6a4c87428044ddbc5199cfb05de27e)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:32.740116 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a70c23a-a08f-4af7-9b7c-16e875c11f58 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:32.760049 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d13f28-ea3c-4a67-8f24-cd3d35b36543 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:32.800196 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b41de8-d25d-49bf-8393-b15d0685aadc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:32.801062 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b41de8-d25d-49bf-8393-b15d0685aadc None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:32.801463 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b41de8-d25d-49bf-8393-b15d0685aadc None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:32.801756 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b41de8-d25d-49bf-8393-b15d0685aadc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:32.812480 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b41de8-d25d-49bf-8393-b15d0685aadc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:32.813920 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b41de8-d25d-49bf-8393-b15d0685aadc None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:32.833834 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-e2b41de8-d25d-49bf-8393-b15d0685aadc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:37:32.833834 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:32.833834 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:32.833834 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:32.833834 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:32.833834 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:32.833834 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:32.833834 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:32.833834 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:32.833834 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:32.833834 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:32.833834 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:32.833834 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:37:32.833834 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:37:32.833834 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:37:32.834800 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:37:32.834800 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:32.834800 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:32.834800 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:32.834800 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:32.834800 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:32.834800 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:32.834800 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:32.834800 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:32.834800 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:32.834800 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:32.834800 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:32.834800 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:32.834800 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:32.834800 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:32.834800 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:32.834800 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:32.836086 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:37:32.836086 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:37:32.836086 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:37:32.836086 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:37:32.836086 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 304/602] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 14 17:37:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 17:37:32.839399 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f60da49-1c54-4db9-a370-4f279384e7d7 None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:32.839399 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f60da49-1c54-4db9-a370-4f279384e7d7 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:32.839399 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f60da49-1c54-4db9-a370-4f279384e7d7 None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:32.839399 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 305/603] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:37:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:37:32.840241 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f60da49-1c54-4db9-a370-4f279384e7d7 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:32.859540 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 299/604] 10.222.0.36 () {58 vars in 1439 bytes} [Tue Jun 14 17:37:32 2022] PUT /identity/v3/projects/f3e1d023a52c42b98d018617987ef83c/users/17945e7d72954b8787e0ba09a9903247/roles/ed6a4c87428044ddbc5199cfb05de27e => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 17:37:32.864038 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf0d08c-57bb-409b-8165-42b4402b9777 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:32.864038 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf0d08c-57bb-409b-8165-42b4402b9777 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:32.864038 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf0d08c-57bb-409b-8165-42b4402b9777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:32.891828 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-ddf0d08c-57bb-409b-8165-42b4402b9777 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:37:32.894589 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-ddf0d08c-57bb-409b-8165-42b4402b9777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:37:32.962662 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:32.983186 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f60da49-1c54-4db9-a370-4f279384e7d7 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:33.033333 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f144bc-40c5-4bbb-809c-bae0aea66cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:33.035029 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f144bc-40c5-4bbb-809c-bae0aea66cdb None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:33.035525 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f144bc-40c5-4bbb-809c-bae0aea66cdb None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:33.036056 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f144bc-40c5-4bbb-809c-bae0aea66cdb None admin] PATH_INFO: `/v3/domains` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:33.037753 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f144bc-40c5-4bbb-809c-bae0aea66cdb None admin] RBAC: Adding query filter params (name=Default) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:33.038253 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f144bc-40c5-4bbb-809c-bae0aea66cdb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:33.039920 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f144bc-40c5-4bbb-809c-bae0aea66cdb None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:33.060050 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 306/605] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 14 17:37:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:33.062300 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f144bc-40c5-4bbb-809c-bae0aea66cdb None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:33.128988 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 300/606] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:37:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:37:33.156481 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf0d08c-57bb-409b-8165-42b4402b9777 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:33.211279 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f144bc-40c5-4bbb-809c-bae0aea66cdb None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:33.268848 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:33.295474 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf0d08c-57bb-409b-8165-42b4402b9777 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:33.304038 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d6675e-907d-4acd-a418-5ac3ad34a23a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:33.305024 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d6675e-907d-4acd-a418-5ac3ad34a23a None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:33.305406 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d6675e-907d-4acd-a418-5ac3ad34a23a None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:33.305780 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d6675e-907d-4acd-a418-5ac3ad34a23a None admin] PATH_INFO: `/v3/projects/service` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:33.328771 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d6675e-907d-4acd-a418-5ac3ad34a23a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:33.330157 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d6675e-907d-4acd-a418-5ac3ad34a23a None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:33.334651 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b5b062-fb73-4bbd-9600-b250b21c4f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:33.335685 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b5b062-fb73-4bbd-9600-b250b21c4f6c None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:33.336122 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b5b062-fb73-4bbd-9600-b250b21c4f6c None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:33.336613 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b5b062-fb73-4bbd-9600-b250b21c4f6c None admin] PATH_INFO: `/v3/roles/service` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:33.348727 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b5b062-fb73-4bbd-9600-b250b21c4f6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:37:33.357311 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-38b5b062-fb73-4bbd-9600-b250b21c4f6c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 14 17:37:33.357311 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:33.357311 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:33.357311 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:33.357311 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:33.357311 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:33.357311 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:33.357311 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:33.357311 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:33.357311 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:33.357311 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:33.357311 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:33.357311 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:37:33.357311 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:37:33.357311 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:37:33.357311 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:37:33.358468 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:37:33.358468 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:37:33.358468 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:37:33.358468 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:37:33.358468 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:33.358468 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:33.358468 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:33.358468 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:33.358468 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:33.358468 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:33.358468 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:33.358468 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:33.358468 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:33.358468 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:33.358468 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:33.358468 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:33.359546 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:33.359546 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:33.359546 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:33.359546 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:33.359546 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:37:33.359546 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:37:33.359546 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:37:33.359546 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:37:33.359546 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:37:33.359546 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:37:33.359546 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 14 17:37:33.359546 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:37:33.362042 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 301/607] 10.222.0.36 () {56 vars in 1102 bytes} [Tue Jun 14 17:37:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 17:37:33.373352 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b5b062-fb73-4bbd-9600-b250b21c4f6c None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:33.373598 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-12d6675e-907d-4acd-a418-5ac3ad34a23a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:37:33.373598 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:33.373598 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:33.373598 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:33.373598 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:33.373598 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:33.373598 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:33.373598 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:33.373598 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:33.373598 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:33.373598 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:33.373598 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:33.373598 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 14 17:37:33.373598 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 14 17:37:33.373598 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 14 17:37:33.374481 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 14 17:37:33.374481 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:33.374481 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:33.374481 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:33.374481 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:33.374481 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:33.374481 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:33.374481 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:33.374481 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:33.374481 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:33.374481 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:33.374481 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:33.374481 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:33.374481 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:33.374481 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:33.374481 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:33.374481 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:33.375793 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 14 17:37:33.375793 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 14 17:37:33.375793 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 14 17:37:33.375793 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 14 17:37:33.375793 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 14 17:37:33.375793 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 14 17:37:33.375793 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:37:33.375793 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:37:33.375793 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 307/608] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 14 17:37:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:37:33.381696 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d6675e-907d-4acd-a418-5ac3ad34a23a None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:33.390825 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:33.546884 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d6675e-907d-4acd-a418-5ac3ad34a23a None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:33.561325 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b5b062-fb73-4bbd-9600-b250b21c4f6c None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:33.596734 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6692d96d-6b61-4102-b35c-65260fb811b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:33.597440 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6692d96d-6b61-4102-b35c-65260fb811b8 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:33.597729 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6692d96d-6b61-4102-b35c-65260fb811b8 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:33.598007 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6692d96d-6b61-4102-b35c-65260fb811b8 None admin] PATH_INFO: `/v3/projects` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:33.598801 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6692d96d-6b61-4102-b35c-65260fb811b8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:33.599113 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6692d96d-6b61-4102-b35c-65260fb811b8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:33.599950 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c58a46-30a0-4b95-84c5-f99bfc5cbc5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:33.600641 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c58a46-30a0-4b95-84c5-f99bfc5cbc5e None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:33.600804 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6692d96d-6b61-4102-b35c-65260fb811b8 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:33.600942 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c58a46-30a0-4b95-84c5-f99bfc5cbc5e None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:33.601232 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c58a46-30a0-4b95-84c5-f99bfc5cbc5e None admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:33.601950 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c58a46-30a0-4b95-84c5-f99bfc5cbc5e None admin] RBAC: Adding query filter params (name=service) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:33.602388 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c58a46-30a0-4b95-84c5-f99bfc5cbc5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:33.603925 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c58a46-30a0-4b95-84c5-f99bfc5cbc5e None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:33.613024 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 302/609] 10.222.0.36 () {56 vars in 1103 bytes} [Tue Jun 14 17:37:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:37:33.614435 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f45f50-a693-4537-a0b5-7e9956520730 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:33.614739 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f45f50-a693-4537-a0b5-7e9956520730 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:33.615016 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f45f50-a693-4537-a0b5-7e9956520730 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:33.617157 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 303/610] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:37:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:37:33.617578 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:33.618183 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 308/611] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jun 14 17:37:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:33.619147 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f45f50-a693-4537-a0b5-7e9956520730 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:33.622445 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23b5b4b-a3e4-43b8-80d6-5748a7388735 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:33.622737 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23b5b4b-a3e4-43b8-80d6-5748a7388735 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:33.623070 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23b5b4b-a3e4-43b8-80d6-5748a7388735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:33.644720 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-c23b5b4b-a3e4-43b8-80d6-5748a7388735 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:37:33.646043 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-c23b5b4b-a3e4-43b8-80d6-5748a7388735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:37:33.710852 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:33.718827 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 309/612] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:37:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:37:33.719922 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23b5b4b-a3e4-43b8-80d6-5748a7388735 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:33.736153 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f45f50-a693-4537-a0b5-7e9956520730 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:33.778768 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd68360-0526-433f-a0cc-51faa2e4e615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:33.779607 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd68360-0526-433f-a0cc-51faa2e4e615 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:33.779899 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd68360-0526-433f-a0cc-51faa2e4e615 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:33.780291 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd68360-0526-433f-a0cc-51faa2e4e615 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:33.793095 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd68360-0526-433f-a0cc-51faa2e4e615 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:33.794556 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd68360-0526-433f-a0cc-51faa2e4e615 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:33.816206 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-8cd68360-0526-433f-a0cc-51faa2e4e615 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:37:33.816206 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:33.816206 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:33.816206 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:33.816206 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:33.816206 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:33.816206 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:33.816206 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:33.816206 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:33.816206 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:33.816206 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:33.816206 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:33.816206 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:37:33.816206 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:37:33.816206 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:37:33.817152 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:37:33.817152 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:33.817152 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:33.817152 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:33.817152 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:33.817152 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:33.817152 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:33.817152 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:33.817152 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:33.817152 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:33.817152 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:33.817152 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:33.817152 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:33.817152 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:33.817152 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:33.817152 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:33.817152 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:33.818490 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:37:33.818490 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:37:33.818490 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:37:33.818490 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:37:33.818490 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 304/613] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 14 17:37:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:37:33.818972 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd68360-0526-433f-a0cc-51faa2e4e615 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:33.834002 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23b5b4b-a3e4-43b8-80d6-5748a7388735 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:33.870351 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d9fc0c-d1a0-4c2b-b896-a5767efe5f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:33.871275 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d9fc0c-d1a0-4c2b-b896-a5767efe5f6e None admin] REQUEST_METHOD: `PUT` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:33.871587 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d9fc0c-d1a0-4c2b-b896-a5767efe5f6e None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:33.871925 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d9fc0c-d1a0-4c2b-b896-a5767efe5f6e None admin] PATH_INFO: `/v3/projects/f3e1d023a52c42b98d018617987ef83c/users/5652329c71cd431fb579d69cef933b37/roles/ed6a4c87428044ddbc5199cfb05de27e` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:33.876247 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:33.888615 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d9fc0c-d1a0-4c2b-b896-a5767efe5f6e None admin] RBAC: Authorizing `identity:create_grant(project_id=f3e1d023a52c42b98d018617987ef83c, user_id=5652329c71cd431fb579d69cef933b37, role_id=ed6a4c87428044ddbc5199cfb05de27e)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:33.890063 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d9fc0c-d1a0-4c2b-b896-a5767efe5f6e None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:33.938552 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd68360-0526-433f-a0cc-51faa2e4e615 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:33.966320 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 310/614] 10.222.0.36 () {58 vars in 1439 bytes} [Tue Jun 14 17:37:33 2022] PUT /identity/v3/projects/f3e1d023a52c42b98d018617987ef83c/users/5652329c71cd431fb579d69cef933b37/roles/ed6a4c87428044ddbc5199cfb05de27e => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:37:33.968341 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d9fc0c-d1a0-4c2b-b896-a5767efe5f6e None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:33.975663 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fc501e-81c8-45b9-bcd2-d369b4bca646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:33.976573 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fc501e-81c8-45b9-bcd2-d369b4bca646 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:33.976868 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fc501e-81c8-45b9-bcd2-d369b4bca646 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:33.977153 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fc501e-81c8-45b9-bcd2-d369b4bca646 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:33.992040 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fc501e-81c8-45b9-bcd2-d369b4bca646 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:37:34.000394 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-e0fc501e-81c8-45b9-bcd2-d369b4bca646 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 14 17:37:34.000394 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:34.000394 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:34.000394 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:34.000394 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:34.000394 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:34.000394 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:34.000394 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:34.000394 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:34.000394 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:34.000394 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:34.000394 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:34.000394 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:37:34.000394 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:37:34.000394 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:37:34.000394 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:37:34.002034 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:37:34.002034 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:37:34.002034 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:37:34.002034 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:37:34.002034 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:34.002034 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:34.002034 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:34.002034 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:34.002034 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:34.002034 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:34.002034 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:34.002034 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:34.002034 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:34.002034 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:34.002034 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:34.002034 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:34.005191 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:34.005191 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:34.005191 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:34.005191 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:34.005191 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:37:34.005191 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:37:34.005191 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:37:34.005191 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:37:34.005191 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:37:34.005191 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:37:34.005191 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 14 17:37:34.005191 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:37:34.005191 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 305/615] 10.222.0.36 () {56 vars in 1102 bytes} [Tue Jun 14 17:37:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:37:34.009420 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fc501e-81c8-45b9-bcd2-d369b4bca646 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:34.093395 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:34.202032 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d9fc0c-d1a0-4c2b-b896-a5767efe5f6e None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:34.249018 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93dd666-81b7-4aba-93f0-2b171087cfab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:34.249435 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93dd666-81b7-4aba-93f0-2b171087cfab None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:34.249980 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93dd666-81b7-4aba-93f0-2b171087cfab None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:34.250115 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93dd666-81b7-4aba-93f0-2b171087cfab None admin] PATH_INFO: `/v3/domains` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:34.250748 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93dd666-81b7-4aba-93f0-2b171087cfab None admin] RBAC: Adding query filter params (name=Default) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:34.251112 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93dd666-81b7-4aba-93f0-2b171087cfab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:34.253139 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93dd666-81b7-4aba-93f0-2b171087cfab None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:34.254819 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fc501e-81c8-45b9-bcd2-d369b4bca646 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:34.266209 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:34.267607 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 311/616] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 14 17:37:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:34.274123 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93dd666-81b7-4aba-93f0-2b171087cfab None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:34.296802 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf09d9ec-6457-46a8-8f34-9d761f82e52c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:34.297833 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf09d9ec-6457-46a8-8f34-9d761f82e52c None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:34.298318 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf09d9ec-6457-46a8-8f34-9d761f82e52c None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:34.298818 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf09d9ec-6457-46a8-8f34-9d761f82e52c None admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:34.301179 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf09d9ec-6457-46a8-8f34-9d761f82e52c None admin] RBAC: Adding query filter params (name=service) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:34.301729 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf09d9ec-6457-46a8-8f34-9d761f82e52c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:34.303968 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf09d9ec-6457-46a8-8f34-9d761f82e52c None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:34.314819 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 306/617] 10.222.0.36 () {56 vars in 1103 bytes} [Tue Jun 14 17:37:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:37:34.319931 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf09d9ec-6457-46a8-8f34-9d761f82e52c None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:34.406055 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93dd666-81b7-4aba-93f0-2b171087cfab None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:34.425291 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:34.479340 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf09d9ec-6457-46a8-8f34-9d761f82e52c None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:34.486368 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ea376f-42f1-433f-97cc-59bd2dc58bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:34.487977 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ea376f-42f1-433f-97cc-59bd2dc58bff None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:34.488273 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ea376f-42f1-433f-97cc-59bd2dc58bff None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:34.488557 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ea376f-42f1-433f-97cc-59bd2dc58bff None admin] PATH_INFO: `/v3/users/swift` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:34.508475 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ea376f-42f1-433f-97cc-59bd2dc58bff None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:34.510038 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ea376f-42f1-433f-97cc-59bd2dc58bff None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:34.537176 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-e1ea376f-42f1-433f-97cc-59bd2dc58bff None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 14 17:37:34.537176 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:34.537176 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:34.537176 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:34.537176 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:34.537176 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:34.537176 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:34.537176 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:34.537176 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:34.537176 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:34.537176 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:34.537176 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:34.537176 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 14 17:37:34.537176 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 14 17:37:34.537176 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 14 17:37:34.537176 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 14 17:37:34.538190 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:34.538190 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:34.538190 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 14 17:37:34.538190 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:37:34.538190 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 14 17:37:34.538190 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:37:34.538190 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:34.538190 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:34.538190 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:34.538190 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:34.538190 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:34.538190 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:34.538190 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:34.538190 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:34.538190 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:34.538190 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:34.538190 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:34.538190 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:34.539293 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:34.539293 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:34.539293 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 14 17:37:34.539293 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 14 17:37:34.539293 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 14 17:37:34.539293 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 14 17:37:34.539293 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 14 17:37:34.539293 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 14 17:37:34.539293 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 14 17:37:34.539293 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:37:34.539293 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 312/618] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jun 14 17:37:34 2022] GET /identity/v3/users/swift => generated 83 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:37:34.544123 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c23925-cc10-4e9c-b7fa-85137134402d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:34.544960 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c23925-cc10-4e9c-b7fa-85137134402d None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:34.545252 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c23925-cc10-4e9c-b7fa-85137134402d None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:34.545538 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c23925-cc10-4e9c-b7fa-85137134402d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:34.547271 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ea376f-42f1-433f-97cc-59bd2dc58bff None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:34.571781 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c23925-cc10-4e9c-b7fa-85137134402d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:34.573308 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c23925-cc10-4e9c-b7fa-85137134402d None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:34.607485 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-14c23925-cc10-4e9c-b7fa-85137134402d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:37:34.607485 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:34.607485 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:34.607485 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:34.607485 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:34.607485 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:34.607485 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:34.607485 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:34.607485 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:34.607485 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:34.607485 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:34.607485 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:34.607485 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:37:34.607485 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:37:34.607485 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:37:34.608453 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:37:34.608453 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:34.608453 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:34.608453 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:34.608453 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:34.608453 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:34.608453 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:34.608453 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:34.608453 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:34.608453 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:34.608453 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:34.608453 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:34.608453 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:34.608453 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:34.608453 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:34.608453 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:34.608453 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:34.609335 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:37:34.609335 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:37:34.609335 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:37:34.609335 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:37:34.610773 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 307/619] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 14 17:37:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 17:37:34.616035 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c23925-cc10-4e9c-b7fa-85137134402d None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:34.666521 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:34.731268 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ea376f-42f1-433f-97cc-59bd2dc58bff None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:34.760110 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c23925-cc10-4e9c-b7fa-85137134402d None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:34.773031 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe8afb2-9621-449f-9fa4-99ff217fc5e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:34.774133 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe8afb2-9621-449f-9fa4-99ff217fc5e5 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:34.774642 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe8afb2-9621-449f-9fa4-99ff217fc5e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:34.775166 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe8afb2-9621-449f-9fa4-99ff217fc5e5 None admin] PATH_INFO: `/v3/users` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:34.776341 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe8afb2-9621-449f-9fa4-99ff217fc5e5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:34.777097 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe8afb2-9621-449f-9fa4-99ff217fc5e5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:34.778649 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe8afb2-9621-449f-9fa4-99ff217fc5e5 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:34.799955 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb34f6f8-20df-4dc1-94aa-83c14eb35257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:34.800908 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb34f6f8-20df-4dc1-94aa-83c14eb35257 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:34.801340 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb34f6f8-20df-4dc1-94aa-83c14eb35257 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:34.801750 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb34f6f8-20df-4dc1-94aa-83c14eb35257 None admin] PATH_INFO: `/v3/domains` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:34.802755 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb34f6f8-20df-4dc1-94aa-83c14eb35257 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:34.803211 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb34f6f8-20df-4dc1-94aa-83c14eb35257 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:34.803733 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 313/620] 10.222.0.36 () {56 vars in 1135 bytes} [Tue Jun 14 17:37:34 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:37:34.804974 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb34f6f8-20df-4dc1-94aa-83c14eb35257 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:34.805336 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd00f7e-3a6a-46c2-8b91-b62432cfead9 None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:34.805722 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd00f7e-3a6a-46c2-8b91-b62432cfead9 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:34.806099 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd00f7e-3a6a-46c2-8b91-b62432cfead9 None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:34.807925 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 314/621] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:37:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:37:34.809169 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd00f7e-3a6a-46c2-8b91-b62432cfead9 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:34.822535 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 308/622] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 14 17:37:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:37:34.824664 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01e692e-364e-43b6-bc29-d0451c8d1279 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:34.825131 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01e692e-364e-43b6-bc29-d0451c8d1279 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:34.826024 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01e692e-364e-43b6-bc29-d0451c8d1279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:34.840845 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:34.850116 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-d01e692e-364e-43b6-bc29-d0451c8d1279 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:37:34.851774 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-d01e692e-364e-43b6-bc29-d0451c8d1279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:37:34.930163 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 309/623] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:37:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:37:34.931131 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01e692e-364e-43b6-bc29-d0451c8d1279 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:34.942193 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd00f7e-3a6a-46c2-8b91-b62432cfead9 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:34.947333 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:34.982872 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456b9649-1597-486b-9d45-9128951132ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:34.984137 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456b9649-1597-486b-9d45-9128951132ab None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:34.984674 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456b9649-1597-486b-9d45-9128951132ab None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:34.985154 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456b9649-1597-486b-9d45-9128951132ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:34.998283 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456b9649-1597-486b-9d45-9128951132ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:35.000476 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456b9649-1597-486b-9d45-9128951132ab None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:35.022606 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-456b9649-1597-486b-9d45-9128951132ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:37:35.022606 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:35.022606 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:35.022606 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:35.022606 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:35.022606 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:35.022606 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:35.022606 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:35.022606 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:35.022606 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:35.022606 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:35.022606 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:35.022606 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:37:35.022606 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:37:35.022606 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:37:35.026523 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:37:35.026523 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:35.026523 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:35.026523 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:35.026523 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:35.026523 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:35.026523 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:35.026523 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:35.026523 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:35.026523 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:35.026523 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:35.026523 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:35.026523 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:35.026523 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:35.026523 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:35.026523 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:35.026523 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:35.027448 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:37:35.027448 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:37:35.027448 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:37:35.027448 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:37:35.027448 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 315/624] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 14 17:37:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 17:37:35.027448 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456b9649-1597-486b-9d45-9128951132ab None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:35.058721 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01e692e-364e-43b6-bc29-d0451c8d1279 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:35.097566 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b304f1e-c3ec-43d7-a4b7-416790e97bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:35.098588 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b304f1e-c3ec-43d7-a4b7-416790e97bc0 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:35.098949 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b304f1e-c3ec-43d7-a4b7-416790e97bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:35.099319 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b304f1e-c3ec-43d7-a4b7-416790e97bc0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:35.107638 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b304f1e-c3ec-43d7-a4b7-416790e97bc0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:35.109297 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b304f1e-c3ec-43d7-a4b7-416790e97bc0 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:35.116433 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:35.125698 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-2b304f1e-c3ec-43d7-a4b7-416790e97bc0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 14 17:37:35.125698 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:35.125698 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:35.125698 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:35.125698 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:35.125698 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:35.125698 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:35.125698 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:35.125698 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:35.125698 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:35.125698 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:35.125698 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:35.125698 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 14 17:37:35.125698 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 14 17:37:35.125698 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 14 17:37:35.125698 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 14 17:37:35.128645 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:35.128645 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:35.128645 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 14 17:37:35.128645 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:37:35.128645 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 14 17:37:35.128645 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:37:35.128645 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:35.128645 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:35.128645 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:35.128645 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:35.128645 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:35.128645 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:35.128645 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:35.128645 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:35.128645 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:35.128645 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:35.128645 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:35.128645 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:35.129845 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:35.129845 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:35.129845 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 14 17:37:35.129845 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 14 17:37:35.129845 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 14 17:37:35.129845 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 14 17:37:35.129845 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 14 17:37:35.129845 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 14 17:37:35.129845 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 14 17:37:35.129845 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:37:35.131462 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 310/625] 10.222.0.36 () {56 vars in 1093 bytes} [Tue Jun 14 17:37:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:37:35.132625 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b304f1e-c3ec-43d7-a4b7-416790e97bc0 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:35.143645 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456b9649-1597-486b-9d45-9128951132ab None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:35.182610 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf3d94c-422b-47ad-8dff-0fde582df035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:35.183486 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf3d94c-422b-47ad-8dff-0fde582df035 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:35.183774 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf3d94c-422b-47ad-8dff-0fde582df035 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:35.184185 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf3d94c-422b-47ad-8dff-0fde582df035 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:35.196273 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf3d94c-422b-47ad-8dff-0fde582df035 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:37:35.205045 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-0bf3d94c-422b-47ad-8dff-0fde582df035 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 14 17:37:35.205045 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:35.205045 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:35.205045 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:35.205045 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:35.205045 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:35.205045 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:35.205045 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:35.205045 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:35.205045 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:35.205045 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:35.205045 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:35.205045 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:37:35.205045 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:37:35.205045 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:37:35.205045 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:37:35.206894 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:37:35.206894 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:37:35.206894 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:37:35.206894 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:37:35.206894 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:35.206894 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:35.206894 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:35.206894 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:35.206894 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:35.206894 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:35.206894 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:35.206894 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:35.206894 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:35.206894 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:35.206894 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:35.206894 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:35.212790 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:35.212790 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:35.212790 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:35.212790 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:35.212790 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:37:35.212790 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:37:35.212790 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:37:35.212790 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:37:35.212790 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:37:35.212790 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:37:35.212790 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 14 17:37:35.212790 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:37:35.212790 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 316/626] 10.222.0.36 () {56 vars in 1102 bytes} [Tue Jun 14 17:37:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:37:35.212790 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf3d94c-422b-47ad-8dff-0fde582df035 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:35.227143 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:35.256220 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b304f1e-c3ec-43d7-a4b7-416790e97bc0 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:35.295317 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0bbffd-388f-4753-bae3-66f1227c5c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:35.295861 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0bbffd-388f-4753-bae3-66f1227c5c47 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:35.296222 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0bbffd-388f-4753-bae3-66f1227c5c47 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:35.296573 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0bbffd-388f-4753-bae3-66f1227c5c47 None admin] PATH_INFO: `/v3/domains` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:35.297395 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0bbffd-388f-4753-bae3-66f1227c5c47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:35.297778 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0bbffd-388f-4753-bae3-66f1227c5c47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:35.299345 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0bbffd-388f-4753-bae3-66f1227c5c47 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:35.313046 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 311/627] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 14 17:37:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:35.314186 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0bbffd-388f-4753-bae3-66f1227c5c47 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:35.332383 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf3d94c-422b-47ad-8dff-0fde582df035 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:35.371051 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00eade5-5321-4711-8a83-63aa095759d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:35.372152 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00eade5-5321-4711-8a83-63aa095759d0 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:35.372619 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00eade5-5321-4711-8a83-63aa095759d0 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:35.373199 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00eade5-5321-4711-8a83-63aa095759d0 None admin] PATH_INFO: `/v3/users` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:35.374213 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00eade5-5321-4711-8a83-63aa095759d0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:35.374719 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00eade5-5321-4711-8a83-63aa095759d0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:35.376519 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00eade5-5321-4711-8a83-63aa095759d0 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:35.380748 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:35.399026 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 317/628] 10.222.0.36 () {56 vars in 1133 bytes} [Tue Jun 14 17:37:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:35.400057 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00eade5-5321-4711-8a83-63aa095759d0 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:35.433370 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0bbffd-388f-4753-bae3-66f1227c5c47 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:35.471832 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008c6069-eddd-45fa-a16d-ab6e9cf0459b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:35.472870 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008c6069-eddd-45fa-a16d-ab6e9cf0459b None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:35.473399 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008c6069-eddd-45fa-a16d-ab6e9cf0459b None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:35.473832 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008c6069-eddd-45fa-a16d-ab6e9cf0459b None admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:35.474851 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008c6069-eddd-45fa-a16d-ab6e9cf0459b None admin] RBAC: Adding query filter params (name=service) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:35.475362 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008c6069-eddd-45fa-a16d-ab6e9cf0459b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:35.476956 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008c6069-eddd-45fa-a16d-ab6e9cf0459b None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:35.479939 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:35.490097 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 312/629] 10.222.0.36 () {56 vars in 1103 bytes} [Tue Jun 14 17:37:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:35.491194 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008c6069-eddd-45fa-a16d-ab6e9cf0459b None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:35.521083 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00eade5-5321-4711-8a83-63aa095759d0 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:35.558900 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd66923c-081e-4fac-8144-499eda13214f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:35.559944 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd66923c-081e-4fac-8144-499eda13214f None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:35.560432 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd66923c-081e-4fac-8144-499eda13214f None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:35.560815 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd66923c-081e-4fac-8144-499eda13214f None admin] PATH_INFO: `/v3/projects/service` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:35.569554 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd66923c-081e-4fac-8144-499eda13214f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:35.571148 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd66923c-081e-4fac-8144-499eda13214f None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:35.587248 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-fd66923c-081e-4fac-8144-499eda13214f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:37:35.587248 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:35.587248 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:35.587248 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:35.587248 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:35.587248 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:35.587248 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:35.587248 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:35.587248 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:35.587248 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:35.587248 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:35.587248 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:35.587248 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 14 17:37:35.587248 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 14 17:37:35.587248 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 14 17:37:35.588340 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 14 17:37:35.588340 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:35.588340 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:35.588340 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:35.588340 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:35.588340 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:35.588340 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:35.588340 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:35.588340 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:35.588340 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:35.588340 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:35.588340 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:35.588340 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:35.588340 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:35.588340 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:35.588340 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:35.588340 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:35.589243 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 14 17:37:35.589243 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 14 17:37:35.589243 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 14 17:37:35.589243 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 14 17:37:35.589243 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 14 17:37:35.589243 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 14 17:37:35.589243 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:37:35.589243 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:37:35.589243 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 318/630] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 14 17:37:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:37:35.590243 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd66923c-081e-4fac-8144-499eda13214f None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:35.620939 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008c6069-eddd-45fa-a16d-ab6e9cf0459b None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:35.655600 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:35.661089 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27997ae-8db8-4e67-9821-aeee08f1d41e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:35.661663 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27997ae-8db8-4e67-9821-aeee08f1d41e None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:35.661952 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27997ae-8db8-4e67-9821-aeee08f1d41e None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:35.662236 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27997ae-8db8-4e67-9821-aeee08f1d41e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:35.704273 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd66923c-081e-4fac-8144-499eda13214f None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:35.729522 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:35.736224 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27997ae-8db8-4e67-9821-aeee08f1d41e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:35.738420 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27997ae-8db8-4e67-9821-aeee08f1d41e None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:35.742617 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6fce75-af71-4686-95a5-645d7df0c90c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:35.743454 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6fce75-af71-4686-95a5-645d7df0c90c None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:35.743745 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6fce75-af71-4686-95a5-645d7df0c90c None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:35.744026 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6fce75-af71-4686-95a5-645d7df0c90c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:35.756974 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6fce75-af71-4686-95a5-645d7df0c90c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:35.758462 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6fce75-af71-4686-95a5-645d7df0c90c None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:35.777005 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-7c6fce75-af71-4686-95a5-645d7df0c90c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:37:35.777005 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:35.777005 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:35.777005 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:35.777005 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:35.777005 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:35.777005 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:35.777005 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:35.777005 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:35.777005 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:35.777005 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:35.777005 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:35.777005 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:37:35.777005 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:37:35.777005 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:37:35.777956 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:37:35.777956 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:35.777956 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:35.777956 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:35.777956 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:35.777956 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:35.777956 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:35.777956 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:35.777956 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:35.777956 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:35.777956 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:35.777956 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:35.777956 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:35.777956 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:35.777956 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:35.777956 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:35.777956 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:35.778857 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:37:35.778857 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:37:35.778857 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:37:35.778857 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:37:35.778857 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 319/631] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 14 17:37:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:37:35.779152 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6fce75-af71-4686-95a5-645d7df0c90c None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:35.851480 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 313/632] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 14 17:37:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 14 17:37:35.852896 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c050b0c-ff49-4227-bc0f-d7c8d0185daa None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:35.853190 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c050b0c-ff49-4227-bc0f-d7c8d0185daa None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:35.853470 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c050b0c-ff49-4227-bc0f-d7c8d0185daa None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:35.858790 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 314/633] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:37:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:37:35.858790 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c050b0c-ff49-4227-bc0f-d7c8d0185daa None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:35.904474 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6fce75-af71-4686-95a5-645d7df0c90c None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:35.912458 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:35.938859 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d28087-4f6d-4c85-8a1c-8ff88c38cc25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:35.940166 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d28087-4f6d-4c85-8a1c-8ff88c38cc25 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:35.940963 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d28087-4f6d-4c85-8a1c-8ff88c38cc25 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:35.941408 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d28087-4f6d-4c85-8a1c-8ff88c38cc25 None admin] PATH_INFO: `/v3/projects` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:35.942475 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d28087-4f6d-4c85-8a1c-8ff88c38cc25 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:35.942788 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d28087-4f6d-4c85-8a1c-8ff88c38cc25 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:35.944268 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d28087-4f6d-4c85-8a1c-8ff88c38cc25 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:35.957436 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 320/634] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jun 14 17:37:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:35.958272 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d28087-4f6d-4c85-8a1c-8ff88c38cc25 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:35.970793 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:35.978298 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c050b0c-ff49-4227-bc0f-d7c8d0185daa None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:36.018832 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e39a1b-0508-43b4-b027-073c4ac5ad0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:36.019799 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e39a1b-0508-43b4-b027-073c4ac5ad0d None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:36.020508 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e39a1b-0508-43b4-b027-073c4ac5ad0d None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:36.020797 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e39a1b-0508-43b4-b027-073c4ac5ad0d None admin] PATH_INFO: `/v3/domains` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:36.021867 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e39a1b-0508-43b4-b027-073c4ac5ad0d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:36.022180 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e39a1b-0508-43b4-b027-073c4ac5ad0d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:36.024318 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e39a1b-0508-43b4-b027-073c4ac5ad0d None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:36.038491 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 315/635] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 14 17:37:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:36.039866 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da6eac7-d974-4dac-b213-5d6c62deb83c None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:36.045786 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da6eac7-d974-4dac-b213-5d6c62deb83c None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:36.045786 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da6eac7-d974-4dac-b213-5d6c62deb83c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:36.059544 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-7da6eac7-d974-4dac-b213-5d6c62deb83c None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:37:36.060753 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-7da6eac7-d974-4dac-b213-5d6c62deb83c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:37:36.068839 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d28087-4f6d-4c85-8a1c-8ff88c38cc25 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:36.108661 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbf7032-988b-4ff6-a99d-3945b4fb8d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:36.109782 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbf7032-988b-4ff6-a99d-3945b4fb8d3c None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:36.110077 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbf7032-988b-4ff6-a99d-3945b4fb8d3c None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:36.110514 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbf7032-988b-4ff6-a99d-3945b4fb8d3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:36.122528 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbf7032-988b-4ff6-a99d-3945b4fb8d3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:36.124019 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbf7032-988b-4ff6-a99d-3945b4fb8d3c None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:36.143321 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 316/636] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:37:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:37:36.143321 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da6eac7-d974-4dac-b213-5d6c62deb83c None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:36.152828 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-7bbf7032-988b-4ff6-a99d-3945b4fb8d3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:37:36.152828 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:36.152828 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:36.152828 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:36.152828 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:36.152828 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:36.152828 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:36.152828 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:36.152828 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:36.152828 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:36.152828 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:36.152828 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:36.152828 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:37:36.152828 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:37:36.152828 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:37:36.153918 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:37:36.153918 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:36.153918 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:36.153918 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:36.153918 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:36.153918 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:36.153918 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:36.153918 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:36.153918 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:36.153918 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:36.153918 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:36.153918 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:36.153918 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:36.153918 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:36.153918 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:36.153918 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:36.153918 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:36.154821 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:37:36.154821 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:37:36.154821 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:37:36.154821 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:37:36.154821 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 321/637] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 14 17:37:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:37:36.155590 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbf7032-988b-4ff6-a99d-3945b4fb8d3c None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:36.179947 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:36.242574 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:36.262384 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da6eac7-d974-4dac-b213-5d6c62deb83c None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:36.273639 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbf7032-988b-4ff6-a99d-3945b4fb8d3c None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:36.301560 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5415b6-7bfb-47df-b9bc-6d6f257c4ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:36.302477 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5415b6-7bfb-47df-b9bc-6d6f257c4ac2 None admin] REQUEST_METHOD: `PUT` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:36.302764 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5415b6-7bfb-47df-b9bc-6d6f257c4ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:36.303050 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5415b6-7bfb-47df-b9bc-6d6f257c4ac2 None admin] PATH_INFO: `/v3/projects/f3e1d023a52c42b98d018617987ef83c/users/ba38b47a31b14526be0aa2054841881b/roles/ed6a4c87428044ddbc5199cfb05de27e` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:36.310286 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d319c4-3d75-4b20-a96b-5c765508c202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:36.311093 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d319c4-3d75-4b20-a96b-5c765508c202 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:36.311411 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d319c4-3d75-4b20-a96b-5c765508c202 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:36.311698 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d319c4-3d75-4b20-a96b-5c765508c202 None admin] PATH_INFO: `/v3/users/glance` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:36.320368 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d319c4-3d75-4b20-a96b-5c765508c202 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:36.321550 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5415b6-7bfb-47df-b9bc-6d6f257c4ac2 None admin] RBAC: Authorizing `identity:create_grant(project_id=f3e1d023a52c42b98d018617987ef83c, user_id=ba38b47a31b14526be0aa2054841881b, role_id=ed6a4c87428044ddbc5199cfb05de27e)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:36.321819 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d319c4-3d75-4b20-a96b-5c765508c202 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:36.322999 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5415b6-7bfb-47df-b9bc-6d6f257c4ac2 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:36.337111 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-d7d319c4-3d75-4b20-a96b-5c765508c202 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 14 17:37:36.337111 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:36.337111 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:36.337111 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:36.337111 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:36.337111 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:36.337111 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:36.337111 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:36.337111 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:36.337111 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:36.337111 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:36.337111 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:36.337111 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 14 17:37:36.337111 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 14 17:37:36.337111 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 14 17:37:36.337111 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 14 17:37:36.339045 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:36.339045 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:36.339045 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 14 17:37:36.339045 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:37:36.339045 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 14 17:37:36.339045 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:37:36.339045 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:36.339045 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:36.339045 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:36.339045 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:36.339045 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:36.339045 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:36.339045 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:36.339045 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:36.339045 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:36.339045 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:36.339045 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:36.339045 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:36.340067 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:36.340067 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:36.340067 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 14 17:37:36.340067 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 14 17:37:36.340067 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 14 17:37:36.340067 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 14 17:37:36.340067 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 14 17:37:36.340067 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 14 17:37:36.340067 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 14 17:37:36.340067 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:37:36.340067 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 322/638] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 14 17:37:36 2022] GET /identity/v3/users/glance => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:37:36.340067 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d319c4-3d75-4b20-a96b-5c765508c202 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:36.403967 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 317/639] 10.222.0.36 () {58 vars in 1439 bytes} [Tue Jun 14 17:37:36 2022] PUT /identity/v3/projects/f3e1d023a52c42b98d018617987ef83c/users/ba38b47a31b14526be0aa2054841881b/roles/ed6a4c87428044ddbc5199cfb05de27e => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:37:36.405151 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5415b6-7bfb-47df-b9bc-6d6f257c4ac2 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:36.441653 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:36.466174 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d319c4-3d75-4b20-a96b-5c765508c202 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:36.508825 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a11c16-9e19-40ad-b22c-eba2e50a5c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:36.509548 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a11c16-9e19-40ad-b22c-eba2e50a5c64 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:36.509835 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a11c16-9e19-40ad-b22c-eba2e50a5c64 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:36.510173 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a11c16-9e19-40ad-b22c-eba2e50a5c64 None admin] PATH_INFO: `/v3/domains` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:36.510973 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a11c16-9e19-40ad-b22c-eba2e50a5c64 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:36.511292 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a11c16-9e19-40ad-b22c-eba2e50a5c64 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:36.512992 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a11c16-9e19-40ad-b22c-eba2e50a5c64 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:36.527113 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 323/640] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 14 17:37:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:36.528471 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a11c16-9e19-40ad-b22c-eba2e50a5c64 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:36.536298 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5415b6-7bfb-47df-b9bc-6d6f257c4ac2 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:36.578457 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac48674-a708-4bcf-bebf-b5106320e311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:36.578799 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac48674-a708-4bcf-bebf-b5106320e311 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:36.579047 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac48674-a708-4bcf-bebf-b5106320e311 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:36.579352 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac48674-a708-4bcf-bebf-b5106320e311 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:36.583738 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:36.593153 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac48674-a708-4bcf-bebf-b5106320e311 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:37:36.602257 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-9ac48674-a708-4bcf-bebf-b5106320e311 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 14 17:37:36.602257 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:36.602257 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:36.602257 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:36.602257 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:36.602257 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:36.602257 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:36.602257 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:36.602257 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:36.602257 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:36.602257 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:36.602257 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:36.602257 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:37:36.602257 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:37:36.602257 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:37:36.602257 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:37:36.603554 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:37:36.603554 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:37:36.603554 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:37:36.603554 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:37:36.603554 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:36.603554 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:36.603554 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:36.603554 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:36.603554 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:36.603554 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:36.603554 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:36.603554 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:36.603554 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:36.603554 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:36.603554 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:36.603554 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:36.604629 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:36.604629 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:36.604629 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:36.604629 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:36.604629 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:37:36.604629 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:37:36.604629 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:37:36.604629 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:37:36.604629 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:37:36.604629 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:37:36.604629 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 14 17:37:36.604629 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:37:36.604629 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 318/641] 10.222.0.36 () {56 vars in 1102 bytes} [Tue Jun 14 17:37:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:37:36.605494 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc157a3-5cd3-4ede-abba-b358d07cb8fe None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:36.605577 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc157a3-5cd3-4ede-abba-b358d07cb8fe None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:36.605816 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc157a3-5cd3-4ede-abba-b358d07cb8fe None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:36.607430 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 319/642] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:37:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:37:36.608001 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc157a3-5cd3-4ede-abba-b358d07cb8fe None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:36.661045 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a11c16-9e19-40ad-b22c-eba2e50a5c64 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:36.697764 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fefbf3-6315-4327-8f0c-b9df010cc972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:36.698453 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fefbf3-6315-4327-8f0c-b9df010cc972 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:36.698750 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fefbf3-6315-4327-8f0c-b9df010cc972 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:36.699034 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fefbf3-6315-4327-8f0c-b9df010cc972 None admin] PATH_INFO: `/v3/users` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:36.699938 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fefbf3-6315-4327-8f0c-b9df010cc972 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:36.700256 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fefbf3-6315-4327-8f0c-b9df010cc972 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:36.701726 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fefbf3-6315-4327-8f0c-b9df010cc972 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:36.712785 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:36.727619 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 324/643] 10.222.0.36 () {56 vars in 1137 bytes} [Tue Jun 14 17:37:36 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:36.727619 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fefbf3-6315-4327-8f0c-b9df010cc972 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:36.740984 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc157a3-5cd3-4ede-abba-b358d07cb8fe None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:36.783045 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce912b4-eb76-4175-9447-27f28993276c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:36.784271 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce912b4-eb76-4175-9447-27f28993276c None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:36.784804 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce912b4-eb76-4175-9447-27f28993276c None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:36.785313 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce912b4-eb76-4175-9447-27f28993276c None admin] PATH_INFO: `/v3/projects/service` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:36.793547 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce912b4-eb76-4175-9447-27f28993276c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:36.795144 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce912b4-eb76-4175-9447-27f28993276c None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:36.810362 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-dce912b4-eb76-4175-9447-27f28993276c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:37:36.810362 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:36.810362 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:36.810362 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:36.810362 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:36.810362 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:36.810362 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:36.810362 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:36.810362 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:36.810362 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:36.810362 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:36.810362 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:36.810362 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 14 17:37:36.810362 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 14 17:37:36.810362 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 14 17:37:36.811382 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 14 17:37:36.811382 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:36.811382 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:36.811382 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:36.811382 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:36.811382 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:36.811382 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:36.811382 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:36.811382 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:36.811382 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:36.811382 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:36.811382 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:36.811382 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:36.811382 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:36.811382 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:36.811382 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:36.811382 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:36.812442 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 14 17:37:36.812442 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 14 17:37:36.812442 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 14 17:37:36.812442 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 14 17:37:36.812442 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 14 17:37:36.812442 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 14 17:37:36.812442 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:37:36.812442 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:37:36.816882 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 320/644] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 14 17:37:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:37:36.818273 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b7984f-c9b7-409e-8324-66799a40ff1d None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:36.818625 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b7984f-c9b7-409e-8324-66799a40ff1d None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:36.818914 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b7984f-c9b7-409e-8324-66799a40ff1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:36.837605 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-49b7984f-c9b7-409e-8324-66799a40ff1d None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:37:36.838853 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-49b7984f-c9b7-409e-8324-66799a40ff1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:37:36.851094 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fefbf3-6315-4327-8f0c-b9df010cc972 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:36.897597 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389e4694-3842-4fc6-b8f1-ae9c4ea47171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:36.898310 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389e4694-3842-4fc6-b8f1-ae9c4ea47171 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:36.898624 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389e4694-3842-4fc6-b8f1-ae9c4ea47171 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:36.898895 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389e4694-3842-4fc6-b8f1-ae9c4ea47171 None admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:36.899717 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389e4694-3842-4fc6-b8f1-ae9c4ea47171 None admin] RBAC: Adding query filter params (name=service) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:36.900037 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389e4694-3842-4fc6-b8f1-ae9c4ea47171 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:36.901480 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389e4694-3842-4fc6-b8f1-ae9c4ea47171 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:36.908539 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:36.915962 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 325/645] 10.222.0.36 () {56 vars in 1103 bytes} [Tue Jun 14 17:37:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:36.915962 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389e4694-3842-4fc6-b8f1-ae9c4ea47171 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:36.932453 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 321/646] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:37:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:37:36.933353 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b7984f-c9b7-409e-8324-66799a40ff1d None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:36.997807 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:37.055842 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389e4694-3842-4fc6-b8f1-ae9c4ea47171 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:37.063117 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b7984f-c9b7-409e-8324-66799a40ff1d None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:37.101563 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ea90c6-fb9c-476c-a600-b53eb61bad04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:37.102225 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ea90c6-fb9c-476c-a600-b53eb61bad04 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:37.102522 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ea90c6-fb9c-476c-a600-b53eb61bad04 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:37.102804 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ea90c6-fb9c-476c-a600-b53eb61bad04 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:37.107443 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c91a482-896a-4ce1-be9c-41be780cb51d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:37.108123 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c91a482-896a-4ce1-be9c-41be780cb51d None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:37.108419 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c91a482-896a-4ce1-be9c-41be780cb51d None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:37.108700 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c91a482-896a-4ce1-be9c-41be780cb51d None admin] PATH_INFO: `/v3/projects` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:37.109512 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c91a482-896a-4ce1-be9c-41be780cb51d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:37.109829 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c91a482-896a-4ce1-be9c-41be780cb51d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:37.111356 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c91a482-896a-4ce1-be9c-41be780cb51d None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:37.125689 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 322/647] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jun 14 17:37:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:37.128047 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c91a482-896a-4ce1-be9c-41be780cb51d None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:37.178863 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:37.205886 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ea90c6-fb9c-476c-a600-b53eb61bad04 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:37.209070 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ea90c6-fb9c-476c-a600-b53eb61bad04 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:37.241276 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c91a482-896a-4ce1-be9c-41be780cb51d None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:37.277662 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1c5f11-b1d3-4969-bbf7-498098f5e742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:37.278816 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1c5f11-b1d3-4969-bbf7-498098f5e742 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:37.279261 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1c5f11-b1d3-4969-bbf7-498098f5e742 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:37.279576 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1c5f11-b1d3-4969-bbf7-498098f5e742 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:37.281352 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:37.294129 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1c5f11-b1d3-4969-bbf7-498098f5e742 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:37.295651 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1c5f11-b1d3-4969-bbf7-498098f5e742 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:37.314441 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-fe1c5f11-b1d3-4969-bbf7-498098f5e742 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:37:37.314441 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:37.314441 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:37.314441 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:37.314441 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:37.314441 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:37.314441 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:37.314441 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:37.314441 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:37.314441 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:37.314441 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:37.314441 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:37.314441 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:37:37.314441 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:37:37.314441 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:37:37.316152 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:37:37.316152 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:37.316152 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:37.316152 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:37.316152 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:37.316152 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:37.316152 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:37.316152 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:37.316152 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:37.316152 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:37.316152 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:37.316152 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:37.316152 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:37.316152 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:37.316152 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:37.316152 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:37.316152 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:37.317075 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:37:37.317075 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:37:37.317075 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:37:37.317075 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:37:37.317075 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 323/648] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 14 17:37:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:37:37.317795 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1c5f11-b1d3-4969-bbf7-498098f5e742 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:37.335114 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 326/649] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 14 17:37:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 14 17:37:37.336273 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ea90c6-fb9c-476c-a600-b53eb61bad04 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:37.426864 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:37.431205 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1c5f11-b1d3-4969-bbf7-498098f5e742 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:37.456095 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ea90c6-fb9c-476c-a600-b53eb61bad04 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:37.466711 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7f371b-369f-459f-b152-9c20f470000b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:37.467561 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7f371b-369f-459f-b152-9c20f470000b None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:37.467855 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7f371b-369f-459f-b152-9c20f470000b None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:37.468140 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7f371b-369f-459f-b152-9c20f470000b None admin] PATH_INFO: `/v3/roles/service` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:37.479836 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7f371b-369f-459f-b152-9c20f470000b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:37:37.488890 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-2a7f371b-369f-459f-b152-9c20f470000b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 14 17:37:37.488890 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:37.488890 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:37.488890 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:37.488890 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:37.488890 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:37.488890 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:37.488890 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:37.488890 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:37.488890 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:37.488890 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:37.488890 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:37.488890 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:37:37.488890 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:37:37.488890 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:37:37.488890 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:37:37.489885 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:37:37.489885 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:37:37.489885 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:37:37.489885 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:37:37.489885 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:37.489885 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:37.489885 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:37.489885 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:37.489885 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:37.489885 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:37.489885 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:37.489885 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:37.489885 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:37.489885 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:37.489885 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:37.489885 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:37.490728 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:37.490728 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:37.490728 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:37.490728 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:37.490728 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:37:37.490728 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:37:37.490728 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:37:37.490728 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:37:37.490728 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:37:37.490728 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:37:37.490728 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 14 17:37:37.490728 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:37:37.493618 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 324/650] 10.222.0.36 () {56 vars in 1102 bytes} [Tue Jun 14 17:37:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:37:37.494263 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7f371b-369f-459f-b152-9c20f470000b None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:37.500023 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb96837-d54c-4f6f-a559-8203ba333892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:37.501030 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb96837-d54c-4f6f-a559-8203ba333892 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:37.501526 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb96837-d54c-4f6f-a559-8203ba333892 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:37.502012 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb96837-d54c-4f6f-a559-8203ba333892 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:37.504104 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb96837-d54c-4f6f-a559-8203ba333892 None admin] RBAC: Adding query filter params (role.id=ed6a4c87428044ddbc5199cfb05de27e, scope.project.id=f3e1d023a52c42b98d018617987ef83c, user.id=e4696d396adb495ab300a9a5a5727595) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:37.504926 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb96837-d54c-4f6f-a559-8203ba333892 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:37.507535 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb96837-d54c-4f6f-a559-8203ba333892 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:37.523348 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 327/651] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 14 17:37:37 2022] GET /identity/v3/role_assignments?user.id=e4696d396adb495ab300a9a5a5727595&scope.project.id=f3e1d023a52c42b98d018617987ef83c&role.id=ed6a4c87428044ddbc5199cfb05de27e => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:37.523348 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb96837-d54c-4f6f-a559-8203ba333892 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:37.553335 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:37.649775 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7f371b-369f-459f-b152-9c20f470000b None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:37.668519 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb96837-d54c-4f6f-a559-8203ba333892 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:37.703945 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443d1e2d-9a4f-4993-ae59-34a34ec955a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:37.706149 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443d1e2d-9a4f-4993-ae59-34a34ec955a3 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:37.706578 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443d1e2d-9a4f-4993-ae59-34a34ec955a3 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:37.706870 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443d1e2d-9a4f-4993-ae59-34a34ec955a3 None admin] PATH_INFO: `/v3/domains` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:37.708344 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443d1e2d-9a4f-4993-ae59-34a34ec955a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:37.708667 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443d1e2d-9a4f-4993-ae59-34a34ec955a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:37.710272 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443d1e2d-9a4f-4993-ae59-34a34ec955a3 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:37.716348 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952ba3df-1712-4c6e-b5bd-d14b216fab08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:37.717161 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952ba3df-1712-4c6e-b5bd-d14b216fab08 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:37.717446 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952ba3df-1712-4c6e-b5bd-d14b216fab08 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:37.717732 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952ba3df-1712-4c6e-b5bd-d14b216fab08 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:37.725575 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 325/652] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 14 17:37:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:37.726449 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443d1e2d-9a4f-4993-ae59-34a34ec955a3 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:37.736073 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952ba3df-1712-4c6e-b5bd-d14b216fab08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:37.738670 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952ba3df-1712-4c6e-b5bd-d14b216fab08 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:37.748675 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:37.765314 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-952ba3df-1712-4c6e-b5bd-d14b216fab08 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:37:37.765314 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:37.765314 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:37.765314 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:37.765314 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:37.765314 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:37.765314 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:37.765314 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:37.765314 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:37.765314 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:37.765314 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:37.765314 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:37.765314 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:37:37.765314 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:37:37.765314 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:37:37.766270 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:37:37.766270 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:37.766270 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:37.766270 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:37.766270 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:37.766270 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:37.766270 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:37.766270 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:37.766270 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:37.766270 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:37.766270 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:37.766270 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:37.766270 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:37.766270 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:37.766270 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:37.766270 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:37.766270 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:37.767156 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:37:37.767156 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:37:37.767156 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:37:37.767156 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:37:37.767156 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 328/653] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 14 17:37:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:37:37.769508 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952ba3df-1712-4c6e-b5bd-d14b216fab08 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:37.861113 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443d1e2d-9a4f-4993-ae59-34a34ec955a3 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:37.869964 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:37.900139 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89f7e30-4f11-43b6-893a-1cddfd479413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:37.901068 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89f7e30-4f11-43b6-893a-1cddfd479413 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:37.901543 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89f7e30-4f11-43b6-893a-1cddfd479413 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:37.902005 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89f7e30-4f11-43b6-893a-1cddfd479413 None admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:37.902966 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89f7e30-4f11-43b6-893a-1cddfd479413 None admin] RBAC: Adding query filter params (name=service) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:37.903531 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89f7e30-4f11-43b6-893a-1cddfd479413 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:37.904989 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952ba3df-1712-4c6e-b5bd-d14b216fab08 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:37.905482 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89f7e30-4f11-43b6-893a-1cddfd479413 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:37.917637 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 326/654] 10.222.0.36 () {56 vars in 1103 bytes} [Tue Jun 14 17:37:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:37.918767 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89f7e30-4f11-43b6-893a-1cddfd479413 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:37.951334 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ea0f78-5191-4ca4-9dd3-9fd0aa9e4b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:37.952300 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ea0f78-5191-4ca4-9dd3-9fd0aa9e4b86 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:37.952686 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ea0f78-5191-4ca4-9dd3-9fd0aa9e4b86 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:37.953064 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ea0f78-5191-4ca4-9dd3-9fd0aa9e4b86 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:37.961309 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ea0f78-5191-4ca4-9dd3-9fd0aa9e4b86 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:37.962986 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ea0f78-5191-4ca4-9dd3-9fd0aa9e4b86 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:37.982369 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-35ea0f78-5191-4ca4-9dd3-9fd0aa9e4b86 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 14 17:37:37.982369 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:37.982369 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:37.982369 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:37.982369 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:37.982369 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:37.982369 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:37.982369 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:37.982369 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:37.982369 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:37.982369 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:37.982369 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:37.982369 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 14 17:37:37.982369 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 14 17:37:37.982369 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 14 17:37:37.982369 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 14 17:37:37.983445 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:37.983445 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:37.983445 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 14 17:37:37.983445 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:37:37.983445 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 14 17:37:37.983445 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:37:37.983445 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:37.983445 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:37.983445 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:37.983445 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:37.983445 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:37.983445 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:37.983445 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:37.983445 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:37.983445 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:37.983445 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:37.983445 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:37.983445 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:37.984401 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:37.984401 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:37.984401 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 14 17:37:37.984401 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 14 17:37:37.984401 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 14 17:37:37.984401 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 14 17:37:37.984401 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 14 17:37:37.984401 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 14 17:37:37.984401 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 14 17:37:37.984401 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:37:37.984401 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 329/655] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 14 17:37:37 2022] GET /identity/v3/users/cinder => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:37:37.985397 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ea0f78-5191-4ca4-9dd3-9fd0aa9e4b86 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:38.022673 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:38.044221 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89f7e30-4f11-43b6-893a-1cddfd479413 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:38.084353 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b4e6b5-d24e-4680-9ad7-2ba06d086fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:38.085156 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b4e6b5-d24e-4680-9ad7-2ba06d086fa1 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:38.085512 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b4e6b5-d24e-4680-9ad7-2ba06d086fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:38.085867 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b4e6b5-d24e-4680-9ad7-2ba06d086fa1 None admin] PATH_INFO: `/v3/domains` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:38.086679 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b4e6b5-d24e-4680-9ad7-2ba06d086fa1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:38.087084 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b4e6b5-d24e-4680-9ad7-2ba06d086fa1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:38.088634 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b4e6b5-d24e-4680-9ad7-2ba06d086fa1 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:38.107635 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 327/656] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 14 17:37:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:38.108756 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b4e6b5-d24e-4680-9ad7-2ba06d086fa1 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:38.111484 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ea0f78-5191-4ca4-9dd3-9fd0aa9e4b86 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:38.153796 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49e1428-7c52-4f01-80e7-48a35b950551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:38.154859 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49e1428-7c52-4f01-80e7-48a35b950551 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:38.155175 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49e1428-7c52-4f01-80e7-48a35b950551 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:38.155471 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49e1428-7c52-4f01-80e7-48a35b950551 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:38.157889 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:38.169290 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49e1428-7c52-4f01-80e7-48a35b950551 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:38.171108 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49e1428-7c52-4f01-80e7-48a35b950551 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:38.192229 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-f49e1428-7c52-4f01-80e7-48a35b950551 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:37:38.192229 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:38.192229 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:38.192229 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:38.192229 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:38.192229 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:38.192229 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:38.192229 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:38.192229 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:38.192229 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:38.192229 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:38.192229 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:38.192229 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:37:38.192229 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:37:38.192229 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:37:38.193423 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:37:38.193423 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:38.193423 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:38.193423 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:38.193423 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:38.193423 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:38.193423 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:38.193423 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:38.193423 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:38.193423 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:38.193423 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:38.193423 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:38.193423 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:38.193423 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:38.193423 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:38.193423 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:38.193423 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:38.194502 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:37:38.194502 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:37:38.194502 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:37:38.194502 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:37:38.196605 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 330/657] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 14 17:37:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:37:38.198729 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49e1428-7c52-4f01-80e7-48a35b950551 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:38.223225 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b4e6b5-d24e-4680-9ad7-2ba06d086fa1 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:38.262026 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e798231-2cee-46b2-814a-35ef06fd2de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:38.262808 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e798231-2cee-46b2-814a-35ef06fd2de5 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:38.263169 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e798231-2cee-46b2-814a-35ef06fd2de5 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:38.263546 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e798231-2cee-46b2-814a-35ef06fd2de5 None admin] PATH_INFO: `/v3/users` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:38.264467 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e798231-2cee-46b2-814a-35ef06fd2de5 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:38.264853 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e798231-2cee-46b2-814a-35ef06fd2de5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:38.266403 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e798231-2cee-46b2-814a-35ef06fd2de5 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:38.276073 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:38.287428 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 328/658] 10.222.0.36 () {56 vars in 1137 bytes} [Tue Jun 14 17:37:38 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:38.288144 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e798231-2cee-46b2-814a-35ef06fd2de5 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:38.344567 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49e1428-7c52-4f01-80e7-48a35b950551 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:38.393941 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e798231-2cee-46b2-814a-35ef06fd2de5 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:38.415755 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4b7b69-d88e-4b05-8df0-757be3cd8d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:38.417424 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4b7b69-d88e-4b05-8df0-757be3cd8d4e None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:38.418291 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4b7b69-d88e-4b05-8df0-757be3cd8d4e None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:38.419121 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4b7b69-d88e-4b05-8df0-757be3cd8d4e None admin] PATH_INFO: `/v3/projects/service` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:38.430848 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee735fd-fe24-493f-9671-29b27b55438b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:38.431567 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee735fd-fe24-493f-9671-29b27b55438b None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:38.432072 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee735fd-fe24-493f-9671-29b27b55438b None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:38.432314 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee735fd-fe24-493f-9671-29b27b55438b None admin] PATH_INFO: `/v3/domains` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:38.433049 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee735fd-fe24-493f-9671-29b27b55438b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:38.433366 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee735fd-fe24-493f-9671-29b27b55438b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:38.434134 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4b7b69-d88e-4b05-8df0-757be3cd8d4e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:38.434746 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee735fd-fe24-493f-9671-29b27b55438b None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:38.437579 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4b7b69-d88e-4b05-8df0-757be3cd8d4e None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:38.448020 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 329/659] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 14 17:37:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:38.448884 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee735fd-fe24-493f-9671-29b27b55438b None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:38.468314 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-9e4b7b69-d88e-4b05-8df0-757be3cd8d4e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:37:38.468314 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:38.468314 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:38.468314 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:38.468314 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:38.468314 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:38.468314 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:38.468314 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:38.468314 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:38.468314 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:38.468314 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:38.468314 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:38.468314 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 14 17:37:38.468314 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 14 17:37:38.468314 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 14 17:37:38.470243 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 14 17:37:38.470243 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:38.470243 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:38.470243 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:38.470243 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:38.470243 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:38.470243 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:38.470243 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:38.470243 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:38.470243 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:38.470243 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:38.470243 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:38.470243 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:38.470243 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:38.470243 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:38.470243 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:38.470243 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:38.472333 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 14 17:37:38.472333 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 14 17:37:38.472333 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 14 17:37:38.472333 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 14 17:37:38.472333 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 14 17:37:38.472333 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 14 17:37:38.472333 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:37:38.472333 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:37:38.475992 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 331/660] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 14 17:37:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:37:38.477697 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4b7b69-d88e-4b05-8df0-757be3cd8d4e None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:38.515276 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:38.564847 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee735fd-fe24-493f-9671-29b27b55438b None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:38.571498 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:38.607975 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19b73fb-cec9-4723-b87d-af4937a70988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:38.608645 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19b73fb-cec9-4723-b87d-af4937a70988 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:38.608968 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19b73fb-cec9-4723-b87d-af4937a70988 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:38.609255 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19b73fb-cec9-4723-b87d-af4937a70988 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:38.650923 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4b7b69-d88e-4b05-8df0-757be3cd8d4e None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:38.693097 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6602110e-ae4c-41bc-aea3-1eb62bdab517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:38.693834 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6602110e-ae4c-41bc-aea3-1eb62bdab517 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:38.694122 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6602110e-ae4c-41bc-aea3-1eb62bdab517 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:38.694402 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6602110e-ae4c-41bc-aea3-1eb62bdab517 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:38.700875 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19b73fb-cec9-4723-b87d-af4937a70988 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:38.702828 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6602110e-ae4c-41bc-aea3-1eb62bdab517 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:38.703102 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19b73fb-cec9-4723-b87d-af4937a70988 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:38.704494 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6602110e-ae4c-41bc-aea3-1eb62bdab517 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:38.728855 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-6602110e-ae4c-41bc-aea3-1eb62bdab517 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 14 17:37:38.728855 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:38.728855 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:38.728855 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:38.728855 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:38.728855 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:38.728855 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:38.728855 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:38.728855 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:38.728855 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:38.728855 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:38.728855 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:38.728855 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 14 17:37:38.728855 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 14 17:37:38.728855 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 14 17:37:38.728855 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 14 17:37:38.730057 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:38.730057 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:38.730057 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 14 17:37:38.730057 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:37:38.730057 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 14 17:37:38.730057 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:37:38.730057 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:38.730057 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:38.730057 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:38.730057 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:38.730057 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:38.730057 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:38.730057 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:38.730057 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:38.730057 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:38.730057 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:38.730057 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:38.730057 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:38.731342 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:38.731342 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:38.731342 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 14 17:37:38.731342 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 14 17:37:38.731342 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 14 17:37:38.731342 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 14 17:37:38.731342 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 14 17:37:38.731342 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 14 17:37:38.731342 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 14 17:37:38.731342 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:37:38.734481 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 332/661] 10.222.0.36 () {56 vars in 1102 bytes} [Tue Jun 14 17:37:38 2022] GET /identity/v3/users/neutron => generated 85 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:37:38.735618 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6602110e-ae4c-41bc-aea3-1eb62bdab517 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:38.772391 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:38.828105 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 330/662] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 14 17:37:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 14 17:37:38.829242 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19b73fb-cec9-4723-b87d-af4937a70988 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:38.882260 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6602110e-ae4c-41bc-aea3-1eb62bdab517 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:38.891958 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:38.925783 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58426a5e-13f9-45c6-bd4c-1bb861373a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:38.926465 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58426a5e-13f9-45c6-bd4c-1bb861373a17 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:38.926761 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58426a5e-13f9-45c6-bd4c-1bb861373a17 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:38.927049 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58426a5e-13f9-45c6-bd4c-1bb861373a17 None admin] PATH_INFO: `/v3/projects` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:38.927918 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58426a5e-13f9-45c6-bd4c-1bb861373a17 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:38.928210 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58426a5e-13f9-45c6-bd4c-1bb861373a17 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:38.929664 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58426a5e-13f9-45c6-bd4c-1bb861373a17 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:38.948446 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 333/663] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jun 14 17:37:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:38.949298 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58426a5e-13f9-45c6-bd4c-1bb861373a17 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:38.950194 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19b73fb-cec9-4723-b87d-af4937a70988 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:38.990966 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7319cf-0a80-4f44-919f-f517322c7780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:38.991688 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7319cf-0a80-4f44-919f-f517322c7780 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:38.991979 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7319cf-0a80-4f44-919f-f517322c7780 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:38.992262 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7319cf-0a80-4f44-919f-f517322c7780 None admin] PATH_INFO: `/v3/users` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:38.993113 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7319cf-0a80-4f44-919f-f517322c7780 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:38.993428 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7319cf-0a80-4f44-919f-f517322c7780 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:38.995762 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7319cf-0a80-4f44-919f-f517322c7780 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:39.021974 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 331/664] 10.222.0.36 () {56 vars in 1139 bytes} [Tue Jun 14 17:37:38 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:39.023426 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab422292-128f-47dc-b2ef-d59990104e2a None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:39.023722 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab422292-128f-47dc-b2ef-d59990104e2a None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:39.030349 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab422292-128f-47dc-b2ef-d59990104e2a None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:39.030349 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 332/665] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:37:39 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:37:39.030349 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab422292-128f-47dc-b2ef-d59990104e2a None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:39.049948 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:39.063926 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58426a5e-13f9-45c6-bd4c-1bb861373a17 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:39.104874 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee96f65a-a35d-434c-a417-355fcd925564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:39.105685 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee96f65a-a35d-434c-a417-355fcd925564 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:39.105980 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee96f65a-a35d-434c-a417-355fcd925564 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:39.106259 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee96f65a-a35d-434c-a417-355fcd925564 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:39.118732 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee96f65a-a35d-434c-a417-355fcd925564 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:39.120238 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee96f65a-a35d-434c-a417-355fcd925564 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:39.140969 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-ee96f65a-a35d-434c-a417-355fcd925564 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:37:39.140969 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:39.140969 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:39.140969 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:39.140969 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:39.140969 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:39.140969 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:39.140969 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:39.140969 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:39.140969 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:39.140969 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:39.140969 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:39.140969 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:37:39.140969 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:37:39.140969 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:37:39.141963 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:37:39.141963 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:39.141963 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:39.141963 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:39.141963 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:39.141963 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:39.141963 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:39.141963 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:39.141963 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:39.141963 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:39.141963 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:39.141963 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:39.141963 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:39.141963 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:39.141963 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:39.141963 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:39.141963 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:39.142950 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:37:39.142950 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:37:39.142950 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:37:39.142950 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:37:39.142950 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 334/666] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 14 17:37:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:37:39.143548 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee96f65a-a35d-434c-a417-355fcd925564 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:39.162084 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab422292-128f-47dc-b2ef-d59990104e2a None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:39.169445 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:39.210574 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4663d258-3636-4a9a-9f20-893f6c440846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:39.210979 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4663d258-3636-4a9a-9f20-893f6c440846 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:39.211263 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4663d258-3636-4a9a-9f20-893f6c440846 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:39.211590 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4663d258-3636-4a9a-9f20-893f6c440846 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:39.212437 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4663d258-3636-4a9a-9f20-893f6c440846 None admin] RBAC: Adding query filter params (role.id=ed6a4c87428044ddbc5199cfb05de27e, scope.project.id=f3e1d023a52c42b98d018617987ef83c, user.id=359f5ed4eb684e769f552484ca9a34c7) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:39.212752 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4663d258-3636-4a9a-9f20-893f6c440846 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:39.214206 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4663d258-3636-4a9a-9f20-893f6c440846 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:39.221779 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 333/667] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 14 17:37:39 2022] GET /identity/v3/role_assignments?user.id=359f5ed4eb684e769f552484ca9a34c7&scope.project.id=f3e1d023a52c42b98d018617987ef83c&role.id=ed6a4c87428044ddbc5199cfb05de27e => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:39.223035 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e679a93-324e-4126-8cd9-754da2555af7 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:39.223352 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e679a93-324e-4126-8cd9-754da2555af7 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:39.223644 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e679a93-324e-4126-8cd9-754da2555af7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:39.248837 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-9e679a93-324e-4126-8cd9-754da2555af7 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:37:39.250110 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-9e679a93-324e-4126-8cd9-754da2555af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:37:39.307034 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee96f65a-a35d-434c-a417-355fcd925564 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:39.352090 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 334/668] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:37:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:37:39.354035 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e679a93-324e-4126-8cd9-754da2555af7 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:39.358407 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa2e08b-581b-43f8-b7f9-cde82f03ef88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:39.359897 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa2e08b-581b-43f8-b7f9-cde82f03ef88 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:39.360383 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa2e08b-581b-43f8-b7f9-cde82f03ef88 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:39.360817 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa2e08b-581b-43f8-b7f9-cde82f03ef88 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:39.382374 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:39.484213 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa2e08b-581b-43f8-b7f9-cde82f03ef88 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:39.485908 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa2e08b-581b-43f8-b7f9-cde82f03ef88 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:39.507797 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:39.535292 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e679a93-324e-4126-8cd9-754da2555af7 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:39.603408 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98df0abf-3ce0-457b-bead-5b4021afcf98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:39.604583 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98df0abf-3ce0-457b-bead-5b4021afcf98 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:39.605032 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98df0abf-3ce0-457b-bead-5b4021afcf98 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:39.605695 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98df0abf-3ce0-457b-bead-5b4021afcf98 None admin] PATH_INFO: `/v3/domains` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:39.606854 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98df0abf-3ce0-457b-bead-5b4021afcf98 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:39.607402 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98df0abf-3ce0-457b-bead-5b4021afcf98 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:39.609795 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98df0abf-3ce0-457b-bead-5b4021afcf98 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:39.627838 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 335/669] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 14 17:37:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:39.627838 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98df0abf-3ce0-457b-bead-5b4021afcf98 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:39.645187 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 335/670] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 14 17:37:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 14 17:37:39.646597 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa2e08b-581b-43f8-b7f9-cde82f03ef88 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:39.719161 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:39.763504 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98df0abf-3ce0-457b-bead-5b4021afcf98 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:39.779150 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa2e08b-581b-43f8-b7f9-cde82f03ef88 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:39.800716 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:39.805533 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252e4661-ff68-4435-b2ed-5d89237ba595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:39.806352 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e4661-ff68-4435-b2ed-5d89237ba595 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:39.806639 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e4661-ff68-4435-b2ed-5d89237ba595 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:39.806917 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e4661-ff68-4435-b2ed-5d89237ba595 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:39.820234 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252e4661-ff68-4435-b2ed-5d89237ba595 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:37:39.822210 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a04a1e2-f225-4f65-a9c6-f46c2b0a9b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:39.823023 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a04a1e2-f225-4f65-a9c6-f46c2b0a9b2a None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:39.823329 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a04a1e2-f225-4f65-a9c6-f46c2b0a9b2a None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:39.823614 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a04a1e2-f225-4f65-a9c6-f46c2b0a9b2a None admin] PATH_INFO: `/v3/projects/service` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:39.828182 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-252e4661-ff68-4435-b2ed-5d89237ba595 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 14 17:37:39.828182 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:39.828182 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:39.828182 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:39.828182 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:39.828182 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:39.828182 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:39.828182 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:39.828182 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:39.828182 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:39.828182 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:39.828182 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:39.828182 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:37:39.828182 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:37:39.828182 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:37:39.828182 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:37:39.829141 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:37:39.829141 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:37:39.829141 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:37:39.829141 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:37:39.829141 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:39.829141 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:39.829141 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:39.829141 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:39.829141 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:39.829141 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:39.829141 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:39.829141 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:39.829141 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:39.829141 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:39.829141 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:39.829141 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:39.831493 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:39.831493 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:39.831493 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:39.831493 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:39.831493 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:37:39.831493 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:37:39.831493 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:37:39.831493 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:37:39.831493 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:37:39.831493 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:37:39.831493 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 14 17:37:39.831493 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:37:39.831493 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 336/671] 10.222.0.36 () {56 vars in 1102 bytes} [Tue Jun 14 17:37:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:37:39.833132 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252e4661-ff68-4435-b2ed-5d89237ba595 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:39.839325 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a04a1e2-f225-4f65-a9c6-f46c2b0a9b2a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:39.839325 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a04a1e2-f225-4f65-a9c6-f46c2b0a9b2a None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:39.854248 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-7a04a1e2-f225-4f65-a9c6-f46c2b0a9b2a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:37:39.854248 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:39.854248 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:39.854248 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:39.854248 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:39.854248 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:39.854248 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:39.854248 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:39.854248 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:39.854248 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:39.854248 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:39.854248 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:39.854248 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 14 17:37:39.854248 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 14 17:37:39.854248 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 14 17:37:39.856382 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 14 17:37:39.856382 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:39.856382 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:39.856382 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:39.856382 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:39.856382 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:39.856382 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:39.856382 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:39.856382 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:39.856382 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:39.856382 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:39.856382 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:39.856382 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:39.856382 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:39.856382 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:39.856382 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:39.856382 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:39.858652 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 14 17:37:39.858652 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 14 17:37:39.858652 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 14 17:37:39.858652 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 14 17:37:39.858652 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 14 17:37:39.858652 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 14 17:37:39.858652 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:37:39.858652 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:37:39.867584 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 336/672] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 14 17:37:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:37:39.867584 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a04a1e2-f225-4f65-a9c6-f46c2b0a9b2a None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:39.959288 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252e4661-ff68-4435-b2ed-5d89237ba595 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:39.993976 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:40.001902 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0a45a6-784a-4c84-b927-05cabd755958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:40.003101 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a04a1e2-f225-4f65-a9c6-f46c2b0a9b2a None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:40.004049 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a45a6-784a-4c84-b927-05cabd755958 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:40.004049 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a45a6-784a-4c84-b927-05cabd755958 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:40.004049 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a45a6-784a-4c84-b927-05cabd755958 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:40.023902 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0a45a6-784a-4c84-b927-05cabd755958 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:40.023902 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0a45a6-784a-4c84-b927-05cabd755958 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:40.042045 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-ec0a45a6-784a-4c84-b927-05cabd755958 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:37:40.042045 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:40.042045 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:40.042045 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:40.042045 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:40.042045 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:40.042045 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:40.042045 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:40.042045 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:40.042045 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:40.042045 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:40.042045 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:40.042045 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:37:40.042045 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:37:40.042045 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:37:40.048499 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:37:40.048499 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:40.048499 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:40.048499 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:40.048499 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:40.048499 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:40.048499 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:40.048499 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:40.048499 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:40.048499 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:40.048499 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:40.048499 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:40.048499 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:40.048499 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:40.048499 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:40.048499 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:40.048499 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:40.050172 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:37:40.050172 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:37:40.050172 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:37:40.050172 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:37:40.050404 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e034d23-1f36-498f-b9fa-660c03e50c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:40.050404 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e034d23-1f36-498f-b9fa-660c03e50c10 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:40.050404 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e034d23-1f36-498f-b9fa-660c03e50c10 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:40.050404 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e034d23-1f36-498f-b9fa-660c03e50c10 None admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:40.050683 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e034d23-1f36-498f-b9fa-660c03e50c10 None admin] RBAC: Adding query filter params (name=service) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:40.050683 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e034d23-1f36-498f-b9fa-660c03e50c10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:40.050683 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e034d23-1f36-498f-b9fa-660c03e50c10 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:40.051442 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 337/673] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 14 17:37:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:37:40.052382 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0a45a6-784a-4c84-b927-05cabd755958 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:40.061660 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 337/674] 10.222.0.36 () {56 vars in 1103 bytes} [Tue Jun 14 17:37:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:40.061660 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f84202-53e6-4381-9c1f-67318b5107cc None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:40.061660 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f84202-53e6-4381-9c1f-67318b5107cc None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:40.061660 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f84202-53e6-4381-9c1f-67318b5107cc None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:40.061660 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 338/675] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:37:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:37:40.061660 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f84202-53e6-4381-9c1f-67318b5107cc None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:40.114936 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:40.186341 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f84202-53e6-4381-9c1f-67318b5107cc None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:40.203416 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0a45a6-784a-4c84-b927-05cabd755958 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:40.227736 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9a043e-52f0-4236-bd66-cfbec2ff7c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:40.228443 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9a043e-52f0-4236-bd66-cfbec2ff7c19 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:40.228744 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9a043e-52f0-4236-bd66-cfbec2ff7c19 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:40.229033 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9a043e-52f0-4236-bd66-cfbec2ff7c19 None admin] PATH_INFO: `/v3/domains` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:40.229772 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9a043e-52f0-4236-bd66-cfbec2ff7c19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:40.230090 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9a043e-52f0-4236-bd66-cfbec2ff7c19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:40.231576 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9a043e-52f0-4236-bd66-cfbec2ff7c19 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:40.247004 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 339/676] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 14 17:37:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:40.248247 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9a043e-52f0-4236-bd66-cfbec2ff7c19 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:40.253483 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74bd959-9bf0-40f8-a99e-429f6f9867e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:40.254708 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74bd959-9bf0-40f8-a99e-429f6f9867e0 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:40.254997 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74bd959-9bf0-40f8-a99e-429f6f9867e0 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:40.255285 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74bd959-9bf0-40f8-a99e-429f6f9867e0 None admin] PATH_INFO: `/v3/projects` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:40.256186 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74bd959-9bf0-40f8-a99e-429f6f9867e0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:40.256552 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74bd959-9bf0-40f8-a99e-429f6f9867e0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:40.258040 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74bd959-9bf0-40f8-a99e-429f6f9867e0 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:40.275572 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 338/677] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jun 14 17:37:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:40.278018 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d470854-f423-4515-9698-c2d493f7570a None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:40.278298 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d470854-f423-4515-9698-c2d493f7570a None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:40.278813 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d470854-f423-4515-9698-c2d493f7570a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:40.298773 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-4d470854-f423-4515-9698-c2d493f7570a None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:37:40.301648 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-4d470854-f423-4515-9698-c2d493f7570a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:37:40.345698 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:40.385575 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:40.385829 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 339/678] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:37:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:37:40.386673 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d470854-f423-4515-9698-c2d493f7570a None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:40.394916 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9a043e-52f0-4236-bd66-cfbec2ff7c19 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:40.436418 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81ff447-ab84-453d-81f9-97d156719d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:40.437294 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ff447-ab84-453d-81f9-97d156719d93 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:40.437582 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ff447-ab84-453d-81f9-97d156719d93 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:40.437856 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ff447-ab84-453d-81f9-97d156719d93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:40.450522 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81ff447-ab84-453d-81f9-97d156719d93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:40.452051 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81ff447-ab84-453d-81f9-97d156719d93 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:40.473062 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-a81ff447-ab84-453d-81f9-97d156719d93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:37:40.473062 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:40.473062 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:40.473062 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:40.473062 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:40.473062 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:40.473062 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:40.473062 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:40.473062 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:40.473062 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:40.473062 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:40.473062 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:40.473062 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:37:40.473062 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:37:40.473062 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:37:40.474154 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:37:40.474154 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:40.474154 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:40.474154 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:40.474154 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:40.474154 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:40.474154 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:40.474154 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:40.474154 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:40.474154 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:40.474154 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:40.474154 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:40.474154 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:40.474154 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:40.474154 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:40.474154 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:40.474154 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:40.475092 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:37:40.475092 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:37:40.475092 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:37:40.475092 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:37:40.475092 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 340/679] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 14 17:37:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:37:40.475999 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81ff447-ab84-453d-81f9-97d156719d93 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:40.519256 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d470854-f423-4515-9698-c2d493f7570a None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:40.567211 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc619bf5-2d78-4767-ae4c-572c2def22ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:40.568450 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc619bf5-2d78-4767-ae4c-572c2def22ef None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:40.568830 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc619bf5-2d78-4767-ae4c-572c2def22ef None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:40.569180 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc619bf5-2d78-4767-ae4c-572c2def22ef None admin] PATH_INFO: `/v3/projects/service` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:40.576815 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc619bf5-2d78-4767-ae4c-572c2def22ef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:40.578270 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc619bf5-2d78-4767-ae4c-572c2def22ef None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:40.597277 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-dc619bf5-2d78-4767-ae4c-572c2def22ef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:37:40.597277 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:40.597277 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:40.597277 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:40.597277 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:40.597277 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:40.597277 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:40.597277 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:40.597277 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:40.597277 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:40.597277 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:40.597277 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:40.597277 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 14 17:37:40.597277 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 14 17:37:40.597277 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 14 17:37:40.598290 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 14 17:37:40.598290 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:40.598290 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:40.598290 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:40.598290 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:40.598290 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:40.598290 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:40.598290 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:40.598290 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:40.598290 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:40.598290 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:40.598290 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:40.598290 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:40.598290 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:40.598290 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:40.598290 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:40.598290 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:40.599215 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 14 17:37:40.599215 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 14 17:37:40.599215 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 14 17:37:40.599215 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 14 17:37:40.599215 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 14 17:37:40.599215 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 14 17:37:40.599215 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:37:40.599215 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:37:40.599215 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 340/680] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 14 17:37:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:37:40.600297 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc619bf5-2d78-4767-ae4c-572c2def22ef None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:40.610073 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81ff447-ab84-453d-81f9-97d156719d93 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:40.639266 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:40.661840 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95398c53-3554-4405-bf2e-25e2b6dc4d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:40.662630 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95398c53-3554-4405-bf2e-25e2b6dc4d90 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:40.665563 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95398c53-3554-4405-bf2e-25e2b6dc4d90 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:40.665563 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95398c53-3554-4405-bf2e-25e2b6dc4d90 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:40.665563 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95398c53-3554-4405-bf2e-25e2b6dc4d90 None admin] RBAC: Adding query filter params (role.id=ed6a4c87428044ddbc5199cfb05de27e, scope.project.id=f3e1d023a52c42b98d018617987ef83c, user.id=17945e7d72954b8787e0ba09a9903247) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:40.665563 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95398c53-3554-4405-bf2e-25e2b6dc4d90 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:40.666935 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95398c53-3554-4405-bf2e-25e2b6dc4d90 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:40.675276 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 341/681] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 14 17:37:40 2022] GET /identity/v3/role_assignments?user.id=17945e7d72954b8787e0ba09a9903247&scope.project.id=f3e1d023a52c42b98d018617987ef83c&role.id=ed6a4c87428044ddbc5199cfb05de27e => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:40.676616 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95398c53-3554-4405-bf2e-25e2b6dc4d90 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:40.711805 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:40.763809 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc619bf5-2d78-4767-ae4c-572c2def22ef None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:40.820270 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dc4bbf-6aa2-481e-8253-f557f268ccf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:40.821564 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dc4bbf-6aa2-481e-8253-f557f268ccf8 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:40.822076 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dc4bbf-6aa2-481e-8253-f557f268ccf8 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:40.822810 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dc4bbf-6aa2-481e-8253-f557f268ccf8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:40.843508 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dc4bbf-6aa2-481e-8253-f557f268ccf8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:37:40.855680 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95398c53-3554-4405-bf2e-25e2b6dc4d90 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:40.858622 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-45dc4bbf-6aa2-481e-8253-f557f268ccf8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 17:37:40.858622 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:40.858622 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:40.858622 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:40.858622 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:40.858622 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:40.858622 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:40.858622 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:40.858622 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:40.858622 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:40.858622 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:40.858622 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:40.858622 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:37:40.858622 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:37:40.858622 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:37:40.858622 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:37:40.859669 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:37:40.859669 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:37:40.859669 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:37:40.859669 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:37:40.859669 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:40.859669 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:40.859669 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:40.859669 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:40.859669 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:40.859669 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:40.859669 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:40.859669 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:40.859669 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:40.859669 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:40.859669 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:40.859669 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:40.860552 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:40.860552 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:40.860552 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:40.860552 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:40.860552 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:37:40.860552 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:37:40.860552 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:37:40.860552 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:37:40.860552 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:37:40.860552 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:37:40.860552 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 17:37:40.860552 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:37:40.867844 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 341/682] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jun 14 17:37:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:37:40.869412 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dc4bbf-6aa2-481e-8253-f557f268ccf8 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:40.921032 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dddd0fc-6b60-4288-b854-9417efcac951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:40.921614 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dddd0fc-6b60-4288-b854-9417efcac951 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:40.921898 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dddd0fc-6b60-4288-b854-9417efcac951 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:40.922175 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dddd0fc-6b60-4288-b854-9417efcac951 None admin] PATH_INFO: `/v3/domains` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:40.922908 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dddd0fc-6b60-4288-b854-9417efcac951 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:40.924814 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dddd0fc-6b60-4288-b854-9417efcac951 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:40.924945 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dddd0fc-6b60-4288-b854-9417efcac951 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:40.944525 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 342/683] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 14 17:37:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:40.945578 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dddd0fc-6b60-4288-b854-9417efcac951 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:41.006062 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:41.022613 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dc4bbf-6aa2-481e-8253-f557f268ccf8 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:41.075582 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6421672b-5b0a-4e27-8fad-94338cf063ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:41.076660 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6421672b-5b0a-4e27-8fad-94338cf063ce None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:41.077151 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6421672b-5b0a-4e27-8fad-94338cf063ce None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:41.077654 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6421672b-5b0a-4e27-8fad-94338cf063ce None admin] PATH_INFO: `/v3/projects` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:41.079190 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6421672b-5b0a-4e27-8fad-94338cf063ce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:41.079781 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6421672b-5b0a-4e27-8fad-94338cf063ce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:41.082022 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:41.083554 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6421672b-5b0a-4e27-8fad-94338cf063ce None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:41.107510 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 342/684] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jun 14 17:37:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:41.108905 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6421672b-5b0a-4e27-8fad-94338cf063ce None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:41.110996 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dddd0fc-6b60-4288-b854-9417efcac951 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:41.150429 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2381c800-1b2b-45b0-af31-2b0b98ce26af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:41.151267 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2381c800-1b2b-45b0-af31-2b0b98ce26af None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:41.151681 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2381c800-1b2b-45b0-af31-2b0b98ce26af None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:41.152059 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2381c800-1b2b-45b0-af31-2b0b98ce26af None admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:41.152917 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2381c800-1b2b-45b0-af31-2b0b98ce26af None admin] RBAC: Adding query filter params (name=admin) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:41.153330 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2381c800-1b2b-45b0-af31-2b0b98ce26af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:41.154834 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2381c800-1b2b-45b0-af31-2b0b98ce26af None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:41.165142 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 343/685] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 14 17:37:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:41.166163 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2381c800-1b2b-45b0-af31-2b0b98ce26af None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:41.326931 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6421672b-5b0a-4e27-8fad-94338cf063ce None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:41.409525 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2381c800-1b2b-45b0-af31-2b0b98ce26af None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:41.410387 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c545ea79-bcdf-4bc7-8be1-0ece3c2bcdaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:41.411857 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c545ea79-bcdf-4bc7-8be1-0ece3c2bcdaf None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:41.412350 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c545ea79-bcdf-4bc7-8be1-0ece3c2bcdaf None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:41.413221 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c545ea79-bcdf-4bc7-8be1-0ece3c2bcdaf None admin] PATH_INFO: `/v3/users/swift` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:41.434073 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c545ea79-bcdf-4bc7-8be1-0ece3c2bcdaf None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:41.437494 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c545ea79-bcdf-4bc7-8be1-0ece3c2bcdaf None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:41.470824 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-c545ea79-bcdf-4bc7-8be1-0ece3c2bcdaf None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 14 17:37:41.470824 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:41.470824 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:41.470824 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:41.470824 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:41.470824 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:41.470824 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:41.470824 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:41.470824 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:41.470824 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:41.470824 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:41.470824 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:41.470824 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 14 17:37:41.470824 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 14 17:37:41.470824 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 14 17:37:41.470824 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 14 17:37:41.473381 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:41.473381 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:41.473381 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 14 17:37:41.473381 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:37:41.473381 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 14 17:37:41.473381 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:37:41.473381 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:41.473381 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:41.473381 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:41.473381 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:41.473381 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:41.473381 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:41.473381 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:41.473381 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:41.473381 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:41.473381 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:41.473381 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:41.473381 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:41.475348 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:41.475348 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:41.475348 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 14 17:37:41.475348 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 14 17:37:41.475348 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 14 17:37:41.475348 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 14 17:37:41.475348 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 14 17:37:41.475348 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 14 17:37:41.475348 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 14 17:37:41.475348 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:37:41.483341 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 343/686] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jun 14 17:37:41 2022] GET /identity/v3/users/swift => generated 83 bytes in 372 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:37:41.483341 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c545ea79-bcdf-4bc7-8be1-0ece3c2bcdaf None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:41.483758 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155255cc-a6b4-408f-918d-51689d879566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:41.483758 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155255cc-a6b4-408f-918d-51689d879566 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:41.483758 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155255cc-a6b4-408f-918d-51689d879566 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:41.484209 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155255cc-a6b4-408f-918d-51689d879566 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:41.485498 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155255cc-a6b4-408f-918d-51689d879566 None admin] RBAC: Adding query filter params (role.id=ed6a4c87428044ddbc5199cfb05de27e, scope.project.id=f3e1d023a52c42b98d018617987ef83c, user.id=5652329c71cd431fb579d69cef933b37) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:41.486178 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155255cc-a6b4-408f-918d-51689d879566 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:41.489190 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155255cc-a6b4-408f-918d-51689d879566 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:41.504705 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 344/687] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 14 17:37:41 2022] GET /identity/v3/role_assignments?user.id=5652329c71cd431fb579d69cef933b37&scope.project.id=f3e1d023a52c42b98d018617987ef83c&role.id=ed6a4c87428044ddbc5199cfb05de27e => generated 608 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:41.506250 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155255cc-a6b4-408f-918d-51689d879566 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:41.512000 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:41.535419 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:41.744665 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155255cc-a6b4-408f-918d-51689d879566 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:41.819847 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da92cc2-74af-4f41-8885-46cb852dfa54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:41.820950 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da92cc2-74af-4f41-8885-46cb852dfa54 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:41.821439 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da92cc2-74af-4f41-8885-46cb852dfa54 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:41.821955 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da92cc2-74af-4f41-8885-46cb852dfa54 None admin] PATH_INFO: `/v3/users` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:41.823861 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da92cc2-74af-4f41-8885-46cb852dfa54 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:41.824431 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da92cc2-74af-4f41-8885-46cb852dfa54 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:41.827512 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da92cc2-74af-4f41-8885-46cb852dfa54 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:41.872338 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 345/688] 10.222.0.36 () {56 vars in 1135 bytes} [Tue Jun 14 17:37:41 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:41.882093 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da92cc2-74af-4f41-8885-46cb852dfa54 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:41.896669 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c545ea79-bcdf-4bc7-8be1-0ece3c2bcdaf None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:41.967358 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199a1f38-09b2-4062-8139-b3b15d3c730b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:41.968189 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199a1f38-09b2-4062-8139-b3b15d3c730b None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:41.968475 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199a1f38-09b2-4062-8139-b3b15d3c730b None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:41.968754 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199a1f38-09b2-4062-8139-b3b15d3c730b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:41.987486 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199a1f38-09b2-4062-8139-b3b15d3c730b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:41.989671 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:41.989848 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199a1f38-09b2-4062-8139-b3b15d3c730b None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:42.017758 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-199a1f38-09b2-4062-8139-b3b15d3c730b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:37:42.017758 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:42.017758 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:42.017758 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:42.017758 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:42.017758 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:42.017758 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:42.017758 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:42.017758 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:42.017758 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:42.017758 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:42.017758 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:42.017758 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:37:42.017758 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:37:42.017758 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:37:42.019390 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:37:42.019390 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:42.019390 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:42.019390 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:42.019390 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:42.019390 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:42.019390 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:42.019390 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:42.019390 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:42.019390 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:42.019390 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:42.019390 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:42.019390 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:42.019390 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:42.019390 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:42.019390 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:42.019390 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:42.020298 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:37:42.020298 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:37:42.020298 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:37:42.020298 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:37:42.020940 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 344/689] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 14 17:37:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 540 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:37:42.022862 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a144f6-710a-4d9f-9c4f-dc31af1b93b1 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:42.030669 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a144f6-710a-4d9f-9c4f-dc31af1b93b1 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:42.031380 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a144f6-710a-4d9f-9c4f-dc31af1b93b1 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:42.035033 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 345/690] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:37:42 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:37:42.036597 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a144f6-710a-4d9f-9c4f-dc31af1b93b1 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:42.058961 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da92cc2-74af-4f41-8885-46cb852dfa54 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:42.116638 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:42.124642 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2617940d-034a-4b86-8c54-1a537037504f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:42.125728 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2617940d-034a-4b86-8c54-1a537037504f None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:42.126250 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2617940d-034a-4b86-8c54-1a537037504f None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:42.126779 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2617940d-034a-4b86-8c54-1a537037504f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:42.164261 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a144f6-710a-4d9f-9c4f-dc31af1b93b1 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:42.214325 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537b0ae3-7618-4f6d-b58c-9d1c68b71b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:42.215424 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537b0ae3-7618-4f6d-b58c-9d1c68b71b98 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:42.215911 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537b0ae3-7618-4f6d-b58c-9d1c68b71b98 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:42.216388 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537b0ae3-7618-4f6d-b58c-9d1c68b71b98 None admin] PATH_INFO: `/v3/domains` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:42.217350 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537b0ae3-7618-4f6d-b58c-9d1c68b71b98 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:42.217983 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537b0ae3-7618-4f6d-b58c-9d1c68b71b98 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:42.219598 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537b0ae3-7618-4f6d-b58c-9d1c68b71b98 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:42.235884 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 346/691] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 14 17:37:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:42.238757 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ff61f8-1fdc-41b9-870a-d2bc218de2b5 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:42.239353 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ff61f8-1fdc-41b9-870a-d2bc218de2b5 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:42.239855 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ff61f8-1fdc-41b9-870a-d2bc218de2b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:42.264819 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-d6ff61f8-1fdc-41b9-870a-d2bc218de2b5 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:37:42.266391 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-d6ff61f8-1fdc-41b9-870a-d2bc218de2b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:37:42.274112 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2617940d-034a-4b86-8c54-1a537037504f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:42.276917 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2617940d-034a-4b86-8c54-1a537037504f None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:42.351420 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 347/692] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:37:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:37:42.352730 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ff61f8-1fdc-41b9-870a-d2bc218de2b5 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:42.401187 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:42.435157 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:42.483519 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ff61f8-1fdc-41b9-870a-d2bc218de2b5 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:42.489201 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 346/693] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 14 17:37:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 608 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 14 17:37:42.491081 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2617940d-034a-4b86-8c54-1a537037504f None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:42.524611 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a465f4e0-9876-4e50-afde-1bfc68f4f084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:42.525321 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a465f4e0-9876-4e50-afde-1bfc68f4f084 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:42.525670 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a465f4e0-9876-4e50-afde-1bfc68f4f084 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:42.526010 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a465f4e0-9876-4e50-afde-1bfc68f4f084 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:42.535360 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a465f4e0-9876-4e50-afde-1bfc68f4f084 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:42.536941 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a465f4e0-9876-4e50-afde-1bfc68f4f084 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:42.553371 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-a465f4e0-9876-4e50-afde-1bfc68f4f084 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 14 17:37:42.553371 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:42.553371 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:42.553371 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:42.553371 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:42.553371 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:42.553371 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:42.553371 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:42.553371 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:42.553371 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:42.553371 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:42.553371 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:42.553371 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 14 17:37:42.553371 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 14 17:37:42.553371 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 14 17:37:42.553371 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 14 17:37:42.555382 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:42.555382 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:42.555382 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 14 17:37:42.555382 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:37:42.555382 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 14 17:37:42.555382 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:37:42.555382 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:42.555382 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:42.555382 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:42.555382 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:42.555382 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:42.555382 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:42.555382 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:42.555382 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:42.555382 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:42.555382 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:42.555382 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:42.555382 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:42.557357 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:42.557357 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:42.557357 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 14 17:37:42.557357 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 14 17:37:42.557357 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 14 17:37:42.557357 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 14 17:37:42.557357 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 14 17:37:42.557357 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 14 17:37:42.557357 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 14 17:37:42.557357 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:37:42.559440 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 348/694] 10.222.0.36 () {56 vars in 1093 bytes} [Tue Jun 14 17:37:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:37:42.560363 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a465f4e0-9876-4e50-afde-1bfc68f4f084 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:42.671876 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a465f4e0-9876-4e50-afde-1bfc68f4f084 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:42.687981 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:42.707081 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2617940d-034a-4b86-8c54-1a537037504f None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:42.709497 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988f905d-2218-4351-9b30-7f8df17bd53e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:42.710409 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988f905d-2218-4351-9b30-7f8df17bd53e None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:42.710791 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988f905d-2218-4351-9b30-7f8df17bd53e None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:42.711200 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988f905d-2218-4351-9b30-7f8df17bd53e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:42.723130 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988f905d-2218-4351-9b30-7f8df17bd53e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:42.725390 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988f905d-2218-4351-9b30-7f8df17bd53e None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:42.746194 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-988f905d-2218-4351-9b30-7f8df17bd53e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:37:42.746194 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:42.746194 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:42.746194 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:42.746194 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:42.746194 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:42.746194 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:42.746194 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:42.746194 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:42.746194 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:42.746194 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:42.746194 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:42.746194 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:37:42.746194 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:37:42.746194 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:37:42.748174 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:37:42.748174 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:42.748174 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:42.748174 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:42.748174 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:42.748174 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:42.748174 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:42.748174 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:42.748174 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:42.748174 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:42.748174 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:42.748174 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:42.748174 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:42.748174 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:42.748174 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:42.748174 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:42.748174 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:42.750565 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:37:42.750565 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:37:42.750565 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:37:42.750565 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:37:42.750565 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 349/695] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 14 17:37:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:37:42.750565 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988f905d-2218-4351-9b30-7f8df17bd53e None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:42.786793 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011845d3-db0b-4752-9b83-4f0b38aad078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:42.788733 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011845d3-db0b-4752-9b83-4f0b38aad078 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:42.789591 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011845d3-db0b-4752-9b83-4f0b38aad078 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:42.790368 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011845d3-db0b-4752-9b83-4f0b38aad078 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:42.811269 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011845d3-db0b-4752-9b83-4f0b38aad078 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:42.815670 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011845d3-db0b-4752-9b83-4f0b38aad078 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:42.856081 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-011845d3-db0b-4752-9b83-4f0b38aad078 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:37:42.856081 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:42.856081 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:42.856081 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:42.856081 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:42.856081 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:42.856081 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:42.856081 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:42.856081 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:42.856081 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:42.856081 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:42.856081 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:42.856081 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:37:42.856081 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:37:42.856081 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:37:42.865234 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:37:42.865234 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:42.865234 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:42.865234 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:42.865234 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:42.865234 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:42.865234 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:42.865234 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:42.865234 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:42.865234 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:42.865234 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:42.865234 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:42.865234 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:42.865234 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:42.865234 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:42.865234 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:42.865234 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:42.867022 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:37:42.867022 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:37:42.867022 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:37:42.867022 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:37:42.867022 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 347/696] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 14 17:37:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 370 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:37:42.867656 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988f905d-2218-4351-9b30-7f8df17bd53e None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:42.867796 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011845d3-db0b-4752-9b83-4f0b38aad078 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:42.896307 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:42.917124 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89decdce-c2ae-4b46-bc9b-b5a9d0cd9039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:42.917979 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89decdce-c2ae-4b46-bc9b-b5a9d0cd9039 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:42.918329 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89decdce-c2ae-4b46-bc9b-b5a9d0cd9039 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:42.918706 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89decdce-c2ae-4b46-bc9b-b5a9d0cd9039 None admin] PATH_INFO: `/v3/users` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:42.919690 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89decdce-c2ae-4b46-bc9b-b5a9d0cd9039 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:42.920128 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89decdce-c2ae-4b46-bc9b-b5a9d0cd9039 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:42.921667 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89decdce-c2ae-4b46-bc9b-b5a9d0cd9039 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:42.947873 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 350/697] 10.222.0.36 () {56 vars in 1133 bytes} [Tue Jun 14 17:37:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:42.949007 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89decdce-c2ae-4b46-bc9b-b5a9d0cd9039 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:42.978559 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:43.068706 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89decdce-c2ae-4b46-bc9b-b5a9d0cd9039 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:43.082682 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011845d3-db0b-4752-9b83-4f0b38aad078 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:43.109113 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b032799-6876-404a-aac0-1520ff5c4b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:43.110031 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b032799-6876-404a-aac0-1520ff5c4b99 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:43.110656 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b032799-6876-404a-aac0-1520ff5c4b99 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:43.110840 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b032799-6876-404a-aac0-1520ff5c4b99 None admin] PATH_INFO: `/v3/domains` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:43.112603 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b032799-6876-404a-aac0-1520ff5c4b99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:43.113380 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b032799-6876-404a-aac0-1520ff5c4b99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:43.116384 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b032799-6876-404a-aac0-1520ff5c4b99 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:43.147674 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 351/698] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 14 17:37:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:43.149769 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b032799-6876-404a-aac0-1520ff5c4b99 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:43.161404 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c997e9-cba4-4355-9bfb-a3a46d60e5dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:43.162895 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c997e9-cba4-4355-9bfb-a3a46d60e5dc None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:43.163659 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c997e9-cba4-4355-9bfb-a3a46d60e5dc None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:43.164367 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c997e9-cba4-4355-9bfb-a3a46d60e5dc None admin] PATH_INFO: `/v3/domains` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:43.165959 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c997e9-cba4-4355-9bfb-a3a46d60e5dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:43.166708 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c997e9-cba4-4355-9bfb-a3a46d60e5dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:43.169797 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c997e9-cba4-4355-9bfb-a3a46d60e5dc None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:43.195195 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 348/699] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 14 17:37:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:43.197149 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c997e9-cba4-4355-9bfb-a3a46d60e5dc None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:43.315565 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:43.343469 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:43.345468 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b032799-6876-404a-aac0-1520ff5c4b99 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:43.409741 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c997e9-cba4-4355-9bfb-a3a46d60e5dc None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:43.411903 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a568ca68-4853-44bf-893c-68c52dd32de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:43.413153 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a568ca68-4853-44bf-893c-68c52dd32de7 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:43.413759 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a568ca68-4853-44bf-893c-68c52dd32de7 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:43.414364 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a568ca68-4853-44bf-893c-68c52dd32de7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:43.481821 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd8a36a-1343-4ac1-b7e4-b2caeaf42436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:43.483339 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd8a36a-1343-4ac1-b7e4-b2caeaf42436 None admin] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:43.484094 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd8a36a-1343-4ac1-b7e4-b2caeaf42436 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:43.484808 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd8a36a-1343-4ac1-b7e4-b2caeaf42436 None admin] PATH_INFO: `/v3/users` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:43.486946 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd8a36a-1343-4ac1-b7e4-b2caeaf42436 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:43.490229 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd8a36a-1343-4ac1-b7e4-b2caeaf42436 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:43.557581 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a568ca68-4853-44bf-893c-68c52dd32de7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:43.560699 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a568ca68-4853-44bf-893c-68c52dd32de7 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:43.600148 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 349/700] 10.222.0.36 () {60 vars in 1132 bytes} [Tue Jun 14 17:37:43 2022] POST /identity/v3/users => generated 254 bytes in 404 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:37:43.602046 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd8a36a-1343-4ac1-b7e4-b2caeaf42436 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:43.740252 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:43.779726 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 352/701] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 14 17:37:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 626 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 14 17:37:43.782439 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb91c1b6-b706-40b0-b554-0d9a8a4d79e4 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:43.782952 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb91c1b6-b706-40b0-b554-0d9a8a4d79e4 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:43.783571 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb91c1b6-b706-40b0-b554-0d9a8a4d79e4 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:43.790490 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 353/702] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:37:43 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:37:43.791693 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb91c1b6-b706-40b0-b554-0d9a8a4d79e4 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:43.842599 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd8a36a-1343-4ac1-b7e4-b2caeaf42436 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:43.911996 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:43.929341 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e94bcd5-7a6d-4918-bba8-e61da4f3121c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:43.930828 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e94bcd5-7a6d-4918-bba8-e61da4f3121c None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:43.931521 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e94bcd5-7a6d-4918-bba8-e61da4f3121c None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:43.932114 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e94bcd5-7a6d-4918-bba8-e61da4f3121c None admin] PATH_INFO: `/v3/projects/service` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:43.946009 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e94bcd5-7a6d-4918-bba8-e61da4f3121c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:43.948960 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e94bcd5-7a6d-4918-bba8-e61da4f3121c None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:43.978716 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-1e94bcd5-7a6d-4918-bba8-e61da4f3121c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:37:43.978716 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:43.978716 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:43.978716 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:43.978716 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:43.978716 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:43.978716 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:43.978716 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:43.978716 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:43.978716 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:43.978716 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:43.978716 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:43.978716 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 14 17:37:43.978716 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 14 17:37:43.978716 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 14 17:37:43.980747 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 14 17:37:43.980747 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:43.980747 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:43.980747 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:43.980747 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:43.980747 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:43.980747 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:43.980747 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:43.980747 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:43.980747 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:43.980747 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:43.980747 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:43.980747 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:43.980747 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:43.980747 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:43.980747 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:43.980747 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:43.982878 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 14 17:37:43.982878 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 14 17:37:43.982878 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 14 17:37:43.982878 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 14 17:37:43.982878 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 14 17:37:43.982878 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 14 17:37:43.982878 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:37:43.982878 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:37:43.984270 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 350/703] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 14 17:37:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 383 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:37:43.987213 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775177d6-f502-406b-b45c-5c9f5ecd5e50 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:43.988366 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775177d6-f502-406b-b45c-5c9f5ecd5e50 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:43.989356 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775177d6-f502-406b-b45c-5c9f5ecd5e50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:44.006004 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb91c1b6-b706-40b0-b554-0d9a8a4d79e4 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:44.022061 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-775177d6-f502-406b-b45c-5c9f5ecd5e50 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:37:44.024596 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-775177d6-f502-406b-b45c-5c9f5ecd5e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:37:44.086455 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0866000-6333-4474-967d-1f2131fbd899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:44.088304 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0866000-6333-4474-967d-1f2131fbd899 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:44.088976 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0866000-6333-4474-967d-1f2131fbd899 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:44.089700 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0866000-6333-4474-967d-1f2131fbd899 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:44.112566 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0866000-6333-4474-967d-1f2131fbd899 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:44.115805 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0866000-6333-4474-967d-1f2131fbd899 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:44.137851 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-d0866000-6333-4474-967d-1f2131fbd899 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:37:44.137851 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:44.137851 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:44.137851 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:44.137851 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:44.137851 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:44.137851 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:44.137851 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:44.137851 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:44.137851 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:44.137851 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:44.137851 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:44.137851 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:37:44.137851 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:37:44.137851 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:37:44.139793 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:37:44.139793 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:44.139793 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:44.139793 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:44.139793 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:44.139793 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:44.139793 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:44.139793 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:44.139793 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:44.139793 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:44.139793 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:44.139793 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:44.139793 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:44.139793 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:44.139793 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:44.139793 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:44.139793 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:44.141425 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:37:44.141425 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:37:44.141425 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:37:44.141425 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:37:44.141425 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 354/704] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 14 17:37:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:37:44.141425 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0866000-6333-4474-967d-1f2131fbd899 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:44.167365 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 351/705] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:37:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:37:44.167632 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75bf4b5-9ab7-4fbb-85cf-a2b8ec4971af None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:44.167803 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75bf4b5-9ab7-4fbb-85cf-a2b8ec4971af None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:44.168169 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75bf4b5-9ab7-4fbb-85cf-a2b8ec4971af None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:44.169597 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 352/706] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:37:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:37:44.172784 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75bf4b5-9ab7-4fbb-85cf-a2b8ec4971af None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:44.232434 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:44.338483 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75bf4b5-9ab7-4fbb-85cf-a2b8ec4971af None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:44.357730 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0866000-6333-4474-967d-1f2131fbd899 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:44.360588 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:44.386266 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7246452-6178-448a-8d50-69b0318d3937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:44.387480 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7246452-6178-448a-8d50-69b0318d3937 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:44.388445 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7246452-6178-448a-8d50-69b0318d3937 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:44.388559 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7246452-6178-448a-8d50-69b0318d3937 None admin] PATH_INFO: `/v3/domains` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:44.389895 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7246452-6178-448a-8d50-69b0318d3937 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:44.390518 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7246452-6178-448a-8d50-69b0318d3937 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:44.394502 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7246452-6178-448a-8d50-69b0318d3937 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:44.404430 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b47576-72d8-43f8-a8aa-249e00063479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:44.405106 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b47576-72d8-43f8-a8aa-249e00063479 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:44.405390 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b47576-72d8-43f8-a8aa-249e00063479 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:44.405667 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b47576-72d8-43f8-a8aa-249e00063479 None admin] PATH_INFO: `/v3/projects` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:44.406478 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b47576-72d8-43f8-a8aa-249e00063479 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:44.406790 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b47576-72d8-43f8-a8aa-249e00063479 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:44.408616 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b47576-72d8-43f8-a8aa-249e00063479 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:44.416861 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 353/707] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 14 17:37:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:44.419784 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a300240-c3a4-4727-aedf-b3e8bc2f8d6e None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:44.420659 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a300240-c3a4-4727-aedf-b3e8bc2f8d6e None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:44.421709 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a300240-c3a4-4727-aedf-b3e8bc2f8d6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:44.428342 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 355/708] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jun 14 17:37:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:44.429185 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b47576-72d8-43f8-a8aa-249e00063479 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:44.450566 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-7a300240-c3a4-4727-aedf-b3e8bc2f8d6e None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:37:44.451814 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-7a300240-c3a4-4727-aedf-b3e8bc2f8d6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:37:44.535724 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 354/709] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:37:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:37:44.537164 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a300240-c3a4-4727-aedf-b3e8bc2f8d6e None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:44.590710 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:44.599558 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b47576-72d8-43f8-a8aa-249e00063479 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:44.656196 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a839ea66-860d-443c-b016-7a83fb9ed739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:44.657677 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a839ea66-860d-443c-b016-7a83fb9ed739 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:44.658732 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a839ea66-860d-443c-b016-7a83fb9ed739 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:44.659379 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a839ea66-860d-443c-b016-7a83fb9ed739 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:44.660651 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a839ea66-860d-443c-b016-7a83fb9ed739 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:44.664881 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a839ea66-860d-443c-b016-7a83fb9ed739 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:44.685566 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a300240-c3a4-4727-aedf-b3e8bc2f8d6e None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:44.693155 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-a839ea66-860d-443c-b016-7a83fb9ed739 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 14 17:37:44.693155 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:44.693155 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 14 17:37:44.693155 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 14 17:37:44.693155 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 14 17:37:44.693155 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 14 17:37:44.693155 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 14 17:37:44.693155 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 17:37:44.693155 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 14 17:37:44.693155 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:37:44.693155 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 14 17:37:44.693155 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:37:44.693155 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:44.693155 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:44.693155 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:44.693155 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:44.695118 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:44.695118 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:44.695118 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:44.695118 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:44.695118 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:44.695118 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:44.695118 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:44.695118 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 14 17:37:44.695118 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 14 17:37:44.695118 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 14 17:37:44.695118 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 14 17:37:44.695118 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:44.695118 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:44.695118 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:44.695118 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:44.695118 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:44.698176 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:44.698176 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:44.698176 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:44.698176 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:44.698176 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:44.698176 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:44.698176 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:44.698176 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:44.698176 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:44.698176 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:44.698176 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:44.698176 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 14 17:37:44.698176 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 17:37:44.698176 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 14 17:37:44.698176 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:37:44.698176 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 356/710] 10.222.0.36 () {56 vars in 1129 bytes} [Tue Jun 14 17:37:44 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:37:44.701042 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a839ea66-860d-443c-b016-7a83fb9ed739 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:44.703427 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:44.738777 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7a46e0-e7b2-4a58-851e-e37737dd4442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:44.739639 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7a46e0-e7b2-4a58-851e-e37737dd4442 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:44.739924 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7a46e0-e7b2-4a58-851e-e37737dd4442 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:44.740237 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7a46e0-e7b2-4a58-851e-e37737dd4442 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:44.751148 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7a46e0-e7b2-4a58-851e-e37737dd4442 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:44.754782 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7a46e0-e7b2-4a58-851e-e37737dd4442 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:44.774565 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-4f7a46e0-e7b2-4a58-851e-e37737dd4442 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:37:44.774565 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:44.774565 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:44.774565 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:44.774565 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:44.774565 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:44.774565 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:44.774565 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:44.774565 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:44.774565 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:44.774565 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:44.774565 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:44.774565 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 14 17:37:44.774565 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 14 17:37:44.774565 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 14 17:37:44.776584 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 14 17:37:44.776584 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:44.776584 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:44.776584 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:44.776584 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:44.776584 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:44.776584 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:44.776584 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:44.776584 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:44.776584 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:44.776584 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:44.776584 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:44.776584 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:44.776584 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:44.776584 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:44.776584 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:44.776584 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:44.786650 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 14 17:37:44.786650 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 14 17:37:44.786650 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 14 17:37:44.786650 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 14 17:37:44.786650 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 14 17:37:44.786650 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 14 17:37:44.786650 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:37:44.786650 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:37:44.786650 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 355/711] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 14 17:37:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:37:44.786650 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7a46e0-e7b2-4a58-851e-e37737dd4442 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:44.871221 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a839ea66-860d-443c-b016-7a83fb9ed739 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:44.918286 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7a46e0-e7b2-4a58-851e-e37737dd4442 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:44.948401 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67470cdb-eec5-4819-b8eb-c6d18721e67d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:44.949344 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67470cdb-eec5-4819-b8eb-c6d18721e67d None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:44.949810 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67470cdb-eec5-4819-b8eb-c6d18721e67d None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:44.950269 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67470cdb-eec5-4819-b8eb-c6d18721e67d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:44.952474 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67470cdb-eec5-4819-b8eb-c6d18721e67d None admin] RBAC: Adding query filter params (role.id=ed6a4c87428044ddbc5199cfb05de27e, scope.project.id=f3e1d023a52c42b98d018617987ef83c, user.id=ba38b47a31b14526be0aa2054841881b) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:44.953290 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67470cdb-eec5-4819-b8eb-c6d18721e67d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:44.956059 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67470cdb-eec5-4819-b8eb-c6d18721e67d None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:44.975348 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 357/712] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 14 17:37:44 2022] GET /identity/v3/role_assignments?user.id=ba38b47a31b14526be0aa2054841881b&scope.project.id=f3e1d023a52c42b98d018617987ef83c&role.id=ed6a4c87428044ddbc5199cfb05de27e => generated 608 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:44.975348 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67470cdb-eec5-4819-b8eb-c6d18721e67d None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:44.985226 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7200686-eefd-4c50-b97a-161bcf97f63c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:44.987579 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7200686-eefd-4c50-b97a-161bcf97f63c None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:44.988421 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7200686-eefd-4c50-b97a-161bcf97f63c None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:44.988951 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7200686-eefd-4c50-b97a-161bcf97f63c None admin] PATH_INFO: `/v3/services/network` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:44.990403 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7200686-eefd-4c50-b97a-161bcf97f63c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:44.993524 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7200686-eefd-4c50-b97a-161bcf97f63c None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:45.021235 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:45.030856 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-a7200686-eefd-4c50-b97a-161bcf97f63c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 14 17:37:45.030856 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:45.030856 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 14 17:37:45.030856 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 14 17:37:45.030856 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 14 17:37:45.030856 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 14 17:37:45.030856 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 14 17:37:45.030856 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 17:37:45.030856 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 14 17:37:45.030856 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:37:45.030856 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 14 17:37:45.030856 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:37:45.030856 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:45.030856 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:45.030856 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:45.030856 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:45.030856 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:45.033591 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:45.033591 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:45.033591 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:45.033591 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:45.033591 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:45.033591 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:45.033591 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 14 17:37:45.033591 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 14 17:37:45.033591 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 14 17:37:45.033591 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 14 17:37:45.033591 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:45.033591 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:45.033591 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:45.033591 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:45.033591 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:45.033591 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:45.035256 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:45.035256 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:45.035256 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:45.035256 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:45.035256 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:45.035256 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:45.035256 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:45.035256 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:45.035256 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:45.035256 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:45.035256 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 14 17:37:45.035256 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 17:37:45.035256 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 14 17:37:45.035256 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:37:45.035256 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 356/713] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 14 17:37:44 2022] GET /identity/v3/services/network => generated 88 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:37:45.037152 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7200686-eefd-4c50-b97a-161bcf97f63c None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:45.109847 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:45.198097 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67470cdb-eec5-4819-b8eb-c6d18721e67d None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:45.264038 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7200686-eefd-4c50-b97a-161bcf97f63c None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:45.275063 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363fab9f-ed60-4582-b2be-7e7ff96d758c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:45.276605 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363fab9f-ed60-4582-b2be-7e7ff96d758c None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:45.277322 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363fab9f-ed60-4582-b2be-7e7ff96d758c None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:45.277999 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363fab9f-ed60-4582-b2be-7e7ff96d758c None admin] PATH_INFO: `/v3/services` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:45.279549 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363fab9f-ed60-4582-b2be-7e7ff96d758c None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:45.280434 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363fab9f-ed60-4582-b2be-7e7ff96d758c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:45.283334 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363fab9f-ed60-4582-b2be-7e7ff96d758c None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:45.293516 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 358/714] 10.222.0.36 () {56 vars in 1124 bytes} [Tue Jun 14 17:37:44 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:45.297031 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363fab9f-ed60-4582-b2be-7e7ff96d758c None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:45.349763 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc1a8dc-cf9b-4a0d-a34c-5dbec7d34205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:45.351380 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc1a8dc-cf9b-4a0d-a34c-5dbec7d34205 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:45.351912 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc1a8dc-cf9b-4a0d-a34c-5dbec7d34205 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:45.352456 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc1a8dc-cf9b-4a0d-a34c-5dbec7d34205 None admin] PATH_INFO: `/v3/projects` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:45.354167 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc1a8dc-cf9b-4a0d-a34c-5dbec7d34205 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:45.355585 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc1a8dc-cf9b-4a0d-a34c-5dbec7d34205 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:45.358360 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc1a8dc-cf9b-4a0d-a34c-5dbec7d34205 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:45.391474 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 357/715] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jun 14 17:37:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:45.393968 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc1a8dc-cf9b-4a0d-a34c-5dbec7d34205 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:45.471949 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:45.501703 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363fab9f-ed60-4582-b2be-7e7ff96d758c None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:45.544097 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:45.553043 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc1a8dc-cf9b-4a0d-a34c-5dbec7d34205 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:45.587202 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04e0c21-39ee-47d4-987f-187972b2845b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:45.589493 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04e0c21-39ee-47d4-987f-187972b2845b None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:45.590900 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04e0c21-39ee-47d4-987f-187972b2845b None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:45.592104 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04e0c21-39ee-47d4-987f-187972b2845b None admin] PATH_INFO: `/v3/services` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:45.594659 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04e0c21-39ee-47d4-987f-187972b2845b None admin] RBAC: Adding query filter params (name=network) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:45.596061 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04e0c21-39ee-47d4-987f-187972b2845b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:45.600408 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04e0c21-39ee-47d4-987f-187972b2845b None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:45.604754 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77c30df-24ab-49b9-b475-12ea44323cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:45.605590 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77c30df-24ab-49b9-b475-12ea44323cc2 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:45.605931 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77c30df-24ab-49b9-b475-12ea44323cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:45.606167 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77c30df-24ab-49b9-b475-12ea44323cc2 None admin] PATH_INFO: `/v3/services` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:45.606920 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77c30df-24ab-49b9-b475-12ea44323cc2 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:45.607226 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77c30df-24ab-49b9-b475-12ea44323cc2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:45.609054 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77c30df-24ab-49b9-b475-12ea44323cc2 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:45.612609 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 359/716] 10.222.0.36 () {56 vars in 1112 bytes} [Tue Jun 14 17:37:45 2022] GET /identity/v3/services?name=network => generated 124 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:45.614526 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04e0c21-39ee-47d4-987f-187972b2845b None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:45.621868 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 358/717] 10.222.0.36 () {56 vars in 1124 bytes} [Tue Jun 14 17:37:45 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:45.628097 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77c30df-24ab-49b9-b475-12ea44323cc2 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:45.781385 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04e0c21-39ee-47d4-987f-187972b2845b None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:45.827378 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e82f328-79f8-488b-85cc-8ba2423dc586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:45.827973 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e82f328-79f8-488b-85cc-8ba2423dc586 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:45.828257 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e82f328-79f8-488b-85cc-8ba2423dc586 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:45.828537 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e82f328-79f8-488b-85cc-8ba2423dc586 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:45.829389 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e82f328-79f8-488b-85cc-8ba2423dc586 None admin] RBAC: Adding query filter params (role.id=1348580877d04014bfdec4d866b98a74, scope.project.id=f3e1d023a52c42b98d018617987ef83c, user.id=e4696d396adb495ab300a9a5a5727595) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:45.829704 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e82f328-79f8-488b-85cc-8ba2423dc586 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:45.832354 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e82f328-79f8-488b-85cc-8ba2423dc586 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:45.843550 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 360/718] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 14 17:37:45 2022] GET /identity/v3/role_assignments?user.id=e4696d396adb495ab300a9a5a5727595&scope.project.id=f3e1d023a52c42b98d018617987ef83c&role.id=1348580877d04014bfdec4d866b98a74 => generated 259 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:45.932201 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77c30df-24ab-49b9-b475-12ea44323cc2 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:46.005680 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3ed0f3-23b1-40d6-8633-281db603e38e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:46.006896 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3ed0f3-23b1-40d6-8633-281db603e38e None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:46.007449 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3ed0f3-23b1-40d6-8633-281db603e38e None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:46.007957 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3ed0f3-23b1-40d6-8633-281db603e38e None admin] PATH_INFO: `/v3/services` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:46.009434 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3ed0f3-23b1-40d6-8633-281db603e38e None admin] RBAC: Adding query filter params (type=network) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:46.009983 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3ed0f3-23b1-40d6-8633-281db603e38e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:46.012817 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3ed0f3-23b1-40d6-8633-281db603e38e None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:46.026029 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 359/719] 10.222.0.36 () {56 vars in 1112 bytes} [Tue Jun 14 17:37:45 2022] GET /identity/v3/services?type=network => generated 124 bytes in 403 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:46.448819 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db5538e-6f60-4aa1-a77c-e91d9e3e4e93 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:46.449351 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db5538e-6f60-4aa1-a77c-e91d9e3e4e93 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:46.449351 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db5538e-6f60-4aa1-a77c-e91d9e3e4e93 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:46.451083 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 361/720] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:37:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:37:46.457532 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470e191c-69a5-4e86-bddf-8e302402f73f None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:46.458029 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470e191c-69a5-4e86-bddf-8e302402f73f None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:46.458452 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470e191c-69a5-4e86-bddf-8e302402f73f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:46.478189 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-470e191c-69a5-4e86-bddf-8e302402f73f None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:37:46.481442 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-470e191c-69a5-4e86-bddf-8e302402f73f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:37:46.508824 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:46.589063 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 360/721] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:37:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:37:46.631951 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db5538e-6f60-4aa1-a77c-e91d9e3e4e93 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:46.658522 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:46.809913 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db5538e-6f60-4aa1-a77c-e91d9e3e4e93 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:46.863159 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bd7b82-b814-4810-9b1d-6abfdf3e2a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:46.864663 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bd7b82-b814-4810-9b1d-6abfdf3e2a2b None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:46.865134 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bd7b82-b814-4810-9b1d-6abfdf3e2a2b None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:46.865633 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bd7b82-b814-4810-9b1d-6abfdf3e2a2b None admin] PATH_INFO: `/v3/roles/service` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:46.888444 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bd7b82-b814-4810-9b1d-6abfdf3e2a2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:37:46.910753 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-69bd7b82-b814-4810-9b1d-6abfdf3e2a2b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 14 17:37:46.910753 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:46.910753 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:46.910753 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:46.910753 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:46.910753 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:46.910753 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:46.910753 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:46.910753 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:46.910753 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:46.910753 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:46.910753 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:46.910753 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:37:46.910753 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:37:46.910753 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:37:46.910753 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:37:46.911853 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:37:46.911853 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:37:46.911853 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:37:46.911853 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:37:46.911853 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:46.911853 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:46.911853 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:46.911853 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:46.911853 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:46.911853 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:46.911853 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:46.911853 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:46.911853 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:46.911853 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:46.911853 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:46.911853 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:46.912685 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:46.912685 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:46.912685 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:46.912685 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:46.912685 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:37:46.912685 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:37:46.912685 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:37:46.912685 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:37:46.912685 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:37:46.912685 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:37:46.912685 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 14 17:37:46.912685 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:37:46.912685 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 362/722] 10.222.0.36 () {56 vars in 1102 bytes} [Tue Jun 14 17:37:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:37:46.918232 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470e191c-69a5-4e86-bddf-8e302402f73f None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:47.065205 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470e191c-69a5-4e86-bddf-8e302402f73f None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:47.133048 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b5353a-b133-4309-b131-5c79435f7fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:47.133751 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b5353a-b133-4309-b131-5c79435f7fbc None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:47.134042 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b5353a-b133-4309-b131-5c79435f7fbc None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:47.134330 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b5353a-b133-4309-b131-5c79435f7fbc None admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:47.135092 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b5353a-b133-4309-b131-5c79435f7fbc None admin] RBAC: Adding query filter params (name=service) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:47.135435 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b5353a-b133-4309-b131-5c79435f7fbc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:47.136832 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b5353a-b133-4309-b131-5c79435f7fbc None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:47.151509 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 361/723] 10.222.0.36 () {56 vars in 1103 bytes} [Tue Jun 14 17:37:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:47.157305 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bd7b82-b814-4810-9b1d-6abfdf3e2a2b None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:47.273838 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:47.317737 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bd7b82-b814-4810-9b1d-6abfdf3e2a2b None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:47.372432 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f21fd89-5619-42b6-b5b5-b92be1814a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:47.373262 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f21fd89-5619-42b6-b5b5-b92be1814a21 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:47.373549 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f21fd89-5619-42b6-b5b5-b92be1814a21 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:47.373881 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f21fd89-5619-42b6-b5b5-b92be1814a21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:47.392425 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f21fd89-5619-42b6-b5b5-b92be1814a21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:47.394363 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f21fd89-5619-42b6-b5b5-b92be1814a21 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:47.416562 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-1f21fd89-5619-42b6-b5b5-b92be1814a21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:37:47.416562 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:47.416562 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:47.416562 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:47.416562 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:47.416562 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:47.416562 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:47.416562 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:47.416562 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:47.416562 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:47.416562 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:47.416562 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:47.416562 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:37:47.416562 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:37:47.416562 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:37:47.417614 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:37:47.417614 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:47.417614 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:47.417614 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:47.417614 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:47.417614 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:47.417614 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:47.417614 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:47.417614 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:47.417614 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:47.417614 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:47.417614 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:47.417614 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:47.417614 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:47.417614 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:47.417614 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:47.417614 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:47.418514 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:37:47.418514 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:37:47.418514 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:37:47.418514 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:37:47.418514 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 363/724] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 14 17:37:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:37:47.425567 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b5353a-b133-4309-b131-5c79435f7fbc None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:47.446300 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:47.559040 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b5353a-b133-4309-b131-5c79435f7fbc None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:47.603186 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de99b3ac-eeb6-4836-b893-d3afc02dacd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:47.604237 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de99b3ac-eeb6-4836-b893-d3afc02dacd7 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:47.604750 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de99b3ac-eeb6-4836-b893-d3afc02dacd7 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:47.605231 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de99b3ac-eeb6-4836-b893-d3afc02dacd7 None admin] PATH_INFO: `/v3/domains` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:47.606183 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de99b3ac-eeb6-4836-b893-d3afc02dacd7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:47.606719 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de99b3ac-eeb6-4836-b893-d3afc02dacd7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:47.608544 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de99b3ac-eeb6-4836-b893-d3afc02dacd7 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:47.627260 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 362/725] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 14 17:37:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:47.633601 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f21fd89-5619-42b6-b5b5-b92be1814a21 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:47.803832 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f21fd89-5619-42b6-b5b5-b92be1814a21 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:47.837943 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:47.848577 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b53316b-914e-437a-87b8-5b928ac1d740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:47.849412 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b53316b-914e-437a-87b8-5b928ac1d740 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:47.852621 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b53316b-914e-437a-87b8-5b928ac1d740 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:47.852621 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b53316b-914e-437a-87b8-5b928ac1d740 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:47.864646 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b53316b-914e-437a-87b8-5b928ac1d740 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:47.866064 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b53316b-914e-437a-87b8-5b928ac1d740 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:47.884612 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-8b53316b-914e-437a-87b8-5b928ac1d740 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 14 17:37:47.884612 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:47.884612 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:47.884612 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:47.884612 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:47.884612 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:47.884612 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:47.884612 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:47.884612 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:47.884612 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:47.884612 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:47.884612 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:47.884612 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 14 17:37:47.884612 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 14 17:37:47.884612 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 14 17:37:47.884612 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 14 17:37:47.885662 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:47.885662 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:47.885662 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 14 17:37:47.885662 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:37:47.885662 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 14 17:37:47.885662 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:37:47.885662 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:47.885662 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:47.885662 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:47.885662 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:47.885662 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:47.885662 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:47.885662 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:47.885662 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:47.885662 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:47.885662 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:47.885662 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:47.885662 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:47.886639 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:47.886639 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:47.886639 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 14 17:37:47.886639 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 14 17:37:47.886639 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 14 17:37:47.886639 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 14 17:37:47.886639 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 14 17:37:47.886639 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 14 17:37:47.886639 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 14 17:37:47.886639 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:37:47.886639 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 364/726] 10.222.0.36 () {56 vars in 1117 bytes} [Tue Jun 14 17:37:47 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:37:47.895212 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de99b3ac-eeb6-4836-b893-d3afc02dacd7 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:48.005504 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:48.025207 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de99b3ac-eeb6-4836-b893-d3afc02dacd7 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:48.066571 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef899a2-313c-4afb-b9c6-ffc6abede604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:48.068070 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef899a2-313c-4afb-b9c6-ffc6abede604 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:48.068622 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef899a2-313c-4afb-b9c6-ffc6abede604 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:48.069102 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef899a2-313c-4afb-b9c6-ffc6abede604 None admin] PATH_INFO: `/v3/users` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:48.070137 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef899a2-313c-4afb-b9c6-ffc6abede604 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:48.070652 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef899a2-313c-4afb-b9c6-ffc6abede604 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:48.072320 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef899a2-313c-4afb-b9c6-ffc6abede604 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:48.092894 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 363/727] 10.222.0.36 () {56 vars in 1149 bytes} [Tue Jun 14 17:37:47 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:48.099036 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b53316b-914e-437a-87b8-5b928ac1d740 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:48.215689 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd51514-eb49-4a8e-8d3a-19a35eebc882 None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:48.216025 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd51514-eb49-4a8e-8d3a-19a35eebc882 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:48.216414 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd51514-eb49-4a8e-8d3a-19a35eebc882 None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:48.218074 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 364/728] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:37:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:37:48.224298 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308c55b0-6cfe-426e-9dd9-4b712f2bbcb6 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:48.224589 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308c55b0-6cfe-426e-9dd9-4b712f2bbcb6 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:48.224874 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308c55b0-6cfe-426e-9dd9-4b712f2bbcb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:48.252966 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-308c55b0-6cfe-426e-9dd9-4b712f2bbcb6 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:37:48.254199 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-308c55b0-6cfe-426e-9dd9-4b712f2bbcb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:37:48.266632 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b53316b-914e-437a-87b8-5b928ac1d740 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:48.336142 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5515467-9339-4edb-96d2-aa6130d2c273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:48.336825 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5515467-9339-4edb-96d2-aa6130d2c273 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:48.337117 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5515467-9339-4edb-96d2-aa6130d2c273 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:48.337405 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5515467-9339-4edb-96d2-aa6130d2c273 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:48.367671 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 365/729] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:37:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:37:48.409613 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308c55b0-6cfe-426e-9dd9-4b712f2bbcb6 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:48.430653 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:48.445523 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5515467-9339-4edb-96d2-aa6130d2c273 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:48.447491 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5515467-9339-4edb-96d2-aa6130d2c273 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:48.543355 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:48.582645 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 365/730] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 14 17:37:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 14 17:37:48.584530 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5c5034-4bf3-4499-9db1-846c71a19116 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:48.585186 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5c5034-4bf3-4499-9db1-846c71a19116 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:48.585505 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5c5034-4bf3-4499-9db1-846c71a19116 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:48.587773 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 366/731] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:37:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:37:48.589087 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5c5034-4bf3-4499-9db1-846c71a19116 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:48.602493 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308c55b0-6cfe-426e-9dd9-4b712f2bbcb6 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:48.641941 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b34def-c3d3-47aa-9367-8907d15b5c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:48.643479 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b34def-c3d3-47aa-9367-8907d15b5c65 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:48.644106 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b34def-c3d3-47aa-9367-8907d15b5c65 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:48.644655 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b34def-c3d3-47aa-9367-8907d15b5c65 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:48.656971 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b34def-c3d3-47aa-9367-8907d15b5c65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:37:48.666012 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-61b34def-c3d3-47aa-9367-8907d15b5c65 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 17:37:48.666012 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:48.666012 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:48.666012 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:48.666012 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:48.666012 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:48.666012 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:48.666012 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:48.666012 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:48.666012 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:48.666012 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:48.666012 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:48.666012 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:37:48.666012 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:37:48.666012 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:37:48.666012 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:37:48.666997 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:37:48.666997 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:37:48.666997 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:37:48.666997 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:37:48.666997 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:48.666997 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:48.666997 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:48.666997 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:48.666997 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:48.666997 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:48.666997 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:48.666997 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:48.666997 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:48.666997 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:48.666997 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:48.666997 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:48.668194 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:48.668194 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:48.668194 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:48.668194 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:48.668194 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:37:48.668194 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:37:48.668194 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:37:48.668194 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:37:48.668194 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:37:48.668194 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:37:48.668194 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 17:37:48.668194 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:37:48.670774 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 366/732] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jun 14 17:37:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 17:37:48.672314 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75109a30-f375-4fd4-99bc-d64af6446ef4 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:48.672838 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75109a30-f375-4fd4-99bc-d64af6446ef4 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:48.673321 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75109a30-f375-4fd4-99bc-d64af6446ef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:48.692647 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-75109a30-f375-4fd4-99bc-d64af6446ef4 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:37:48.694233 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-75109a30-f375-4fd4-99bc-d64af6446ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:37:48.723127 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5c5034-4bf3-4499-9db1-846c71a19116 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:48.739717 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:48.767027 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766d79d2-87b0-49b0-a5b2-1d4f95fd27a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:48.768295 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d79d2-87b0-49b0-a5b2-1d4f95fd27a5 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:48.768814 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d79d2-87b0-49b0-a5b2-1d4f95fd27a5 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:48.769303 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d79d2-87b0-49b0-a5b2-1d4f95fd27a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:48.783365 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 367/733] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:37:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:37:48.783365 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75109a30-f375-4fd4-99bc-d64af6446ef4 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:48.790899 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766d79d2-87b0-49b0-a5b2-1d4f95fd27a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:48.792764 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766d79d2-87b0-49b0-a5b2-1d4f95fd27a5 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:48.829187 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-766d79d2-87b0-49b0-a5b2-1d4f95fd27a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:37:48.829187 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:48.829187 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:48.829187 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:48.829187 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:48.829187 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:48.829187 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:48.829187 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:48.829187 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:48.829187 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:48.829187 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:48.829187 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:48.829187 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:37:48.829187 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:37:48.829187 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:37:48.830319 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:37:48.830319 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:48.830319 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:48.830319 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:48.830319 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:48.830319 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:48.830319 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:48.830319 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:48.830319 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:48.830319 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:48.830319 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:48.830319 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:48.830319 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:48.830319 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:48.830319 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:48.830319 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:48.830319 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:48.831463 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:37:48.831463 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:37:48.831463 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:37:48.831463 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:37:48.833711 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 367/734] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 14 17:37:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:37:48.834957 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766d79d2-87b0-49b0-a5b2-1d4f95fd27a5 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:48.847853 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:48.922105 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75109a30-f375-4fd4-99bc-d64af6446ef4 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:48.963368 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766d79d2-87b0-49b0-a5b2-1d4f95fd27a5 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:48.967594 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f5d7eb-bff9-439e-b311-9e941bf189b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:48.968276 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f5d7eb-bff9-439e-b311-9e941bf189b5 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:48.968558 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f5d7eb-bff9-439e-b311-9e941bf189b5 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:48.968836 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f5d7eb-bff9-439e-b311-9e941bf189b5 None admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:48.969715 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f5d7eb-bff9-439e-b311-9e941bf189b5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:48.969906 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f5d7eb-bff9-439e-b311-9e941bf189b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:48.973124 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f5d7eb-bff9-439e-b311-9e941bf189b5 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:48.986102 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 368/735] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 14 17:37:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:48.986102 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f5d7eb-bff9-439e-b311-9e941bf189b5 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:49.019890 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac6b085-cf43-47a5-a1fe-e9e69c85cef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:49.020920 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac6b085-cf43-47a5-a1fe-e9e69c85cef5 None admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:49.021214 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac6b085-cf43-47a5-a1fe-e9e69c85cef5 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:49.021501 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac6b085-cf43-47a5-a1fe-e9e69c85cef5 None admin] PATH_INFO: `/v3/services` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:49.022273 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac6b085-cf43-47a5-a1fe-e9e69c85cef5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:49.023728 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac6b085-cf43-47a5-a1fe-e9e69c85cef5 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:49.119366 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f5d7eb-bff9-439e-b311-9e941bf189b5 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:49.125215 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:49.132493 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 368/736] 10.222.0.36 () {60 vars in 1141 bytes} [Tue Jun 14 17:37:48 2022] POST /identity/v3/services => generated 251 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:37:49.134799 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0cda8a-c4c7-4a75-96f1-0a666894e108 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:49.135258 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0cda8a-c4c7-4a75-96f1-0a666894e108 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:49.135707 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0cda8a-c4c7-4a75-96f1-0a666894e108 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:49.138623 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 369/737] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:37:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:37:49.139963 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0cda8a-c4c7-4a75-96f1-0a666894e108 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:49.145541 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:49.186455 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb1eb06-e27a-421b-98ba-eb13a5829d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:49.187155 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb1eb06-e27a-421b-98ba-eb13a5829d1c None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:49.187508 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb1eb06-e27a-421b-98ba-eb13a5829d1c None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:49.187825 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb1eb06-e27a-421b-98ba-eb13a5829d1c None admin] PATH_INFO: `/v3/domains` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:49.188505 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb1eb06-e27a-421b-98ba-eb13a5829d1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:49.188825 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb1eb06-e27a-421b-98ba-eb13a5829d1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:49.191675 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb1eb06-e27a-421b-98ba-eb13a5829d1c None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:49.206759 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 369/738] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 14 17:37:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:49.208203 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafff050-e12f-4cf7-af57-98a118f64b80 None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:49.208499 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafff050-e12f-4cf7-af57-98a118f64b80 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:49.208788 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafff050-e12f-4cf7-af57-98a118f64b80 None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:49.210504 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 370/739] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:37:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:37:49.211575 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aae155-5e40-4d26-9901-47d281ce0471 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:49.211878 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aae155-5e40-4d26-9901-47d281ce0471 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:49.212139 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aae155-5e40-4d26-9901-47d281ce0471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:49.230558 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-d8aae155-5e40-4d26-9901-47d281ce0471 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:37:49.231858 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-d8aae155-5e40-4d26-9901-47d281ce0471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:37:49.296947 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0cda8a-c4c7-4a75-96f1-0a666894e108 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:49.341328 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 371/740] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:37:49 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:37:49.342602 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aae155-5e40-4d26-9901-47d281ce0471 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:49.353201 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85e698f-0f38-4742-a21b-a3be54057824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:49.354037 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85e698f-0f38-4742-a21b-a3be54057824 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:49.354317 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85e698f-0f38-4742-a21b-a3be54057824 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:49.354605 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85e698f-0f38-4742-a21b-a3be54057824 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:49.368660 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85e698f-0f38-4742-a21b-a3be54057824 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:49.370149 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85e698f-0f38-4742-a21b-a3be54057824 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:49.408389 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-a85e698f-0f38-4742-a21b-a3be54057824 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:37:49.408389 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:49.408389 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:49.408389 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:49.408389 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:49.408389 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:49.408389 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:49.408389 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:49.408389 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:49.408389 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:49.408389 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:49.408389 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:49.408389 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:37:49.408389 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:37:49.408389 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:37:49.409467 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:37:49.409467 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:49.409467 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:49.409467 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:49.409467 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:49.409467 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:49.409467 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:49.409467 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:49.409467 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:49.409467 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:49.409467 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:49.409467 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:49.409467 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:49.409467 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:49.409467 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:49.409467 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:49.409467 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:49.410355 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:37:49.410355 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:37:49.410355 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:37:49.410355 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:37:49.410947 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 370/741] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 14 17:37:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:37:49.417345 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4273c23f-6516-4717-add2-d0367a777ff1 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:49.417905 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4273c23f-6516-4717-add2-d0367a777ff1 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:49.418750 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4273c23f-6516-4717-add2-d0367a777ff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:49.440680 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-4273c23f-6516-4717-add2-d0367a777ff1 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:37:49.442412 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-4273c23f-6516-4717-add2-d0367a777ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:37:49.471082 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:49.475247 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aae155-5e40-4d26-9901-47d281ce0471 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:49.497215 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:49.518385 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cfb02a-15f9-4a74-a896-e018b573d6c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:49.527513 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cfb02a-15f9-4a74-a896-e018b573d6c9 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:49.527701 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 371/742] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:37:49 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:37:49.527794 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cfb02a-15f9-4a74-a896-e018b573d6c9 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:49.527794 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cfb02a-15f9-4a74-a896-e018b573d6c9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:49.527952 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4273c23f-6516-4717-add2-d0367a777ff1 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:49.543907 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cfb02a-15f9-4a74-a896-e018b573d6c9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:49.547496 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cfb02a-15f9-4a74-a896-e018b573d6c9 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:49.563860 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-a2cfb02a-15f9-4a74-a896-e018b573d6c9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:37:49.563860 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:49.563860 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:49.563860 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:49.563860 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:49.563860 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:49.563860 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:49.563860 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:49.563860 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:49.563860 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:49.563860 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:49.563860 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:49.563860 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 14 17:37:49.563860 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 14 17:37:49.563860 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 14 17:37:49.565542 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 14 17:37:49.565542 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:49.565542 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:49.565542 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:49.565542 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:49.565542 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:49.565542 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:49.565542 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:49.565542 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:49.565542 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:49.565542 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:49.565542 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:49.565542 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:49.565542 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:49.565542 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:49.565542 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:49.565542 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:49.566695 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 14 17:37:49.566695 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 14 17:37:49.566695 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 14 17:37:49.566695 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 14 17:37:49.566695 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 14 17:37:49.566695 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 14 17:37:49.566695 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:37:49.566695 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:37:49.570738 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 372/743] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 14 17:37:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:37:49.571737 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cfb02a-15f9-4a74-a896-e018b573d6c9 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:49.665086 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4273c23f-6516-4717-add2-d0367a777ff1 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:49.711357 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfa7491-09c3-4b69-83c3-f6a2fa8694d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:49.712193 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfa7491-09c3-4b69-83c3-f6a2fa8694d6 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:49.712484 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfa7491-09c3-4b69-83c3-f6a2fa8694d6 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:49.712835 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfa7491-09c3-4b69-83c3-f6a2fa8694d6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:49.713840 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cfb02a-15f9-4a74-a896-e018b573d6c9 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:49.725405 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfa7491-09c3-4b69-83c3-f6a2fa8694d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:37:49.733489 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-adfa7491-09c3-4b69-83c3-f6a2fa8694d6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 17:37:49.733489 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:49.733489 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:49.733489 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:49.733489 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:49.733489 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:49.733489 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:49.733489 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:49.733489 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:49.733489 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:49.733489 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:49.733489 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:49.733489 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:37:49.733489 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:37:49.733489 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:37:49.733489 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:37:49.734491 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:37:49.734491 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:37:49.734491 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:37:49.734491 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:37:49.734491 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:49.734491 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:49.734491 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:49.734491 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:49.734491 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:49.734491 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:49.734491 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:49.734491 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:49.734491 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:49.734491 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:49.734491 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:49.734491 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:49.736665 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:49.736665 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:49.736665 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:49.736665 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:49.736665 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:37:49.736665 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:37:49.736665 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:37:49.736665 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:37:49.736665 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:37:49.736665 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:37:49.736665 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 17:37:49.736665 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:37:49.736665 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 372/744] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jun 14 17:37:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:37:49.736665 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfa7491-09c3-4b69-83c3-f6a2fa8694d6 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:49.772723 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743a715d-97c8-4de6-9a1e-82345ca1496b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:49.773412 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743a715d-97c8-4de6-9a1e-82345ca1496b None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:49.773779 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743a715d-97c8-4de6-9a1e-82345ca1496b None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:49.773976 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743a715d-97c8-4de6-9a1e-82345ca1496b None admin] PATH_INFO: `/v3/domains` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:49.774710 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743a715d-97c8-4de6-9a1e-82345ca1496b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:49.775018 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743a715d-97c8-4de6-9a1e-82345ca1496b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:49.776444 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743a715d-97c8-4de6-9a1e-82345ca1496b None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:49.794922 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 373/745] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 14 17:37:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:49.794922 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743a715d-97c8-4de6-9a1e-82345ca1496b None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:49.809919 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:49.825966 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:49.880498 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfa7491-09c3-4b69-83c3-f6a2fa8694d6 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:49.926554 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595b2ad7-214e-4554-9e85-f3a603c7597b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:49.927123 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595b2ad7-214e-4554-9e85-f3a603c7597b None admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:49.927501 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595b2ad7-214e-4554-9e85-f3a603c7597b None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:49.927852 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595b2ad7-214e-4554-9e85-f3a603c7597b None admin] PATH_INFO: `/v3/services` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:49.928681 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595b2ad7-214e-4554-9e85-f3a603c7597b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:49.929047 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743a715d-97c8-4de6-9a1e-82345ca1496b None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:49.930219 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595b2ad7-214e-4554-9e85-f3a603c7597b None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:49.967493 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e481bf4-a23e-4513-a3f6-85197a18260c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:49.968170 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e481bf4-a23e-4513-a3f6-85197a18260c None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:49.968458 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e481bf4-a23e-4513-a3f6-85197a18260c None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:49.968740 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e481bf4-a23e-4513-a3f6-85197a18260c None admin] PATH_INFO: `/v3/projects` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:49.969542 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e481bf4-a23e-4513-a3f6-85197a18260c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:49.969867 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e481bf4-a23e-4513-a3f6-85197a18260c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:49.971592 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e481bf4-a23e-4513-a3f6-85197a18260c None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:49.984434 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 374/746] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jun 14 17:37:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:49.985288 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e481bf4-a23e-4513-a3f6-85197a18260c None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:50.007510 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 373/747] 10.222.0.36 () {60 vars in 1141 bytes} [Tue Jun 14 17:37:49 2022] POST /identity/v3/services => generated 240 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:37:50.009224 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595b2ad7-214e-4554-9e85-f3a603c7597b None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:50.157320 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:50.193983 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:50.194244 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e481bf4-a23e-4513-a3f6-85197a18260c None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:50.201108 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595b2ad7-214e-4554-9e85-f3a603c7597b None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:50.248961 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2d676f-84bf-45dd-87fa-4cce98b96ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:50.249669 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2d676f-84bf-45dd-87fa-4cce98b96ff5 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:50.249952 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2d676f-84bf-45dd-87fa-4cce98b96ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:50.250234 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2d676f-84bf-45dd-87fa-4cce98b96ff5 None admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:50.251001 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2d676f-84bf-45dd-87fa-4cce98b96ff5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:50.251393 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2d676f-84bf-45dd-87fa-4cce98b96ff5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:50.253408 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f124badb-ab8e-46f7-b2fc-3ff812205e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:50.253678 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2d676f-84bf-45dd-87fa-4cce98b96ff5 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:50.254898 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f124badb-ab8e-46f7-b2fc-3ff812205e6c None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:50.255375 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f124badb-ab8e-46f7-b2fc-3ff812205e6c None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:50.255804 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f124badb-ab8e-46f7-b2fc-3ff812205e6c None admin] PATH_INFO: `/v3/users/swift` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:50.269022 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f124badb-ab8e-46f7-b2fc-3ff812205e6c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:50.269271 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 375/748] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 14 17:37:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:50.269271 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2d676f-84bf-45dd-87fa-4cce98b96ff5 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:50.270587 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f124badb-ab8e-46f7-b2fc-3ff812205e6c None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:50.288055 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-f124badb-ab8e-46f7-b2fc-3ff812205e6c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 14 17:37:50.288055 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:50.288055 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:50.288055 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:50.288055 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:50.288055 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:50.288055 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:50.288055 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:50.288055 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:50.288055 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:50.288055 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:50.288055 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:50.288055 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 14 17:37:50.288055 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 14 17:37:50.288055 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 14 17:37:50.288055 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 14 17:37:50.289343 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:50.289343 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:50.289343 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 14 17:37:50.289343 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:37:50.289343 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 14 17:37:50.289343 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:37:50.289343 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:50.289343 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:50.289343 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:50.289343 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:50.289343 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:50.289343 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:50.289343 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:50.289343 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:50.289343 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:50.289343 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:50.289343 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:50.289343 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:50.290314 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:50.290314 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:50.290314 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 14 17:37:50.290314 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 14 17:37:50.290314 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 14 17:37:50.290314 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 14 17:37:50.290314 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 14 17:37:50.290314 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 14 17:37:50.290314 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 14 17:37:50.290314 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:37:50.290314 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 374/749] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jun 14 17:37:50 2022] GET /identity/v3/users/swift => generated 83 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:37:50.290913 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f124badb-ab8e-46f7-b2fc-3ff812205e6c None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:50.422346 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2d676f-84bf-45dd-87fa-4cce98b96ff5 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:50.422770 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f124badb-ab8e-46f7-b2fc-3ff812205e6c None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:50.468710 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6934f32-6c33-4243-9153-a716d65e7579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:50.469878 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6934f32-6c33-4243-9153-a716d65e7579 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:50.470631 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6934f32-6c33-4243-9153-a716d65e7579 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:50.471159 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6934f32-6c33-4243-9153-a716d65e7579 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:50.473293 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3bec9c-94f4-4f8f-ac50-106b511c0aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:50.474085 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3bec9c-94f4-4f8f-ac50-106b511c0aa9 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:50.474385 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3bec9c-94f4-4f8f-ac50-106b511c0aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:50.474668 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3bec9c-94f4-4f8f-ac50-106b511c0aa9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:50.475654 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3bec9c-94f4-4f8f-ac50-106b511c0aa9 None admin] RBAC: Adding query filter params (role.id=ed6a4c87428044ddbc5199cfb05de27e, scope.project.id=f3e1d023a52c42b98d018617987ef83c, user.id=f1e32638fe5c4d2d8d3e2e4ea8250aaa) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:50.475974 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3bec9c-94f4-4f8f-ac50-106b511c0aa9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:50.477464 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3bec9c-94f4-4f8f-ac50-106b511c0aa9 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:50.483854 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6934f32-6c33-4243-9153-a716d65e7579 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:50.491337 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 376/750] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 14 17:37:50 2022] GET /identity/v3/role_assignments?user.id=f1e32638fe5c4d2d8d3e2e4ea8250aaa&scope.project.id=f3e1d023a52c42b98d018617987ef83c&role.id=ed6a4c87428044ddbc5199cfb05de27e => generated 259 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:50.491337 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3bec9c-94f4-4f8f-ac50-106b511c0aa9 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:50.491337 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:50.492950 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6934f32-6c33-4243-9153-a716d65e7579 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:50.531693 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-a6934f32-6c33-4243-9153-a716d65e7579 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:37:50.531693 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:50.531693 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:50.531693 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:50.531693 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:50.531693 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:50.531693 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:50.531693 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:50.531693 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:50.531693 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:50.531693 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:50.531693 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:50.531693 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:37:50.531693 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:37:50.531693 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:37:50.532888 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:37:50.532888 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:50.532888 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:50.532888 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:50.532888 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:50.532888 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:50.532888 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:50.532888 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:50.532888 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:50.532888 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:50.532888 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:50.532888 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:50.532888 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:50.532888 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:50.532888 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:50.532888 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:50.532888 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:50.534172 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:37:50.534172 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:37:50.534172 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:37:50.534172 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:37:50.536147 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 375/751] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 14 17:37:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:37:50.542042 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6934f32-6c33-4243-9153-a716d65e7579 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:50.567952 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:50.597807 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3bec9c-94f4-4f8f-ac50-106b511c0aa9 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:50.638589 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3502fb9-5c62-4a79-bbcf-599429c1e87f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:50.639556 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3502fb9-5c62-4a79-bbcf-599429c1e87f None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:50.640117 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3502fb9-5c62-4a79-bbcf-599429c1e87f None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:50.640591 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3502fb9-5c62-4a79-bbcf-599429c1e87f None admin] PATH_INFO: `/v3/users` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:50.641731 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3502fb9-5c62-4a79-bbcf-599429c1e87f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:50.642780 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3502fb9-5c62-4a79-bbcf-599429c1e87f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:50.644484 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3502fb9-5c62-4a79-bbcf-599429c1e87f None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:50.665089 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 377/752] 10.222.0.36 () {56 vars in 1135 bytes} [Tue Jun 14 17:37:50 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:50.672425 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3502fb9-5c62-4a79-bbcf-599429c1e87f None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:50.729325 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6934f32-6c33-4243-9153-a716d65e7579 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:50.760520 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:50.791147 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3502fb9-5c62-4a79-bbcf-599429c1e87f None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:50.813489 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb5f1c7-057b-40d3-b2f6-67c8b795640d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:50.814967 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb5f1c7-057b-40d3-b2f6-67c8b795640d None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:50.815657 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb5f1c7-057b-40d3-b2f6-67c8b795640d None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:50.816080 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb5f1c7-057b-40d3-b2f6-67c8b795640d None admin] PATH_INFO: `/v3/domains` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:50.817001 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb5f1c7-057b-40d3-b2f6-67c8b795640d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:50.817457 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb5f1c7-057b-40d3-b2f6-67c8b795640d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:50.818992 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb5f1c7-057b-40d3-b2f6-67c8b795640d None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:50.834309 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 376/753] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 14 17:37:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:37:50.840269 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb5f1c7-057b-40d3-b2f6-67c8b795640d None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:50.859327 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a31f466-be3e-41f2-9400-cbea3f49ce97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:50.859327 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a31f466-be3e-41f2-9400-cbea3f49ce97 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:50.859327 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a31f466-be3e-41f2-9400-cbea3f49ce97 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:50.859728 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a31f466-be3e-41f2-9400-cbea3f49ce97 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:50.944593 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a31f466-be3e-41f2-9400-cbea3f49ce97 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:50.946046 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a31f466-be3e-41f2-9400-cbea3f49ce97 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:51.017336 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:51.057184 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:51.065362 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 378/754] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 14 17:37:50 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 14 17:37:51.070896 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a31f466-be3e-41f2-9400-cbea3f49ce97 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:51.171164 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb5f1c7-057b-40d3-b2f6-67c8b795640d None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:51.239486 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a31f466-be3e-41f2-9400-cbea3f49ce97 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:51.270074 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4ad880-b9bb-4689-bd86-cd579b771a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:51.271254 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4ad880-b9bb-4689-bd86-cd579b771a1c None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:51.271801 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4ad880-b9bb-4689-bd86-cd579b771a1c None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:51.272275 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4ad880-b9bb-4689-bd86-cd579b771a1c None admin] PATH_INFO: `/v3/users/nova` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:51.281130 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d512fc8f-fcdc-4c3a-a096-90e9240624f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:51.281937 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d512fc8f-fcdc-4c3a-a096-90e9240624f9 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:51.282224 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d512fc8f-fcdc-4c3a-a096-90e9240624f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:51.282506 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d512fc8f-fcdc-4c3a-a096-90e9240624f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:51.290111 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4ad880-b9bb-4689-bd86-cd579b771a1c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:51.291589 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4ad880-b9bb-4689-bd86-cd579b771a1c None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:51.308280 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d512fc8f-fcdc-4c3a-a096-90e9240624f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:51.309744 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d512fc8f-fcdc-4c3a-a096-90e9240624f9 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:51.319109 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-8c4ad880-b9bb-4689-bd86-cd579b771a1c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 14 17:37:51.319109 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:51.319109 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:51.319109 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:51.319109 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:51.319109 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:51.319109 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:51.319109 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:51.319109 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:51.319109 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:51.319109 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:51.319109 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:51.319109 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 14 17:37:51.319109 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 14 17:37:51.319109 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 14 17:37:51.319109 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 14 17:37:51.320096 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:51.320096 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:51.320096 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 14 17:37:51.320096 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:37:51.320096 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 14 17:37:51.320096 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:37:51.320096 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:51.320096 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:51.320096 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:51.320096 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:51.320096 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:51.320096 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:51.320096 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:51.320096 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:51.320096 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:51.320096 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:51.320096 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:51.320096 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:51.321035 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:51.321035 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:51.321035 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 14 17:37:51.321035 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 14 17:37:51.321035 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 14 17:37:51.321035 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 14 17:37:51.321035 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 14 17:37:51.321035 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 14 17:37:51.321035 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 14 17:37:51.321035 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:37:51.324896 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 377/755] 10.222.0.36 () {56 vars in 1093 bytes} [Tue Jun 14 17:37:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 485 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:37:51.331157 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4ad880-b9bb-4689-bd86-cd579b771a1c None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:51.340106 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-d512fc8f-fcdc-4c3a-a096-90e9240624f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:37:51.340106 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:51.340106 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:51.340106 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:51.340106 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:51.340106 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:51.340106 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:51.340106 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:51.340106 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:51.340106 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:51.340106 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:51.340106 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:51.340106 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:37:51.340106 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:37:51.340106 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:37:51.342258 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:37:51.342258 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:51.342258 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:51.342258 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:51.342258 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:51.342258 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:51.342258 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:51.342258 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:51.342258 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:51.342258 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:51.342258 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:51.342258 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:51.342258 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:51.342258 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:51.342258 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:51.342258 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:51.342258 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:51.344372 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:37:51.344372 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:37:51.344372 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:37:51.344372 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:37:51.347139 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 379/756] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 14 17:37:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 17:37:51.348250 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d512fc8f-fcdc-4c3a-a096-90e9240624f9 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:51.379003 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:51.442721 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4ad880-b9bb-4689-bd86-cd579b771a1c None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:51.478991 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574162be-c93b-402d-adbe-4d8c61eb3a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:51.479868 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574162be-c93b-402d-adbe-4d8c61eb3a75 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:51.480166 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574162be-c93b-402d-adbe-4d8c61eb3a75 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:51.480452 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574162be-c93b-402d-adbe-4d8c61eb3a75 None admin] PATH_INFO: `/v3/users` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:51.481301 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574162be-c93b-402d-adbe-4d8c61eb3a75 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:51.481616 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574162be-c93b-402d-adbe-4d8c61eb3a75 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:51.482080 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:51.488837 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574162be-c93b-402d-adbe-4d8c61eb3a75 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:51.523375 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 378/757] 10.222.0.36 () {56 vars in 1133 bytes} [Tue Jun 14 17:37:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:37:51.531507 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574162be-c93b-402d-adbe-4d8c61eb3a75 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:51.585461 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d512fc8f-fcdc-4c3a-a096-90e9240624f9 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:51.621295 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ba5874-b4a1-4829-81c6-5ce688d40546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:51.622016 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ba5874-b4a1-4829-81c6-5ce688d40546 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:51.622305 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ba5874-b4a1-4829-81c6-5ce688d40546 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:51.622583 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ba5874-b4a1-4829-81c6-5ce688d40546 None admin] PATH_INFO: `/v3/domains` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:51.623326 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ba5874-b4a1-4829-81c6-5ce688d40546 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:51.623648 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ba5874-b4a1-4829-81c6-5ce688d40546 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:51.625013 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ba5874-b4a1-4829-81c6-5ce688d40546 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:51.638823 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 380/758] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 14 17:37:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:37:51.640195 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e59173-e35e-4bea-a12a-c5b494c62639 None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:51.640486 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e59173-e35e-4bea-a12a-c5b494c62639 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:51.640768 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e59173-e35e-4bea-a12a-c5b494c62639 None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:51.643046 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 381/759] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:37:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:37:51.644811 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e59173-e35e-4bea-a12a-c5b494c62639 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:51.673693 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574162be-c93b-402d-adbe-4d8c61eb3a75 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:51.709567 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db407139-8f24-4f02-9137-a00c3c491cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:51.710369 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db407139-8f24-4f02-9137-a00c3c491cc6 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:51.710655 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db407139-8f24-4f02-9137-a00c3c491cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:51.710934 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db407139-8f24-4f02-9137-a00c3c491cc6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:51.721545 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db407139-8f24-4f02-9137-a00c3c491cc6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:51.723024 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db407139-8f24-4f02-9137-a00c3c491cc6 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:51.729863 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:51.742139 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-db407139-8f24-4f02-9137-a00c3c491cc6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:37:51.742139 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:51.742139 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:51.742139 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:51.742139 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:51.742139 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:51.742139 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:51.742139 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:51.742139 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:51.742139 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:51.742139 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:51.742139 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:51.742139 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:37:51.742139 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:37:51.742139 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:37:51.745240 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:37:51.745240 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:51.745240 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:51.745240 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:51.745240 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:51.745240 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:51.745240 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:51.745240 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:51.745240 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:51.745240 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:51.745240 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:51.745240 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:51.745240 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:51.745240 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:51.745240 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:51.745240 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:51.745240 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:51.747346 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:37:51.747346 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:37:51.747346 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:37:51.747346 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:37:51.747346 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 379/760] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 14 17:37:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:37:51.747346 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8e4bb8-f7c0-4a0a-93bf-5ac4e3a6104f None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:51.747346 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8e4bb8-f7c0-4a0a-93bf-5ac4e3a6104f None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:51.747346 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8e4bb8-f7c0-4a0a-93bf-5ac4e3a6104f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:51.764629 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e59173-e35e-4bea-a12a-c5b494c62639 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:51.764988 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-cf8e4bb8-f7c0-4a0a-93bf-5ac4e3a6104f None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:37:51.766175 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-cf8e4bb8-f7c0-4a0a-93bf-5ac4e3a6104f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:37:51.804193 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:51.806577 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0f8ae9-dfbe-4e10-b42d-1bc6e57335e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:51.807585 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0f8ae9-dfbe-4e10-b42d-1bc6e57335e7 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:51.808050 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0f8ae9-dfbe-4e10-b42d-1bc6e57335e7 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:51.808483 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0f8ae9-dfbe-4e10-b42d-1bc6e57335e7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:51.816985 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0f8ae9-dfbe-4e10-b42d-1bc6e57335e7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:51.818675 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0f8ae9-dfbe-4e10-b42d-1bc6e57335e7 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:51.835049 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-cd0f8ae9-dfbe-4e10-b42d-1bc6e57335e7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:37:51.835049 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:51.835049 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:51.835049 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:51.835049 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:51.835049 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:51.835049 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:51.835049 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:51.835049 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:51.835049 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:51.835049 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:51.835049 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:51.835049 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 14 17:37:51.835049 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 14 17:37:51.835049 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 14 17:37:51.836371 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 14 17:37:51.836371 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:51.836371 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:51.836371 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:51.836371 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:51.836371 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:51.836371 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:51.836371 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:51.836371 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:51.836371 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:51.836371 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:51.836371 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:51.836371 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:51.836371 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:51.836371 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:51.836371 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:51.836371 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:51.837271 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 14 17:37:51.837271 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 14 17:37:51.837271 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 14 17:37:51.837271 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 14 17:37:51.837271 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 14 17:37:51.837271 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 14 17:37:51.837271 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:37:51.837271 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:37:51.844369 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 382/762] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 14 17:37:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:37:51.846147 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0f8ae9-dfbe-4e10-b42d-1bc6e57335e7 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:51.847781 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 380/762] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:37:51 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 17:37:51.852708 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8e4bb8-f7c0-4a0a-93bf-5ac4e3a6104f None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:51.985607 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0f8ae9-dfbe-4e10-b42d-1bc6e57335e7 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:51.994470 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8e4bb8-f7c0-4a0a-93bf-5ac4e3a6104f None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:52.029443 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18454d27-5574-4440-ae08-659e5e8a8dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:52.030678 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18454d27-5574-4440-ae08-659e5e8a8dee None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:52.031176 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18454d27-5574-4440-ae08-659e5e8a8dee None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:52.031727 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18454d27-5574-4440-ae08-659e5e8a8dee None admin] PATH_INFO: `/v3/domains` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:52.032059 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de14fff-da08-4c4e-b760-b46cac0ef729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:52.035208 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de14fff-da08-4c4e-b760-b46cac0ef729 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:52.035559 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18454d27-5574-4440-ae08-659e5e8a8dee None admin] RBAC: Adding query filter params (name=Default) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:52.035657 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de14fff-da08-4c4e-b760-b46cac0ef729 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:52.035752 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18454d27-5574-4440-ae08-659e5e8a8dee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:52.035836 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de14fff-da08-4c4e-b760-b46cac0ef729 None admin] PATH_INFO: `/v3/projects` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:52.035836 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de14fff-da08-4c4e-b760-b46cac0ef729 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:52.035836 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de14fff-da08-4c4e-b760-b46cac0ef729 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:52.036242 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18454d27-5574-4440-ae08-659e5e8a8dee None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:52.036407 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de14fff-da08-4c4e-b760-b46cac0ef729 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:52.038404 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:52.051683 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 383/764] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 14 17:37:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:52.052998 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18454d27-5574-4440-ae08-659e5e8a8dee None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:52.058207 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 381/764] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jun 14 17:37:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:37:52.058207 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de14fff-da08-4c4e-b760-b46cac0ef729 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:52.087934 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:52.161994 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de14fff-da08-4c4e-b760-b46cac0ef729 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:52.174059 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18454d27-5574-4440-ae08-659e5e8a8dee None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:52.197134 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad586ec-5a6a-4b98-ba58-bcd60dfa77ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:52.197801 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad586ec-5a6a-4b98-ba58-bcd60dfa77ed None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:52.198092 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad586ec-5a6a-4b98-ba58-bcd60dfa77ed None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:52.198726 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad586ec-5a6a-4b98-ba58-bcd60dfa77ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:52.199201 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad586ec-5a6a-4b98-ba58-bcd60dfa77ed None admin] RBAC: Adding query filter params (role.id=1348580877d04014bfdec4d866b98a74, scope.project.id=f3e1d023a52c42b98d018617987ef83c, user.id=ba38b47a31b14526be0aa2054841881b) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:52.199564 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad586ec-5a6a-4b98-ba58-bcd60dfa77ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:52.200996 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad586ec-5a6a-4b98-ba58-bcd60dfa77ed None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:52.215038 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 382/765] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 14 17:37:52 2022] GET /identity/v3/role_assignments?user.id=ba38b47a31b14526be0aa2054841881b&scope.project.id=f3e1d023a52c42b98d018617987ef83c&role.id=1348580877d04014bfdec4d866b98a74 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:52.215751 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1fc246-b3e6-4687-b69f-8738ff669a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:52.216087 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad586ec-5a6a-4b98-ba58-bcd60dfa77ed None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:52.217046 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1fc246-b3e6-4687-b69f-8738ff669a70 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:52.217603 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1fc246-b3e6-4687-b69f-8738ff669a70 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:52.218086 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1fc246-b3e6-4687-b69f-8738ff669a70 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:52.219138 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1fc246-b3e6-4687-b69f-8738ff669a70 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:52.221578 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1fc246-b3e6-4687-b69f-8738ff669a70 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:52.235589 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-ca1fc246-b3e6-4687-b69f-8738ff669a70 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 14 17:37:52.235589 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:52.235589 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 14 17:37:52.235589 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 14 17:37:52.235589 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 14 17:37:52.235589 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 14 17:37:52.235589 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 14 17:37:52.235589 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 17:37:52.235589 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 14 17:37:52.235589 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:37:52.235589 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 14 17:37:52.235589 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:37:52.235589 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:52.235589 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:52.235589 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:52.235589 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:52.237212 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:52.237212 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:52.237212 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:52.237212 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:52.237212 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:52.237212 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:52.237212 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:52.237212 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 14 17:37:52.237212 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 14 17:37:52.237212 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 14 17:37:52.237212 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 14 17:37:52.237212 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:52.237212 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:52.237212 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:52.237212 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:52.237212 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:52.238052 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:52.238052 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:52.238052 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:52.238052 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:52.238052 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:52.238052 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:52.238052 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:52.238052 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:52.238052 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:52.238052 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:52.238052 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:52.238052 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 14 17:37:52.238052 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 17:37:52.238052 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 14 17:37:52.238052 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:37:52.241408 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 384/766] 10.222.0.36 () {56 vars in 1129 bytes} [Tue Jun 14 17:37:52 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:37:52.246880 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1fc246-b3e6-4687-b69f-8738ff669a70 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:52.337830 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:52.388402 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1fc246-b3e6-4687-b69f-8738ff669a70 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:52.425137 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:52.433380 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8380d43b-b87d-49b6-837a-0191dfeec424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:52.434200 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8380d43b-b87d-49b6-837a-0191dfeec424 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:52.434547 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8380d43b-b87d-49b6-837a-0191dfeec424 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:52.434885 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8380d43b-b87d-49b6-837a-0191dfeec424 None admin] PATH_INFO: `/v3/services` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:52.435715 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8380d43b-b87d-49b6-837a-0191dfeec424 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:52.436006 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8380d43b-b87d-49b6-837a-0191dfeec424 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:52.437363 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8380d43b-b87d-49b6-837a-0191dfeec424 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:52.443776 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad586ec-5a6a-4b98-ba58-bcd60dfa77ed None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:52.443986 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 385/767] 10.222.0.36 () {56 vars in 1124 bytes} [Tue Jun 14 17:37:52 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:52.449671 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8380d43b-b87d-49b6-837a-0191dfeec424 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:52.490957 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c98aeb2-c1ed-4e5f-8ae2-13ab0d51a25f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:52.492274 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c98aeb2-c1ed-4e5f-8ae2-13ab0d51a25f None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:52.492754 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c98aeb2-c1ed-4e5f-8ae2-13ab0d51a25f None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:52.493276 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c98aeb2-c1ed-4e5f-8ae2-13ab0d51a25f None admin] PATH_INFO: `/v3/projects/service` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:52.503004 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c98aeb2-c1ed-4e5f-8ae2-13ab0d51a25f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:52.505253 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c98aeb2-c1ed-4e5f-8ae2-13ab0d51a25f None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:52.523003 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-8c98aeb2-c1ed-4e5f-8ae2-13ab0d51a25f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:37:52.523003 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:52.523003 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:52.523003 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:52.523003 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:52.523003 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:52.523003 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:52.523003 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:52.523003 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:52.523003 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:52.523003 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:52.523003 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:52.523003 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 14 17:37:52.523003 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 14 17:37:52.523003 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 14 17:37:52.524135 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 14 17:37:52.524135 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:52.524135 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:52.524135 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:52.524135 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:52.524135 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:52.524135 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:52.524135 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:52.524135 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:52.524135 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:52.524135 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:52.524135 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:52.524135 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:52.524135 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:52.524135 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:52.524135 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:52.524135 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:52.525080 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 14 17:37:52.525080 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 14 17:37:52.525080 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 14 17:37:52.525080 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 14 17:37:52.525080 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 14 17:37:52.525080 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 14 17:37:52.525080 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:37:52.525080 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:37:52.527745 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 383/768] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 14 17:37:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:37:52.534781 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c98aeb2-c1ed-4e5f-8ae2-13ab0d51a25f None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:52.599619 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8380d43b-b87d-49b6-837a-0191dfeec424 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:52.646167 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:52.656413 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa07cd4f-d3d2-4f8a-a52d-1a813064dcd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:52.657091 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa07cd4f-d3d2-4f8a-a52d-1a813064dcd8 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:52.657366 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa07cd4f-d3d2-4f8a-a52d-1a813064dcd8 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:52.657640 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa07cd4f-d3d2-4f8a-a52d-1a813064dcd8 None admin] PATH_INFO: `/v3/services` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:52.658537 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa07cd4f-d3d2-4f8a-a52d-1a813064dcd8 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:52.659370 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa07cd4f-d3d2-4f8a-a52d-1a813064dcd8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:52.670201 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa07cd4f-d3d2-4f8a-a52d-1a813064dcd8 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:52.670201 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 386/769] 10.222.0.36 () {56 vars in 1124 bytes} [Tue Jun 14 17:37:52 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:37:52.670201 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775b866a-affa-48fb-87e4-6ae36326ea71 None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:52.670201 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775b866a-affa-48fb-87e4-6ae36326ea71 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:52.670201 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775b866a-affa-48fb-87e4-6ae36326ea71 None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:52.675438 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 387/770] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:37:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:37:52.675438 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775b866a-affa-48fb-87e4-6ae36326ea71 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:52.678896 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c98aeb2-c1ed-4e5f-8ae2-13ab0d51a25f None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:52.717764 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2198c08-6853-460a-8ede-fe97c5d276d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:52.718445 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2198c08-6853-460a-8ede-fe97c5d276d4 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:52.718729 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2198c08-6853-460a-8ede-fe97c5d276d4 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:52.719008 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2198c08-6853-460a-8ede-fe97c5d276d4 None admin] PATH_INFO: `/v3/projects` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:52.719843 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2198c08-6853-460a-8ede-fe97c5d276d4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:52.720184 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2198c08-6853-460a-8ede-fe97c5d276d4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:52.722483 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2198c08-6853-460a-8ede-fe97c5d276d4 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:52.735657 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 384/771] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jun 14 17:37:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:52.738056 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849dd965-a956-4716-b217-2b119872d6cb None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:52.738348 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849dd965-a956-4716-b217-2b119872d6cb None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:52.738634 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849dd965-a956-4716-b217-2b119872d6cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:52.758403 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-849dd965-a956-4716-b217-2b119872d6cb None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:37:52.759673 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-849dd965-a956-4716-b217-2b119872d6cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:37:52.771989 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:52.804877 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775b866a-affa-48fb-87e4-6ae36326ea71 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:52.851432 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 385/772] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:37:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 17:37:52.851432 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849dd965-a956-4716-b217-2b119872d6cb None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:52.851846 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0168cb17-b8cb-418b-aa80-20565667eb5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:52.852930 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0168cb17-b8cb-418b-aa80-20565667eb5d None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:52.853437 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0168cb17-b8cb-418b-aa80-20565667eb5d None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:52.853916 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0168cb17-b8cb-418b-aa80-20565667eb5d None admin] PATH_INFO: `/v3/endpoints` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:52.854931 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0168cb17-b8cb-418b-aa80-20565667eb5d None admin] RBAC: Adding query filter params (interface=public, service_id=1cfc19607b4e4655b5e386186eb87dbf, region_id=RegionOne) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:52.855548 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0168cb17-b8cb-418b-aa80-20565667eb5d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:52.857182 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0168cb17-b8cb-418b-aa80-20565667eb5d None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:52.874845 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 388/773] 10.222.0.36 () {56 vars in 1251 bytes} [Tue Jun 14 17:37:52 2022] GET /identity/v3/endpoints?service_id=1cfc19607b4e4655b5e386186eb87dbf&interface=public®ion_id=RegionOne => generated 194 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:52.880470 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0168cb17-b8cb-418b-aa80-20565667eb5d None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:52.962801 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:52.992689 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849dd965-a956-4716-b217-2b119872d6cb None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:53.036363 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0168cb17-b8cb-418b-aa80-20565667eb5d None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:53.047636 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14054b31-dc78-43ca-8ba5-655796df0991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:53.049247 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14054b31-dc78-43ca-8ba5-655796df0991 None admin] REQUEST_METHOD: `PUT` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:53.049728 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14054b31-dc78-43ca-8ba5-655796df0991 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:53.050089 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14054b31-dc78-43ca-8ba5-655796df0991 None admin] PATH_INFO: `/v3/projects/f3e1d023a52c42b98d018617987ef83c/users/e4696d396adb495ab300a9a5a5727595/roles/1348580877d04014bfdec4d866b98a74` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:53.052909 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14054b31-dc78-43ca-8ba5-655796df0991 None admin] RBAC: Authorizing `identity:create_grant(project_id=f3e1d023a52c42b98d018617987ef83c, user_id=e4696d396adb495ab300a9a5a5727595, role_id=1348580877d04014bfdec4d866b98a74)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:53.054682 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14054b31-dc78-43ca-8ba5-655796df0991 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:53.087208 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a487ca06-35b5-4ce2-90d9-85ab71e20f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:53.088376 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a487ca06-35b5-4ce2-90d9-85ab71e20f07 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:53.088851 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a487ca06-35b5-4ce2-90d9-85ab71e20f07 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:53.089312 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a487ca06-35b5-4ce2-90d9-85ab71e20f07 None admin] PATH_INFO: `/v3/services` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:53.090212 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a487ca06-35b5-4ce2-90d9-85ab71e20f07 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:53.091931 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a487ca06-35b5-4ce2-90d9-85ab71e20f07 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:53.107461 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 389/774] 10.222.0.36 () {56 vars in 1087 bytes} [Tue Jun 14 17:37:52 2022] GET /identity/v3/services => generated 772 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:37:53.107461 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a487ca06-35b5-4ce2-90d9-85ab71e20f07 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:53.133669 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 386/775] 10.222.0.36 () {58 vars in 1439 bytes} [Tue Jun 14 17:37:52 2022] PUT /identity/v3/projects/f3e1d023a52c42b98d018617987ef83c/users/e4696d396adb495ab300a9a5a5727595/roles/1348580877d04014bfdec4d866b98a74 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:37:53.179171 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788ac38b-bd73-45fb-9ca0-50e273685e88 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:53.179533 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788ac38b-bd73-45fb-9ca0-50e273685e88 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:53.179786 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788ac38b-bd73-45fb-9ca0-50e273685e88 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:53.181610 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 387/776] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:37:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 14 17:37:53.187428 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa6e2e-8b32-4922-a6b0-9a08c095c6ea None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:53.187723 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa6e2e-8b32-4922-a6b0-9a08c095c6ea None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:53.187994 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa6e2e-8b32-4922-a6b0-9a08c095c6ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:53.198770 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:53.215426 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-4cfa6e2e-8b32-4922-a6b0-9a08c095c6ea None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:37:53.216753 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-4cfa6e2e-8b32-4922-a6b0-9a08c095c6ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:37:53.262109 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a487ca06-35b5-4ce2-90d9-85ab71e20f07 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:53.281014 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:53.305324 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 388/777] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:37:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 17:37:53.308577 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf55a24-b555-4c70-a90d-ddbdabbf5bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:53.309740 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf55a24-b555-4c70-a90d-ddbdabbf5bcf None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:53.310269 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf55a24-b555-4c70-a90d-ddbdabbf5bcf None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:53.310760 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf55a24-b555-4c70-a90d-ddbdabbf5bcf None admin] PATH_INFO: `/v3/services/network` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:53.311700 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf55a24-b555-4c70-a90d-ddbdabbf5bcf None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:53.313385 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf55a24-b555-4c70-a90d-ddbdabbf5bcf None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:53.330499 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfa6e2e-8b32-4922-a6b0-9a08c095c6ea None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:53.331291 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-bbf55a24-b555-4c70-a90d-ddbdabbf5bcf None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 14 17:37:53.331291 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:53.331291 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 14 17:37:53.331291 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 14 17:37:53.331291 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 14 17:37:53.331291 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 14 17:37:53.331291 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 14 17:37:53.331291 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 17:37:53.331291 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 14 17:37:53.331291 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:37:53.331291 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 14 17:37:53.331291 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:37:53.331291 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:53.331291 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:53.331291 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:53.331291 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:53.331291 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:53.332296 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:53.332296 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:53.332296 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:53.332296 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:53.332296 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:53.332296 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:53.332296 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 14 17:37:53.332296 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 14 17:37:53.332296 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 14 17:37:53.332296 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 14 17:37:53.332296 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:53.332296 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:53.332296 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:53.332296 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:53.332296 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:53.332296 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:53.333172 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:53.333172 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:53.333172 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:53.333172 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:53.333172 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:53.333172 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:53.333172 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:53.333172 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:53.333172 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:53.333172 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:53.333172 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 14 17:37:53.333172 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 17:37:53.333172 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 14 17:37:53.333172 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:37:53.336431 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 390/778] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 14 17:37:53 2022] GET /identity/v3/services/network => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:37:53.343221 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf55a24-b555-4c70-a90d-ddbdabbf5bcf None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:53.461546 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfa6e2e-8b32-4922-a6b0-9a08c095c6ea None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:53.465990 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf55a24-b555-4c70-a90d-ddbdabbf5bcf None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:53.506390 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8157cec3-c09e-4e1c-84d3-c4d731061b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:53.507495 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8157cec3-c09e-4e1c-84d3-c4d731061b30 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:53.508125 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8157cec3-c09e-4e1c-84d3-c4d731061b30 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:53.508615 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8157cec3-c09e-4e1c-84d3-c4d731061b30 None admin] PATH_INFO: `/v3/services` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:53.509665 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8157cec3-c09e-4e1c-84d3-c4d731061b30 None admin] RBAC: Adding query filter params (name=network) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:53.510199 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8157cec3-c09e-4e1c-84d3-c4d731061b30 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:53.512156 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8157cec3-c09e-4e1c-84d3-c4d731061b30 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:53.516136 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707807c2-a9dc-4d56-abab-ef50ed404ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:53.517804 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707807c2-a9dc-4d56-abab-ef50ed404ac6 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:53.518210 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707807c2-a9dc-4d56-abab-ef50ed404ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:53.518546 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707807c2-a9dc-4d56-abab-ef50ed404ac6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:53.519912 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 391/779] 10.222.0.36 () {56 vars in 1112 bytes} [Tue Jun 14 17:37:53 2022] GET /identity/v3/services?name=network => generated 124 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:37:53.525801 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8157cec3-c09e-4e1c-84d3-c4d731061b30 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:53.526648 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:53.535937 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707807c2-a9dc-4d56-abab-ef50ed404ac6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:37:53.548786 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-707807c2-a9dc-4d56-abab-ef50ed404ac6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 14 17:37:53.548786 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:53.548786 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:53.548786 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:53.548786 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:53.548786 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:53.548786 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:53.548786 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:53.548786 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:53.548786 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:53.548786 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:53.548786 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:53.548786 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:37:53.548786 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:37:53.548786 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:37:53.548786 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:37:53.549843 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:37:53.549843 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:37:53.549843 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:37:53.549843 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:37:53.549843 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:53.549843 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:53.549843 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:53.549843 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:53.549843 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:53.549843 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:53.549843 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:53.549843 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:53.549843 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:53.549843 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:53.549843 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:53.549843 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:53.550682 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:53.550682 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:53.550682 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:53.550682 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:53.550682 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:37:53.550682 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:37:53.550682 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:37:53.550682 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:37:53.550682 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:37:53.550682 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:37:53.550682 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 14 17:37:53.550682 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:37:53.555501 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 389/780] 10.222.0.36 () {56 vars in 1102 bytes} [Tue Jun 14 17:37:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 17:37:53.559058 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707807c2-a9dc-4d56-abab-ef50ed404ac6 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:53.583723 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:53.781463 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707807c2-a9dc-4d56-abab-ef50ed404ac6 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:53.839060 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8157cec3-c09e-4e1c-84d3-c4d731061b30 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:53.856095 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d1b720-01d8-4c1d-a2e2-2ad0eafc69aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:53.857255 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d1b720-01d8-4c1d-a2e2-2ad0eafc69aa None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:53.858025 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d1b720-01d8-4c1d-a2e2-2ad0eafc69aa None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:53.859477 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d1b720-01d8-4c1d-a2e2-2ad0eafc69aa None admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:53.860934 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d1b720-01d8-4c1d-a2e2-2ad0eafc69aa None admin] RBAC: Adding query filter params (name=service) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:53.861440 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d1b720-01d8-4c1d-a2e2-2ad0eafc69aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:53.864142 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d1b720-01d8-4c1d-a2e2-2ad0eafc69aa None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:53.888406 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 390/781] 10.222.0.36 () {56 vars in 1103 bytes} [Tue Jun 14 17:37:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:53.899092 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d1b720-01d8-4c1d-a2e2-2ad0eafc69aa None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:53.977568 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3675f64-f637-4e80-b6a2-c635a65967f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:53.978261 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3675f64-f637-4e80-b6a2-c635a65967f8 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:53.978554 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3675f64-f637-4e80-b6a2-c635a65967f8 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:53.978832 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3675f64-f637-4e80-b6a2-c635a65967f8 None admin] PATH_INFO: `/v3/services` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:53.979583 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3675f64-f637-4e80-b6a2-c635a65967f8 None admin] RBAC: Adding query filter params (type=network) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:53.979897 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3675f64-f637-4e80-b6a2-c635a65967f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:53.981289 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3675f64-f637-4e80-b6a2-c635a65967f8 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:53.993664 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 392/782] 10.222.0.36 () {56 vars in 1112 bytes} [Tue Jun 14 17:37:53 2022] GET /identity/v3/services?type=network => generated 350 bytes in 468 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:37:54.016632 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3675f64-f637-4e80-b6a2-c635a65967f8 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:54.037600 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:54.131793 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d1b720-01d8-4c1d-a2e2-2ad0eafc69aa None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:54.202946 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057f409e-03ff-47ad-8b71-6b0f80ab25d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:54.204313 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057f409e-03ff-47ad-8b71-6b0f80ab25d0 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:54.204859 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057f409e-03ff-47ad-8b71-6b0f80ab25d0 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:54.205307 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057f409e-03ff-47ad-8b71-6b0f80ab25d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:54.228520 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057f409e-03ff-47ad-8b71-6b0f80ab25d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:54.231211 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057f409e-03ff-47ad-8b71-6b0f80ab25d0 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:54.270430 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-057f409e-03ff-47ad-8b71-6b0f80ab25d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:37:54.270430 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:54.270430 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:54.270430 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:54.270430 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:54.270430 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:54.270430 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:54.270430 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:54.270430 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:54.270430 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:54.270430 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:54.270430 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:54.270430 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:37:54.270430 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:37:54.270430 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:37:54.271431 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:37:54.271431 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:54.271431 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:54.271431 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:54.271431 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:54.271431 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:54.271431 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:54.271431 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:54.271431 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:54.271431 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:54.271431 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:54.271431 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:54.271431 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:54.271431 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:54.271431 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:54.271431 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:54.271431 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:54.272342 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:37:54.272342 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:37:54.272342 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:37:54.272342 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:37:54.274083 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 391/783] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 14 17:37:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 375 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:37:54.287954 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057f409e-03ff-47ad-8b71-6b0f80ab25d0 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:54.436433 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3675f64-f637-4e80-b6a2-c635a65967f8 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:54.451040 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:54.503894 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419934d9-4913-47cf-ab45-dd92f07dcf58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:54.505331 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419934d9-4913-47cf-ab45-dd92f07dcf58 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:54.505834 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419934d9-4913-47cf-ab45-dd92f07dcf58 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:54.506333 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419934d9-4913-47cf-ab45-dd92f07dcf58 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:54.508063 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419934d9-4913-47cf-ab45-dd92f07dcf58 None admin] RBAC: Adding query filter params (interface=public, service_id=dfbb418dcaf14616b0ff7f6460076892, region_id=RegionOne) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:54.508626 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419934d9-4913-47cf-ab45-dd92f07dcf58 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:54.511529 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419934d9-4913-47cf-ab45-dd92f07dcf58 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:54.522442 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 393/784] 10.222.0.36 () {56 vars in 1251 bytes} [Tue Jun 14 17:37:54 2022] GET /identity/v3/endpoints?service_id=dfbb418dcaf14616b0ff7f6460076892&interface=public®ion_id=RegionOne => generated 194 bytes in 507 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:54.533855 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419934d9-4913-47cf-ab45-dd92f07dcf58 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:54.562472 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057f409e-03ff-47ad-8b71-6b0f80ab25d0 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:54.580594 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:54.630109 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baf7034-4a77-44a0-9379-25ab61de3a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:54.631349 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baf7034-4a77-44a0-9379-25ab61de3a51 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:54.631936 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baf7034-4a77-44a0-9379-25ab61de3a51 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:54.632422 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baf7034-4a77-44a0-9379-25ab61de3a51 None admin] PATH_INFO: `/v3/domains` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:54.634034 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baf7034-4a77-44a0-9379-25ab61de3a51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:54.634589 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baf7034-4a77-44a0-9379-25ab61de3a51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:54.637239 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baf7034-4a77-44a0-9379-25ab61de3a51 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:54.662128 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 392/785] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 14 17:37:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:54.672486 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baf7034-4a77-44a0-9379-25ab61de3a51 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:54.848764 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419934d9-4913-47cf-ab45-dd92f07dcf58 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:54.919997 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185709d4-8385-4c35-b207-b76856a6d297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:54.921620 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185709d4-8385-4c35-b207-b76856a6d297 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:54.922413 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185709d4-8385-4c35-b207-b76856a6d297 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:54.924015 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185709d4-8385-4c35-b207-b76856a6d297 None admin] PATH_INFO: `/v3/services` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:54.925805 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185709d4-8385-4c35-b207-b76856a6d297 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:54.929310 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185709d4-8385-4c35-b207-b76856a6d297 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:54.941330 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 394/786] 10.222.0.36 () {56 vars in 1087 bytes} [Tue Jun 14 17:37:54 2022] GET /identity/v3/services => generated 772 bytes in 411 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:55.035888 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baf7034-4a77-44a0-9379-25ab61de3a51 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:55.117630 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb71c9e-9b45-4021-9155-e129660a93bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:55.118887 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb71c9e-9b45-4021-9155-e129660a93bd None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:55.119385 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb71c9e-9b45-4021-9155-e129660a93bd None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:55.119855 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb71c9e-9b45-4021-9155-e129660a93bd None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:55.137584 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb71c9e-9b45-4021-9155-e129660a93bd None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:55.144344 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb71c9e-9b45-4021-9155-e129660a93bd None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:55.164196 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e810b541-1212-459e-b39e-1e826e72e786 None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:55.164551 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e810b541-1212-459e-b39e-1e826e72e786 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:55.164781 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e810b541-1212-459e-b39e-1e826e72e786 None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:55.167600 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 395/787] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:37:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 14 17:37:55.172254 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463dfe42-ea7b-4138-9ba0-5566fba8dd77 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:55.172622 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463dfe42-ea7b-4138-9ba0-5566fba8dd77 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:55.173005 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463dfe42-ea7b-4138-9ba0-5566fba8dd77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:55.177125 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-abb71c9e-9b45-4021-9155-e129660a93bd None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 14 17:37:55.177125 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:55.177125 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:55.177125 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:55.177125 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:55.177125 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:55.177125 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:55.177125 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:55.177125 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:55.177125 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:55.177125 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:55.177125 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:55.177125 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 14 17:37:55.177125 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 14 17:37:55.177125 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 14 17:37:55.177125 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 14 17:37:55.178231 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:55.178231 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:55.178231 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 14 17:37:55.178231 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:37:55.178231 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 14 17:37:55.178231 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:37:55.178231 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:55.178231 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:55.178231 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:55.178231 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:55.178231 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:55.178231 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:55.178231 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:55.178231 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:55.178231 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:55.178231 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:55.178231 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:55.178231 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:55.179264 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:55.179264 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:55.179264 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 14 17:37:55.179264 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 14 17:37:55.179264 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 14 17:37:55.179264 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 14 17:37:55.179264 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 14 17:37:55.179264 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 14 17:37:55.179264 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 14 17:37:55.179264 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:37:55.183890 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 393/788] 10.222.0.36 () {56 vars in 1117 bytes} [Tue Jun 14 17:37:54 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 512 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 17:37:55.190655 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb71c9e-9b45-4021-9155-e129660a93bd None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:55.192387 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-463dfe42-ea7b-4138-9ba0-5566fba8dd77 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:37:55.193626 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-463dfe42-ea7b-4138-9ba0-5566fba8dd77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:37:55.244861 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:55.253721 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:55.354957 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 396/789] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:37:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 14 17:37:55.397298 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463dfe42-ea7b-4138-9ba0-5566fba8dd77 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:55.411677 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb71c9e-9b45-4021-9155-e129660a93bd None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:55.481371 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5969dde-0f54-4418-a084-5cee31c4d63a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:55.482477 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5969dde-0f54-4418-a084-5cee31c4d63a None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:55.482981 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5969dde-0f54-4418-a084-5cee31c4d63a None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:55.483500 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5969dde-0f54-4418-a084-5cee31c4d63a None admin] PATH_INFO: `/v3/users` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:55.485551 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5969dde-0f54-4418-a084-5cee31c4d63a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:55.487602 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5969dde-0f54-4418-a084-5cee31c4d63a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:55.490157 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5969dde-0f54-4418-a084-5cee31c4d63a None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:55.526489 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 394/790] 10.222.0.36 () {56 vars in 1149 bytes} [Tue Jun 14 17:37:55 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:37:55.533367 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5969dde-0f54-4418-a084-5cee31c4d63a None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:55.717069 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463dfe42-ea7b-4138-9ba0-5566fba8dd77 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:55.717805 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:55.751775 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5969dde-0f54-4418-a084-5cee31c4d63a None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:55.833021 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd802ed-f483-4b29-ad32-8e8f2915c241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:55.833561 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05d4348-e38b-4180-9a5c-29d82c1815d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:55.834377 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05d4348-e38b-4180-9a5c-29d82c1815d7 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:55.834498 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd802ed-f483-4b29-ad32-8e8f2915c241 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:55.834735 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05d4348-e38b-4180-9a5c-29d82c1815d7 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:55.834913 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd802ed-f483-4b29-ad32-8e8f2915c241 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:55.835015 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05d4348-e38b-4180-9a5c-29d82c1815d7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:55.835425 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd802ed-f483-4b29-ad32-8e8f2915c241 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:55.855149 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd802ed-f483-4b29-ad32-8e8f2915c241 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:55.859344 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd802ed-f483-4b29-ad32-8e8f2915c241 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:55.864272 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05d4348-e38b-4180-9a5c-29d82c1815d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:37:55.872612 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-d05d4348-e38b-4180-9a5c-29d82c1815d7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 17:37:55.872612 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:55.872612 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:55.872612 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:55.872612 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:55.872612 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:55.872612 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:55.872612 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:55.872612 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:55.872612 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:55.872612 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:55.872612 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:55.872612 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:37:55.872612 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:37:55.872612 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:37:55.872612 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:37:55.873602 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:37:55.873602 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:37:55.873602 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:37:55.873602 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:37:55.873602 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:55.873602 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:55.873602 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:55.873602 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:55.873602 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:55.873602 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:55.873602 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:55.873602 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:55.873602 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:55.873602 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:55.873602 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:55.873602 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:55.874458 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:55.874458 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:55.874458 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:55.874458 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:55.874458 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:37:55.874458 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:37:55.874458 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:37:55.874458 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:37:55.874458 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:37:55.874458 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:37:55.874458 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 17:37:55.874458 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:37:55.881243 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 397/791] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jun 14 17:37:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 485 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:37:55.888388 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05d4348-e38b-4180-9a5c-29d82c1815d7 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:55.910740 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-fcd802ed-f483-4b29-ad32-8e8f2915c241 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:37:55.910740 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:55.910740 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:55.910740 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:55.910740 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:55.910740 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:55.910740 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:55.910740 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:55.910740 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:55.910740 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:55.910740 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:55.910740 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:55.910740 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:37:55.910740 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:37:55.910740 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:37:55.912490 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:37:55.912490 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:55.912490 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:55.912490 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:55.912490 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:55.912490 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:55.912490 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:55.912490 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:55.912490 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:55.912490 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:55.912490 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:55.912490 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:55.912490 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:55.912490 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:55.912490 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:55.912490 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:55.912490 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:55.914237 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:37:55.914237 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:37:55.914237 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:37:55.914237 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:37:55.914237 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 395/792] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 14 17:37:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 381 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:37:55.916118 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea92b2-c46b-4594-8bfd-5758ddc0a993 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:55.916607 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea92b2-c46b-4594-8bfd-5758ddc0a993 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:55.917086 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea92b2-c46b-4594-8bfd-5758ddc0a993 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:55.925226 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 396/793] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:37:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:37:55.925226 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ea92b2-c46b-4594-8bfd-5758ddc0a993 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:55.959775 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:56.054383 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ea92b2-c46b-4594-8bfd-5758ddc0a993 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:56.100372 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842a822d-a100-4c9c-b2f8-df9e097ea557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:56.101471 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842a822d-a100-4c9c-b2f8-df9e097ea557 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:56.101978 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842a822d-a100-4c9c-b2f8-df9e097ea557 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:56.102624 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842a822d-a100-4c9c-b2f8-df9e097ea557 None admin] PATH_INFO: `/v3/domains` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:56.103956 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842a822d-a100-4c9c-b2f8-df9e097ea557 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:56.104502 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842a822d-a100-4c9c-b2f8-df9e097ea557 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:56.106395 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842a822d-a100-4c9c-b2f8-df9e097ea557 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:56.114879 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05d4348-e38b-4180-9a5c-29d82c1815d7 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:56.116307 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:56.123565 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 397/794] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 14 17:37:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:56.125749 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d67a57-14c1-4ffd-a6be-0e58c04b101d None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:56.125749 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d67a57-14c1-4ffd-a6be-0e58c04b101d None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:56.125749 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d67a57-14c1-4ffd-a6be-0e58c04b101d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:56.144030 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-97d67a57-14c1-4ffd-a6be-0e58c04b101d None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:37:56.145362 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-97d67a57-14c1-4ffd-a6be-0e58c04b101d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:37:56.197563 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94726b5-199e-4b4b-97a4-413a1d8cdc34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:56.199423 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94726b5-199e-4b4b-97a4-413a1d8cdc34 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:56.200199 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94726b5-199e-4b4b-97a4-413a1d8cdc34 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:56.201133 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94726b5-199e-4b4b-97a4-413a1d8cdc34 None admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:56.202891 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94726b5-199e-4b4b-97a4-413a1d8cdc34 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:56.203866 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94726b5-199e-4b4b-97a4-413a1d8cdc34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:56.207353 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94726b5-199e-4b4b-97a4-413a1d8cdc34 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:56.227199 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 398/795] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 14 17:37:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:56.229154 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94726b5-199e-4b4b-97a4-413a1d8cdc34 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:56.234876 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 398/796] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:37:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 17:37:56.237389 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d67a57-14c1-4ffd-a6be-0e58c04b101d None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:56.344047 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:56.361470 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94726b5-199e-4b4b-97a4-413a1d8cdc34 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:56.401865 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc653eda-a0b2-4517-bd0c-5104c1f82616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:56.402686 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc653eda-a0b2-4517-bd0c-5104c1f82616 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:56.402975 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc653eda-a0b2-4517-bd0c-5104c1f82616 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:56.403251 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc653eda-a0b2-4517-bd0c-5104c1f82616 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:56.411550 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc653eda-a0b2-4517-bd0c-5104c1f82616 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:56.412580 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc653eda-a0b2-4517-bd0c-5104c1f82616 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:56.428348 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-bc653eda-a0b2-4517-bd0c-5104c1f82616 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:37:56.428348 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:56.428348 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:56.428348 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:56.428348 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:56.428348 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:56.428348 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:56.428348 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:56.428348 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:56.428348 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:56.428348 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:56.428348 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:56.428348 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 14 17:37:56.428348 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 14 17:37:56.428348 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 14 17:37:56.430333 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 14 17:37:56.430333 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:56.430333 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:56.430333 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:56.430333 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:56.430333 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:56.430333 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:56.430333 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:56.430333 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:56.430333 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:56.430333 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:56.430333 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:56.430333 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:56.430333 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:56.430333 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:56.430333 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:56.430333 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:56.432202 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 14 17:37:56.432202 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 14 17:37:56.432202 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 14 17:37:56.432202 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 14 17:37:56.432202 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 14 17:37:56.432202 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 14 17:37:56.432202 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:37:56.432202 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:37:56.432202 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 399/797] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 14 17:37:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:37:56.432202 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc653eda-a0b2-4517-bd0c-5104c1f82616 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:56.460375 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d67a57-14c1-4ffd-a6be-0e58c04b101d None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:56.519633 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:56.535408 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80e513f-638f-480a-bad5-53e45a7ddaf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:56.537245 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80e513f-638f-480a-bad5-53e45a7ddaf7 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:56.537896 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80e513f-638f-480a-bad5-53e45a7ddaf7 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:56.538531 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80e513f-638f-480a-bad5-53e45a7ddaf7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:56.550865 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc653eda-a0b2-4517-bd0c-5104c1f82616 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:56.560850 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80e513f-638f-480a-bad5-53e45a7ddaf7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:56.564325 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80e513f-638f-480a-bad5-53e45a7ddaf7 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:56.597007 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f24d28-d68e-4cda-9a3f-633b6abd8f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:56.597754 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f24d28-d68e-4cda-9a3f-633b6abd8f3e None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:56.598040 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f24d28-d68e-4cda-9a3f-633b6abd8f3e None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:56.598322 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f24d28-d68e-4cda-9a3f-633b6abd8f3e None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:56.598997 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f24d28-d68e-4cda-9a3f-633b6abd8f3e None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:56.600507 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f24d28-d68e-4cda-9a3f-633b6abd8f3e None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:56.604160 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-c80e513f-638f-480a-bad5-53e45a7ddaf7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:37:56.604160 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:56.604160 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:56.604160 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:56.604160 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:56.604160 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:56.604160 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:56.604160 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:56.604160 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:56.604160 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:56.604160 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:56.604160 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:56.604160 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:37:56.604160 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:37:56.604160 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:37:56.606136 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:37:56.606136 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:56.606136 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:56.606136 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:56.606136 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:56.606136 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:56.606136 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:56.606136 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:56.606136 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:56.606136 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:56.606136 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:56.606136 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:56.606136 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:56.606136 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:56.606136 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:56.606136 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:56.606136 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:56.608398 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:37:56.608398 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:37:56.608398 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:37:56.608398 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:37:56.612711 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 399/798] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 14 17:37:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 377 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:37:56.614351 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-a2f24d28-d68e-4cda-9a3f-633b6abd8f3e None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 14 17:37:56.614351 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:56.614351 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 14 17:37:56.614351 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 14 17:37:56.614351 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 14 17:37:56.614351 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 14 17:37:56.614351 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 14 17:37:56.614351 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 17:37:56.614351 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 14 17:37:56.614351 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:37:56.614351 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 14 17:37:56.614351 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:37:56.614351 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:56.614351 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:56.614351 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:56.614351 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:56.616379 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:56.616379 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:56.616379 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:56.616379 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:56.616379 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:56.616379 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:56.616379 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:56.616379 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 14 17:37:56.616379 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 14 17:37:56.616379 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 14 17:37:56.616379 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 14 17:37:56.616379 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:56.616379 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:56.616379 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:56.616379 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:56.616379 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:56.618078 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:56.618078 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:56.618078 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:56.618078 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:56.618078 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:56.618078 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:56.618078 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:56.618078 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:56.618078 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:56.618078 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:56.618078 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:56.618078 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 14 17:37:56.618078 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 17:37:56.618078 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 14 17:37:56.618078 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:37:56.620938 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 400/799] 10.222.0.36 () {56 vars in 1129 bytes} [Tue Jun 14 17:37:56 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:37:56.621376 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80e513f-638f-480a-bad5-53e45a7ddaf7 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:56.621980 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f24d28-d68e-4cda-9a3f-633b6abd8f3e None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:56.638629 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:56.770026 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f24d28-d68e-4cda-9a3f-633b6abd8f3e None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:56.818441 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfb437d-ff4e-49c2-ac58-898330583ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:56.819386 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfb437d-ff4e-49c2-ac58-898330583ad0 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:56.819975 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfb437d-ff4e-49c2-ac58-898330583ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:56.820404 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfb437d-ff4e-49c2-ac58-898330583ad0 None admin] PATH_INFO: `/v3/domains` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:56.821310 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfb437d-ff4e-49c2-ac58-898330583ad0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:56.821813 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfb437d-ff4e-49c2-ac58-898330583ad0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:56.823484 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfb437d-ff4e-49c2-ac58-898330583ad0 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:56.825565 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80e513f-638f-480a-bad5-53e45a7ddaf7 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:56.843411 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 401/800] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 14 17:37:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:56.843411 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfb437d-ff4e-49c2-ac58-898330583ad0 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:56.897172 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd9b820-12f5-4d46-a399-c3c82ea826d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:56.898141 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd9b820-12f5-4d46-a399-c3c82ea826d0 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:56.898603 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd9b820-12f5-4d46-a399-c3c82ea826d0 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:56.903540 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd9b820-12f5-4d46-a399-c3c82ea826d0 None admin] PATH_INFO: `/v3/projects` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:56.903540 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd9b820-12f5-4d46-a399-c3c82ea826d0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:56.903540 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd9b820-12f5-4d46-a399-c3c82ea826d0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:56.904960 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd9b820-12f5-4d46-a399-c3c82ea826d0 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:56.927090 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 400/801] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jun 14 17:37:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:56.931012 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f92545-9e93-4105-987f-93b4a23866b2 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:56.932330 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f92545-9e93-4105-987f-93b4a23866b2 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:56.933079 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f92545-9e93-4105-987f-93b4a23866b2 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:56.936890 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 401/802] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:37:56 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:37:56.938672 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f92545-9e93-4105-987f-93b4a23866b2 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:56.954508 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:56.993660 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfb437d-ff4e-49c2-ac58-898330583ad0 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:57.013148 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:57.062137 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f48b7c-e254-491c-aa82-6de11660ebbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:57.063200 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f48b7c-e254-491c-aa82-6de11660ebbc None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:57.063902 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f48b7c-e254-491c-aa82-6de11660ebbc None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:57.064410 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f48b7c-e254-491c-aa82-6de11660ebbc None admin] PATH_INFO: `/v3/services` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:57.065818 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f48b7c-e254-491c-aa82-6de11660ebbc None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:57.066382 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f48b7c-e254-491c-aa82-6de11660ebbc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:57.069345 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f48b7c-e254-491c-aa82-6de11660ebbc None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:57.085695 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 402/803] 10.222.0.36 () {56 vars in 1124 bytes} [Tue Jun 14 17:37:56 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:57.085695 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f48b7c-e254-491c-aa82-6de11660ebbc None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:57.107578 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f92545-9e93-4105-987f-93b4a23866b2 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:57.168561 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8930e62a-189d-46c9-8534-dcb59e326df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:57.169829 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8930e62a-189d-46c9-8534-dcb59e326df0 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:57.170259 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8930e62a-189d-46c9-8534-dcb59e326df0 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:57.170722 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8930e62a-189d-46c9-8534-dcb59e326df0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:57.185786 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8930e62a-189d-46c9-8534-dcb59e326df0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:57.188276 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8930e62a-189d-46c9-8534-dcb59e326df0 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:57.213481 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-8930e62a-189d-46c9-8534-dcb59e326df0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 14 17:37:57.213481 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:57.213481 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:57.213481 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:57.213481 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:57.213481 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:57.213481 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:57.213481 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:57.213481 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:57.213481 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:57.213481 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:57.213481 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:57.213481 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 14 17:37:57.213481 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 14 17:37:57.213481 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 14 17:37:57.213481 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 14 17:37:57.215413 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:57.215413 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:57.215413 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 14 17:37:57.215413 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:37:57.215413 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 14 17:37:57.215413 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:37:57.215413 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:57.215413 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:57.215413 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:57.215413 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:57.215413 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:57.215413 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:57.215413 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:57.215413 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:57.215413 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:57.215413 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:57.215413 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:57.215413 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:57.217666 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:57.217666 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:57.217666 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 14 17:37:57.217666 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 14 17:37:57.217666 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 14 17:37:57.217666 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 14 17:37:57.217666 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 14 17:37:57.217666 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 14 17:37:57.217666 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 14 17:37:57.217666 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:37:57.217666 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 402/804] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jun 14 17:37:56 2022] GET /identity/v3/users/swift => generated 83 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:37:57.218889 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4163a8e2-01ef-4a19-88bf-399103e97bfe None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:57.218889 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4163a8e2-01ef-4a19-88bf-399103e97bfe None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:57.219151 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4163a8e2-01ef-4a19-88bf-399103e97bfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:57.244001 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-4163a8e2-01ef-4a19-88bf-399103e97bfe None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:37:57.246327 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-4163a8e2-01ef-4a19-88bf-399103e97bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:37:57.263261 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f48b7c-e254-491c-aa82-6de11660ebbc None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:57.321944 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e861431-ffa2-4726-b04a-23905a80743f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:57.322877 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e861431-ffa2-4726-b04a-23905a80743f None admin] REQUEST_METHOD: `PUT` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:57.323164 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e861431-ffa2-4726-b04a-23905a80743f None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:57.323478 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e861431-ffa2-4726-b04a-23905a80743f None admin] PATH_INFO: `/v3/projects/f3e1d023a52c42b98d018617987ef83c/users/f1e32638fe5c4d2d8d3e2e4ea8250aaa/roles/ed6a4c87428044ddbc5199cfb05de27e` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:57.326532 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:57.345818 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e861431-ffa2-4726-b04a-23905a80743f None admin] RBAC: Authorizing `identity:create_grant(project_id=f3e1d023a52c42b98d018617987ef83c, user_id=f1e32638fe5c4d2d8d3e2e4ea8250aaa, role_id=ed6a4c87428044ddbc5199cfb05de27e)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:57.348319 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e861431-ffa2-4726-b04a-23905a80743f None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:57.357956 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 403/805] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:37:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 17:37:57.359077 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4163a8e2-01ef-4a19-88bf-399103e97bfe None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:57.400176 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:57.420991 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 403/806] 10.222.0.36 () {58 vars in 1439 bytes} [Tue Jun 14 17:37:57 2022] PUT /identity/v3/projects/f3e1d023a52c42b98d018617987ef83c/users/f1e32638fe5c4d2d8d3e2e4ea8250aaa/roles/ed6a4c87428044ddbc5199cfb05de27e => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:37:57.432656 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e861431-ffa2-4726-b04a-23905a80743f None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:57.516962 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4163a8e2-01ef-4a19-88bf-399103e97bfe None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:57.569432 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b3e1ee-3071-4ba0-a038-479ecf1e7f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:57.570985 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b3e1ee-3071-4ba0-a038-479ecf1e7f8c None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:57.571646 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b3e1ee-3071-4ba0-a038-479ecf1e7f8c None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:57.572431 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b3e1ee-3071-4ba0-a038-479ecf1e7f8c None admin] PATH_INFO: `/v3/services` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:57.574602 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b3e1ee-3071-4ba0-a038-479ecf1e7f8c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:57.575140 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b3e1ee-3071-4ba0-a038-479ecf1e7f8c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:57.577612 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b3e1ee-3071-4ba0-a038-479ecf1e7f8c None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:57.584612 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e861431-ffa2-4726-b04a-23905a80743f None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:57.587424 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 404/807] 10.222.0.36 () {56 vars in 1124 bytes} [Tue Jun 14 17:37:57 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:57.589568 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b3e1ee-3071-4ba0-a038-479ecf1e7f8c None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:57.636530 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d05099-d7b8-4466-ba2a-e4585b8b9937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:57.637894 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d05099-d7b8-4466-ba2a-e4585b8b9937 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:57.638355 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d05099-d7b8-4466-ba2a-e4585b8b9937 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:57.638794 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d05099-d7b8-4466-ba2a-e4585b8b9937 None admin] PATH_INFO: `/v3/users` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:57.640671 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d05099-d7b8-4466-ba2a-e4585b8b9937 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:57.641345 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d05099-d7b8-4466-ba2a-e4585b8b9937 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:57.644610 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d05099-d7b8-4466-ba2a-e4585b8b9937 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:57.672202 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 404/808] 10.222.0.36 () {56 vars in 1135 bytes} [Tue Jun 14 17:37:57 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:57.673690 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d05099-d7b8-4466-ba2a-e4585b8b9937 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:57.729785 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:57.733676 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:57.737504 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b3e1ee-3071-4ba0-a038-479ecf1e7f8c None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:57.781564 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4e5d71-5504-4ac1-81bb-c28c589714fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:57.782379 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e5d71-5504-4ac1-81bb-c28c589714fb None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:57.783671 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e5d71-5504-4ac1-81bb-c28c589714fb None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:57.783948 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e5d71-5504-4ac1-81bb-c28c589714fb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:57.795632 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4e5d71-5504-4ac1-81bb-c28c589714fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:37:57.803211 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d05099-d7b8-4466-ba2a-e4585b8b9937 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:57.804548 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-df4e5d71-5504-4ac1-81bb-c28c589714fb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 17:37:57.804548 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:57.804548 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:57.804548 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:57.804548 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:57.804548 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:57.804548 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:57.804548 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:57.804548 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:57.804548 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:57.804548 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:57.804548 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:57.804548 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:37:57.804548 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:37:57.804548 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:37:57.804548 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:37:57.806354 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:37:57.806354 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:37:57.806354 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:37:57.806354 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:37:57.806354 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:57.806354 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:57.806354 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:57.806354 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:57.806354 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:57.806354 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:57.806354 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:57.806354 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:57.806354 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:57.806354 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:57.806354 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:57.806354 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:57.809238 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:57.809238 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:57.809238 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:57.809238 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:57.809238 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:37:57.809238 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:37:57.809238 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:37:57.809238 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:37:57.809238 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:37:57.809238 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:37:57.809238 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 17:37:57.809238 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:37:57.810756 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 405/809] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jun 14 17:37:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:37:57.811793 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4e5d71-5504-4ac1-81bb-c28c589714fb None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:57.853917 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93f3639-e677-406c-9716-ce20c0e6178b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:57.854875 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93f3639-e677-406c-9716-ce20c0e6178b None admin] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:57.855424 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93f3639-e677-406c-9716-ce20c0e6178b None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:57.855976 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93f3639-e677-406c-9716-ce20c0e6178b None admin] PATH_INFO: `/v3/endpoints` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:57.857367 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93f3639-e677-406c-9716-ce20c0e6178b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:57.860106 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93f3639-e677-406c-9716-ce20c0e6178b None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:57.958366 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 405/810] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Jun 14 17:37:57 2022] POST /identity/v3/endpoints => generated 346 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:37:57.961103 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134db111-0191-4994-86a8-6e33e7294861 None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:57.961821 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134db111-0191-4994-86a8-6e33e7294861 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:57.962289 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134db111-0191-4994-86a8-6e33e7294861 None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:57.972956 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 406/811] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:37:57 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:37:57.973949 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134db111-0191-4994-86a8-6e33e7294861 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:57.977667 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4e5d71-5504-4ac1-81bb-c28c589714fb None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:58.040286 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c83073-7c46-4e02-a9a7-edbe3082fc60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:58.041269 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c83073-7c46-4e02-a9a7-edbe3082fc60 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:58.041562 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c83073-7c46-4e02-a9a7-edbe3082fc60 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:58.041975 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c83073-7c46-4e02-a9a7-edbe3082fc60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:58.058516 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c83073-7c46-4e02-a9a7-edbe3082fc60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:58.060074 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c83073-7c46-4e02-a9a7-edbe3082fc60 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:58.085234 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-28c83073-7c46-4e02-a9a7-edbe3082fc60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:37:58.085234 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:58.085234 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:58.085234 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:58.085234 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:58.085234 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:58.085234 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:58.085234 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:58.085234 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:58.085234 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:58.085234 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:58.085234 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:58.085234 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:37:58.085234 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:37:58.085234 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:37:58.086219 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:37:58.086219 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:58.086219 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:58.086219 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:58.086219 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:58.086219 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:58.086219 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:58.086219 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:58.086219 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:58.086219 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:58.086219 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:58.086219 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:58.086219 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:58.086219 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:58.086219 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:58.086219 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:58.086219 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:58.087117 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:37:58.087117 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:37:58.087117 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:37:58.087117 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:37:58.087117 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 406/812] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 14 17:37:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:37:58.093781 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7134c4-f074-4fb6-a936-e17d01201775 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:58.093781 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7134c4-f074-4fb6-a936-e17d01201775 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:58.093781 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7134c4-f074-4fb6-a936-e17d01201775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:58.102654 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:58.120969 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-ae7134c4-f074-4fb6-a936-e17d01201775 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:37:58.123433 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-ae7134c4-f074-4fb6-a936-e17d01201775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:37:58.191621 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:58.197954 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134db111-0191-4994-86a8-6e33e7294861 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:58.246480 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6d7711-2cef-4ff7-aa19-4db6231143e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:58.247074 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6d7711-2cef-4ff7-aa19-4db6231143e5 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:58.247378 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6d7711-2cef-4ff7-aa19-4db6231143e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:58.247665 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6d7711-2cef-4ff7-aa19-4db6231143e5 None admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:58.248465 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6d7711-2cef-4ff7-aa19-4db6231143e5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:58.248899 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6d7711-2cef-4ff7-aa19-4db6231143e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:58.250439 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6d7711-2cef-4ff7-aa19-4db6231143e5 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:58.262496 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 407/813] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 14 17:37:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:58.263518 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6d7711-2cef-4ff7-aa19-4db6231143e5 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:58.284974 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 407/814] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:37:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 17:37:58.285514 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7134c4-f074-4fb6-a936-e17d01201775 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:58.428511 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6d7711-2cef-4ff7-aa19-4db6231143e5 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:58.476400 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d87afb-90ad-4e49-8681-ae86ebe3072f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:58.477088 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d87afb-90ad-4e49-8681-ae86ebe3072f None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:58.477380 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d87afb-90ad-4e49-8681-ae86ebe3072f None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:58.477646 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d87afb-90ad-4e49-8681-ae86ebe3072f None admin] PATH_INFO: `/v3/domains` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:58.478378 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d87afb-90ad-4e49-8681-ae86ebe3072f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:58.478687 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d87afb-90ad-4e49-8681-ae86ebe3072f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:58.480120 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d87afb-90ad-4e49-8681-ae86ebe3072f None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:58.500131 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7134c4-f074-4fb6-a936-e17d01201775 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:58.507510 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 408/815] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 14 17:37:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:58.509469 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d87afb-90ad-4e49-8681-ae86ebe3072f None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:58.542020 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4690aa3b-8fcb-4ba8-a719-36212954b211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:58.542906 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4690aa3b-8fcb-4ba8-a719-36212954b211 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:58.543194 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4690aa3b-8fcb-4ba8-a719-36212954b211 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:58.543535 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4690aa3b-8fcb-4ba8-a719-36212954b211 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:58.548431 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:58.551843 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:58.560355 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4690aa3b-8fcb-4ba8-a719-36212954b211 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:58.565761 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4690aa3b-8fcb-4ba8-a719-36212954b211 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:58.588714 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-4690aa3b-8fcb-4ba8-a719-36212954b211 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:37:58.588714 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:58.588714 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:58.588714 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:58.588714 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:58.588714 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:58.588714 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:58.588714 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:58.588714 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:58.588714 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:58.588714 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:58.588714 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:58.588714 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:37:58.588714 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:37:58.588714 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:37:58.589843 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:37:58.589843 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:58.589843 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:58.589843 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:58.589843 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:58.589843 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:58.589843 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:58.589843 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:58.589843 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:58.589843 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:58.589843 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:58.589843 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:58.589843 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:58.589843 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:58.589843 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:58.589843 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:58.589843 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:58.590869 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:37:58.590869 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:37:58.590869 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:37:58.590869 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:37:58.598335 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 408/816] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 14 17:37:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:37:58.598335 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4690aa3b-8fcb-4ba8-a719-36212954b211 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:58.655027 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d87afb-90ad-4e49-8681-ae86ebe3072f None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:58.701351 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56be3b8-d67b-4c62-8d7a-f990b7dc9f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:58.702172 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56be3b8-d67b-4c62-8d7a-f990b7dc9f67 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:58.702569 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56be3b8-d67b-4c62-8d7a-f990b7dc9f67 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:58.702865 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56be3b8-d67b-4c62-8d7a-f990b7dc9f67 None admin] PATH_INFO: `/v3/services/network` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:58.703739 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56be3b8-d67b-4c62-8d7a-f990b7dc9f67 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:58.705494 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56be3b8-d67b-4c62-8d7a-f990b7dc9f67 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:58.718724 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-f56be3b8-d67b-4c62-8d7a-f990b7dc9f67 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 14 17:37:58.718724 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:58.718724 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 14 17:37:58.718724 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 14 17:37:58.718724 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 14 17:37:58.718724 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 14 17:37:58.718724 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 14 17:37:58.718724 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 17:37:58.718724 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 14 17:37:58.718724 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:37:58.718724 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 14 17:37:58.718724 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:37:58.718724 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:58.718724 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:58.718724 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:58.718724 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:58.718724 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:58.719819 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:58.719819 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:58.719819 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:58.719819 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:58.719819 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:58.719819 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:58.719819 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 14 17:37:58.719819 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 14 17:37:58.719819 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 14 17:37:58.719819 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 14 17:37:58.719819 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:58.719819 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:58.719819 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:58.719819 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:58.719819 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:58.719819 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:58.721711 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:58.721711 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:58.721711 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:58.721711 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:58.721711 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:58.721711 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:58.721711 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:58.721711 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:58.721711 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:58.721711 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:58.721711 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 14 17:37:58.721711 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 17:37:58.721711 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 14 17:37:58.721711 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:37:58.723645 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 409/817] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 14 17:37:58 2022] GET /identity/v3/services/network => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:37:58.724729 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56be3b8-d67b-4c62-8d7a-f990b7dc9f67 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:58.756657 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4690aa3b-8fcb-4ba8-a719-36212954b211 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:58.804219 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e48a64-c086-4fe1-a81a-165a6fe694f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:58.805139 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e48a64-c086-4fe1-a81a-165a6fe694f5 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:58.805436 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e48a64-c086-4fe1-a81a-165a6fe694f5 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:58.805719 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e48a64-c086-4fe1-a81a-165a6fe694f5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:58.814692 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e48a64-c086-4fe1-a81a-165a6fe694f5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:58.816639 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e48a64-c086-4fe1-a81a-165a6fe694f5 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:58.832520 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-e9e48a64-c086-4fe1-a81a-165a6fe694f5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:37:58.832520 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:58.832520 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:58.832520 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:58.832520 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:58.832520 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:58.832520 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:58.832520 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:58.832520 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:58.832520 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:58.832520 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:58.832520 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:58.832520 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 14 17:37:58.832520 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 14 17:37:58.832520 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 14 17:37:58.833494 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 14 17:37:58.833494 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:58.833494 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:58.833494 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:58.833494 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:58.833494 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:58.833494 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:58.833494 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:58.833494 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:58.833494 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:58.833494 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:58.833494 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:58.833494 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:58.833494 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:58.833494 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:58.833494 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:58.833494 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:58.834842 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 14 17:37:58.834842 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 14 17:37:58.834842 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 14 17:37:58.834842 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 14 17:37:58.834842 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 14 17:37:58.834842 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 14 17:37:58.834842 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:37:58.834842 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:37:58.834842 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 409/818] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 14 17:37:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:37:58.835591 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e48a64-c086-4fe1-a81a-165a6fe694f5 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:58.910016 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:58.977964 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:58.982124 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e48a64-c086-4fe1-a81a-165a6fe694f5 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:58.996980 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56be3b8-d67b-4c62-8d7a-f990b7dc9f67 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:59.038502 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8dd38b-81dd-4245-ad06-38822fbe75fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:59.039106 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8dd38b-81dd-4245-ad06-38822fbe75fb None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:59.039427 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8dd38b-81dd-4245-ad06-38822fbe75fb None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:59.039773 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8dd38b-81dd-4245-ad06-38822fbe75fb None admin] PATH_INFO: `/v3/services` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:59.040507 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8dd38b-81dd-4245-ad06-38822fbe75fb None admin] RBAC: Adding query filter params (name=network) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:59.040847 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8dd38b-81dd-4245-ad06-38822fbe75fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:59.042271 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39281dc2-3536-4d1d-968c-e9f4acc1d07a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:59.042396 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8dd38b-81dd-4245-ad06-38822fbe75fb None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:59.043283 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39281dc2-3536-4d1d-968c-e9f4acc1d07a None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:59.044158 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39281dc2-3536-4d1d-968c-e9f4acc1d07a None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:59.045081 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39281dc2-3536-4d1d-968c-e9f4acc1d07a None admin] PATH_INFO: `/v3/domains` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:59.046334 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39281dc2-3536-4d1d-968c-e9f4acc1d07a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:59.046835 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39281dc2-3536-4d1d-968c-e9f4acc1d07a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:59.049433 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39281dc2-3536-4d1d-968c-e9f4acc1d07a None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:59.053239 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 410/819] 10.222.0.36 () {56 vars in 1112 bytes} [Tue Jun 14 17:37:58 2022] GET /identity/v3/services?name=network => generated 124 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:59.054267 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8dd38b-81dd-4245-ad06-38822fbe75fb None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:59.066965 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 410/820] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 14 17:37:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:59.074101 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39281dc2-3536-4d1d-968c-e9f4acc1d07a None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:59.196232 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8dd38b-81dd-4245-ad06-38822fbe75fb None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:59.212259 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:59.213628 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39281dc2-3536-4d1d-968c-e9f4acc1d07a None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:59.254554 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892d82a4-48e1-4f65-8da4-e64beca0f79d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:59.255122 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2bdff8-6512-4599-8450-3c1cabf1a54a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:59.255829 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892d82a4-48e1-4f65-8da4-e64beca0f79d None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:59.255938 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2bdff8-6512-4599-8450-3c1cabf1a54a None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:59.256266 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2bdff8-6512-4599-8450-3c1cabf1a54a None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:59.256595 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892d82a4-48e1-4f65-8da4-e64beca0f79d None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:59.256697 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2bdff8-6512-4599-8450-3c1cabf1a54a None admin] PATH_INFO: `/v3/services` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:59.257140 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892d82a4-48e1-4f65-8da4-e64beca0f79d None admin] PATH_INFO: `/v3/projects` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:59.257508 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2bdff8-6512-4599-8450-3c1cabf1a54a None admin] RBAC: Adding query filter params (type=network) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:59.257900 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2bdff8-6512-4599-8450-3c1cabf1a54a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:59.258497 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892d82a4-48e1-4f65-8da4-e64beca0f79d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:59.258991 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892d82a4-48e1-4f65-8da4-e64beca0f79d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:59.259567 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2bdff8-6512-4599-8450-3c1cabf1a54a None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:59.261337 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892d82a4-48e1-4f65-8da4-e64beca0f79d None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:59.270869 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 411/821] 10.222.0.36 () {56 vars in 1112 bytes} [Tue Jun 14 17:37:59 2022] GET /identity/v3/services?type=network => generated 350 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:59.272352 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2bdff8-6512-4599-8450-3c1cabf1a54a None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:59.279661 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 411/822] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jun 14 17:37:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:59.280958 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892d82a4-48e1-4f65-8da4-e64beca0f79d None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:59.290960 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:59.404701 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2bdff8-6512-4599-8450-3c1cabf1a54a None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:59.446158 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3966362d-3324-4c2a-8e36-8c0757792edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:59.447097 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3966362d-3324-4c2a-8e36-8c0757792edb None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:59.447421 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3966362d-3324-4c2a-8e36-8c0757792edb None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:59.447703 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3966362d-3324-4c2a-8e36-8c0757792edb None admin] PATH_INFO: `/v3/users/nova` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:59.456732 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3966362d-3324-4c2a-8e36-8c0757792edb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:59.458385 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3966362d-3324-4c2a-8e36-8c0757792edb None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:59.474642 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-3966362d-3324-4c2a-8e36-8c0757792edb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 14 17:37:59.474642 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:59.474642 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:59.474642 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:59.474642 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:59.474642 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:59.474642 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:59.474642 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:59.474642 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:59.474642 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:59.474642 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:59.474642 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:59.474642 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 14 17:37:59.474642 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 14 17:37:59.474642 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 14 17:37:59.474642 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 14 17:37:59.475691 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:59.475691 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:59.475691 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 14 17:37:59.475691 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:37:59.475691 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 14 17:37:59.475691 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:37:59.475691 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:59.475691 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:59.475691 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:59.475691 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:59.475691 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:59.475691 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:59.475691 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:59.475691 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:59.475691 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:59.475691 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:59.475691 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:59.475691 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:59.477080 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:59.477080 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:59.477080 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 14 17:37:59.477080 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 14 17:37:59.477080 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 14 17:37:59.477080 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 14 17:37:59.477080 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 14 17:37:59.477080 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 14 17:37:59.477080 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 14 17:37:59.477080 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:37:59.477080 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 412/823] 10.222.0.36 () {56 vars in 1093 bytes} [Tue Jun 14 17:37:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:37:59.477987 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3966362d-3324-4c2a-8e36-8c0757792edb None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:59.496440 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892d82a4-48e1-4f65-8da4-e64beca0f79d None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:59.560369 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aea7de4-3ace-4dce-bf2e-39c078a5eda3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:59.560969 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aea7de4-3ace-4dce-bf2e-39c078a5eda3 None admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:59.561263 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aea7de4-3ace-4dce-bf2e-39c078a5eda3 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:59.561550 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aea7de4-3ace-4dce-bf2e-39c078a5eda3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:59.562553 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aea7de4-3ace-4dce-bf2e-39c078a5eda3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:59.564606 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:59.565748 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aea7de4-3ace-4dce-bf2e-39c078a5eda3 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:59.626824 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3966362d-3324-4c2a-8e36-8c0757792edb None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:59.692067 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc531d1-c7a6-4fb1-aac9-b0e9da477200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:59.694313 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc531d1-c7a6-4fb1-aac9-b0e9da477200 None admin] REQUEST_METHOD: `PUT` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:59.695136 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc531d1-c7a6-4fb1-aac9-b0e9da477200 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:59.695882 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc531d1-c7a6-4fb1-aac9-b0e9da477200 None admin] PATH_INFO: `/v3/projects/f3e1d023a52c42b98d018617987ef83c/users/ba38b47a31b14526be0aa2054841881b/roles/1348580877d04014bfdec4d866b98a74` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:59.704028 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 412/824] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Jun 14 17:37:59 2022] POST /identity/v3/endpoints => generated 327 bytes in 423 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:37:59.710583 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aea7de4-3ace-4dce-bf2e-39c078a5eda3 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:59.710904 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc531d1-c7a6-4fb1-aac9-b0e9da477200 None admin] RBAC: Authorizing `identity:create_grant(project_id=f3e1d023a52c42b98d018617987ef83c, user_id=ba38b47a31b14526be0aa2054841881b, role_id=1348580877d04014bfdec4d866b98a74)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:59.710904 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc531d1-c7a6-4fb1-aac9-b0e9da477200 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:59.778773 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:59.840484 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 413/825] 10.222.0.36 () {58 vars in 1439 bytes} [Tue Jun 14 17:37:59 2022] PUT /identity/v3/projects/f3e1d023a52c42b98d018617987ef83c/users/ba38b47a31b14526be0aa2054841881b/roles/1348580877d04014bfdec4d866b98a74 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:37:59.841832 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfc13d9-d69d-4f81-bdcc-300fbad35d0c None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:59.842179 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfc13d9-d69d-4f81-bdcc-300fbad35d0c None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:59.842457 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfc13d9-d69d-4f81-bdcc-300fbad35d0c None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:59.844119 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 414/826] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:37:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:37:59.852755 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aedd5d0-74af-4f7c-a331-bdbcaf79e575 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:59.853475 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aedd5d0-74af-4f7c-a331-bdbcaf79e575 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:59.853972 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aedd5d0-74af-4f7c-a331-bdbcaf79e575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:59.878036 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-8aedd5d0-74af-4f7c-a331-bdbcaf79e575 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:37:59.880156 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-8aedd5d0-74af-4f7c-a331-bdbcaf79e575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:37:59.946639 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aea7de4-3ace-4dce-bf2e-39c078a5eda3 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:00.092496 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 415/827] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:37:59 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 17:38:00.093153 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369ff1ca-77b1-40d2-aeaa-369478264728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:00.094499 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369ff1ca-77b1-40d2-aeaa-369478264728 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:00.095638 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369ff1ca-77b1-40d2-aeaa-369478264728 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:00.096160 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369ff1ca-77b1-40d2-aeaa-369478264728 None admin] PATH_INFO: `/v3/users` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:00.097965 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369ff1ca-77b1-40d2-aeaa-369478264728 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:00.098539 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369ff1ca-77b1-40d2-aeaa-369478264728 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:00.101816 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369ff1ca-77b1-40d2-aeaa-369478264728 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:00.143972 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 413/828] 10.222.0.36 () {56 vars in 1133 bytes} [Tue Jun 14 17:37:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 439 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:00.151828 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aedd5d0-74af-4f7c-a331-bdbcaf79e575 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:00.153965 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369ff1ca-77b1-40d2-aeaa-369478264728 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:00.279693 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:00.290379 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:00.309560 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369ff1ca-77b1-40d2-aeaa-369478264728 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:00.352146 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35125452-fc97-4313-b04b-a532d6db04bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:00.353337 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35125452-fc97-4313-b04b-a532d6db04bd None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:00.353944 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35125452-fc97-4313-b04b-a532d6db04bd None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:00.354430 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35125452-fc97-4313-b04b-a532d6db04bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:00.386292 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aedd5d0-74af-4f7c-a331-bdbcaf79e575 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:00.461677 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829ace9e-7994-4884-b29b-b3b7eb11dd37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:00.463141 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829ace9e-7994-4884-b29b-b3b7eb11dd37 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:00.463693 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829ace9e-7994-4884-b29b-b3b7eb11dd37 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:00.464213 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829ace9e-7994-4884-b29b-b3b7eb11dd37 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:00.487255 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829ace9e-7994-4884-b29b-b3b7eb11dd37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:38:00.495740 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35125452-fc97-4313-b04b-a532d6db04bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:00.498432 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35125452-fc97-4313-b04b-a532d6db04bd None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:00.504952 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-829ace9e-7994-4884-b29b-b3b7eb11dd37 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 14 17:38:00.504952 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:00.504952 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:38:00.504952 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:38:00.504952 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:38:00.504952 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:38:00.504952 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:38:00.504952 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:38:00.504952 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:38:00.504952 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:38:00.504952 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:38:00.504952 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:38:00.504952 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:38:00.504952 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:38:00.504952 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:38:00.504952 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:38:00.505966 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:38:00.505966 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:38:00.505966 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:38:00.505966 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:38:00.505966 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:38:00.505966 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:38:00.505966 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:38:00.505966 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:38:00.505966 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:38:00.505966 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:38:00.505966 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:38:00.505966 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:38:00.505966 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:38:00.505966 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:38:00.505966 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:38:00.505966 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:38:00.506816 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:38:00.506816 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:38:00.506816 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:38:00.506816 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:38:00.506816 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:38:00.506816 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:38:00.506816 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:38:00.506816 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:38:00.506816 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:38:00.506816 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:38:00.506816 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 14 17:38:00.506816 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:38:00.508016 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 416/829] 10.222.0.36 () {56 vars in 1102 bytes} [Tue Jun 14 17:38:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:38:00.514388 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829ace9e-7994-4884-b29b-b3b7eb11dd37 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:00.639174 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:00.675118 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 414/830] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 14 17:38:00 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 14 17:38:00.677372 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35125452-fc97-4313-b04b-a532d6db04bd None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:00.697058 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829ace9e-7994-4884-b29b-b3b7eb11dd37 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:00.721258 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:00.750187 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee9b9db-57c5-44a9-88de-06c76f74c9da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:00.752122 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee9b9db-57c5-44a9-88de-06c76f74c9da None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:00.752560 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee9b9db-57c5-44a9-88de-06c76f74c9da None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:00.753063 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee9b9db-57c5-44a9-88de-06c76f74c9da None admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:00.754752 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee9b9db-57c5-44a9-88de-06c76f74c9da None admin] RBAC: Adding query filter params (name=service) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:00.755346 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee9b9db-57c5-44a9-88de-06c76f74c9da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:00.758140 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee9b9db-57c5-44a9-88de-06c76f74c9da None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:00.780944 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 417/831] 10.222.0.36 () {56 vars in 1103 bytes} [Tue Jun 14 17:38:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:00.783597 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee9b9db-57c5-44a9-88de-06c76f74c9da None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:00.831952 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35125452-fc97-4313-b04b-a532d6db04bd None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:00.883590 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1c092e-e27c-45b7-a6e3-f9b2e75fbbcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:00.885581 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1c092e-e27c-45b7-a6e3-f9b2e75fbbcf None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:00.886196 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1c092e-e27c-45b7-a6e3-f9b2e75fbbcf None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:00.889615 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1c092e-e27c-45b7-a6e3-f9b2e75fbbcf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:00.912535 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1c092e-e27c-45b7-a6e3-f9b2e75fbbcf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:00.915685 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1c092e-e27c-45b7-a6e3-f9b2e75fbbcf None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:00.952420 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee9b9db-57c5-44a9-88de-06c76f74c9da None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:00.955374 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-ce1c092e-e27c-45b7-a6e3-f9b2e75fbbcf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:38:00.955374 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:00.955374 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:38:00.955374 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:38:00.955374 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:38:00.955374 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:38:00.955374 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:38:00.955374 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:38:00.955374 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:38:00.955374 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:38:00.955374 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:38:00.955374 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:38:00.955374 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:38:00.955374 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:38:00.955374 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:38:00.956401 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:38:00.956401 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:38:00.956401 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:38:00.956401 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:38:00.956401 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:38:00.956401 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:38:00.956401 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:38:00.956401 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:38:00.956401 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:38:00.956401 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:38:00.956401 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:38:00.956401 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:38:00.956401 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:38:00.956401 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:38:00.956401 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:38:00.956401 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:38:00.956401 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:38:00.957311 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:38:00.957311 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:38:00.957311 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:38:00.957311 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:38:00.966688 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 415/832] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 14 17:38:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:38:00.968986 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1c092e-e27c-45b7-a6e3-f9b2e75fbbcf None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:00.998300 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb20a90-b760-4c48-ba74-4a0d44c85d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:00.999483 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb20a90-b760-4c48-ba74-4a0d44c85d25 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:01.000238 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb20a90-b760-4c48-ba74-4a0d44c85d25 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:01.000723 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb20a90-b760-4c48-ba74-4a0d44c85d25 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:01.014833 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb20a90-b760-4c48-ba74-4a0d44c85d25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:01.017236 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb20a90-b760-4c48-ba74-4a0d44c85d25 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:01.033847 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:01.042848 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-4cb20a90-b760-4c48-ba74-4a0d44c85d25 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:38:01.042848 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:01.042848 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:38:01.042848 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:38:01.042848 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:38:01.042848 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:38:01.042848 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:38:01.042848 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:38:01.042848 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:38:01.042848 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:38:01.042848 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:38:01.042848 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:38:01.042848 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:38:01.042848 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:38:01.042848 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:38:01.051084 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:38:01.051084 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:38:01.051084 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:38:01.051084 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:38:01.051084 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:38:01.051084 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:38:01.051084 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:38:01.051084 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:38:01.051084 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:38:01.051084 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:38:01.051084 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:38:01.051084 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:38:01.051084 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:38:01.051084 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:38:01.051084 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:38:01.051084 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:38:01.051084 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:38:01.052030 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:38:01.052030 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:38:01.052030 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:38:01.052030 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:38:01.052030 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 418/833] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 14 17:38:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 17:38:01.054204 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb20a90-b760-4c48-ba74-4a0d44c85d25 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:01.098714 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:01.148491 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1c092e-e27c-45b7-a6e3-f9b2e75fbbcf None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:01.195829 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a768f4f2-3d84-4470-af50-33b96924a705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:01.196884 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a768f4f2-3d84-4470-af50-33b96924a705 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:01.197482 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a768f4f2-3d84-4470-af50-33b96924a705 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:01.197969 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a768f4f2-3d84-4470-af50-33b96924a705 None admin] PATH_INFO: `/v3/domains` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:01.198963 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a768f4f2-3d84-4470-af50-33b96924a705 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:01.199528 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a768f4f2-3d84-4470-af50-33b96924a705 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:01.201179 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a768f4f2-3d84-4470-af50-33b96924a705 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:01.217438 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 416/834] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 14 17:38:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:01.228651 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a768f4f2-3d84-4470-af50-33b96924a705 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:01.267647 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb20a90-b760-4c48-ba74-4a0d44c85d25 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:01.331134 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f7d2e9-d39e-43f5-b3bb-4e65e9fbbd72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:01.331885 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f7d2e9-d39e-43f5-b3bb-4e65e9fbbd72 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:01.332355 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f7d2e9-d39e-43f5-b3bb-4e65e9fbbd72 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:01.332800 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f7d2e9-d39e-43f5-b3bb-4e65e9fbbd72 None admin] PATH_INFO: `/v3/domains` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:01.333990 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f7d2e9-d39e-43f5-b3bb-4e65e9fbbd72 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:01.334556 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f7d2e9-d39e-43f5-b3bb-4e65e9fbbd72 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:01.337388 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f7d2e9-d39e-43f5-b3bb-4e65e9fbbd72 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:01.355282 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 419/835] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 14 17:38:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:01.363812 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f7d2e9-d39e-43f5-b3bb-4e65e9fbbd72 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:01.381893 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:01.400975 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a768f4f2-3d84-4470-af50-33b96924a705 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:01.463368 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28951d8f-180f-4a20-91a2-0477a088bdcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:01.464654 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28951d8f-180f-4a20-91a2-0477a088bdcf None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:01.465096 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28951d8f-180f-4a20-91a2-0477a088bdcf None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:01.465535 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28951d8f-180f-4a20-91a2-0477a088bdcf None admin] PATH_INFO: `/v3/projects/service` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:01.478847 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28951d8f-180f-4a20-91a2-0477a088bdcf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:01.481567 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28951d8f-180f-4a20-91a2-0477a088bdcf None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:01.503939 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:01.510303 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-28951d8f-180f-4a20-91a2-0477a088bdcf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:38:01.510303 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:01.510303 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:38:01.510303 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:38:01.510303 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:38:01.510303 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:38:01.510303 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:38:01.510303 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:38:01.510303 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:38:01.510303 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:38:01.510303 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:38:01.510303 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:38:01.510303 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 14 17:38:01.510303 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 14 17:38:01.510303 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 14 17:38:01.520234 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 14 17:38:01.520234 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:38:01.520234 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:38:01.520234 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:38:01.520234 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:38:01.520234 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:38:01.520234 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:38:01.520234 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:38:01.520234 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:38:01.520234 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:38:01.520234 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:38:01.520234 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:38:01.520234 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:38:01.520234 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:38:01.520234 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:38:01.520234 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:38:01.520234 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:38:01.521122 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 14 17:38:01.521122 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 14 17:38:01.521122 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 14 17:38:01.521122 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 14 17:38:01.521122 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 14 17:38:01.521122 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 14 17:38:01.521122 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:38:01.521122 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:38:01.521122 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 417/836] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 14 17:38:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 17:38:01.521122 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad12ef8b-050d-442b-91c4-88acc2771a4d None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:01.521122 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad12ef8b-050d-442b-91c4-88acc2771a4d None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:01.521725 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad12ef8b-050d-442b-91c4-88acc2771a4d None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:01.521725 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 418/837] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:38:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:38:01.521725 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad12ef8b-050d-442b-91c4-88acc2771a4d None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:01.523816 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f7d2e9-d39e-43f5-b3bb-4e65e9fbbd72 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:01.570722 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7087d396-4c38-4ed7-aa12-5625bb2845a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:01.571595 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7087d396-4c38-4ed7-aa12-5625bb2845a5 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:01.571879 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7087d396-4c38-4ed7-aa12-5625bb2845a5 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:01.572158 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7087d396-4c38-4ed7-aa12-5625bb2845a5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:01.585807 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7087d396-4c38-4ed7-aa12-5625bb2845a5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:01.588573 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7087d396-4c38-4ed7-aa12-5625bb2845a5 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:01.615832 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-7087d396-4c38-4ed7-aa12-5625bb2845a5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 14 17:38:01.615832 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:01.615832 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:38:01.615832 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:38:01.615832 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:38:01.615832 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:38:01.615832 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:38:01.615832 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:38:01.615832 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:38:01.615832 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:38:01.615832 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:38:01.615832 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:38:01.615832 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 14 17:38:01.615832 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 14 17:38:01.615832 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 14 17:38:01.615832 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 14 17:38:01.616869 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:38:01.616869 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:38:01.616869 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 14 17:38:01.616869 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:38:01.616869 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 14 17:38:01.616869 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:38:01.616869 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:38:01.616869 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:38:01.616869 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:38:01.616869 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:38:01.616869 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:38:01.616869 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:38:01.616869 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:38:01.616869 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:38:01.616869 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:38:01.616869 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:38:01.616869 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:38:01.616869 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:38:01.617814 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:38:01.617814 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:38:01.617814 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 14 17:38:01.617814 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 14 17:38:01.617814 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 14 17:38:01.617814 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 14 17:38:01.617814 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 14 17:38:01.617814 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 14 17:38:01.617814 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 14 17:38:01.617814 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:38:01.618353 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 420/838] 10.222.0.36 () {56 vars in 1117 bytes} [Tue Jun 14 17:38:01 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:38:01.620026 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a2b074-9955-4c74-b7c6-25868f8360fa None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:01.620484 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a2b074-9955-4c74-b7c6-25868f8360fa None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:01.620900 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a2b074-9955-4c74-b7c6-25868f8360fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:01.649974 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-83a2b074-9955-4c74-b7c6-25868f8360fa None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:38:01.651996 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-83a2b074-9955-4c74-b7c6-25868f8360fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:38:01.664157 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad12ef8b-050d-442b-91c4-88acc2771a4d None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:01.706964 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8171545e-ec70-475b-a57f-2185f61e2fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:01.707884 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8171545e-ec70-475b-a57f-2185f61e2fb5 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:01.708099 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8171545e-ec70-475b-a57f-2185f61e2fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:01.708377 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8171545e-ec70-475b-a57f-2185f61e2fb5 None admin] PATH_INFO: `/v3/projects` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:01.709180 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8171545e-ec70-475b-a57f-2185f61e2fb5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:01.709491 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8171545e-ec70-475b-a57f-2185f61e2fb5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:01.711080 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8171545e-ec70-475b-a57f-2185f61e2fb5 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:01.728358 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 419/839] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jun 14 17:38:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:01.729063 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8171545e-ec70-475b-a57f-2185f61e2fb5 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:01.746306 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:01.783578 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 421/840] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:38:01 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 17:38:01.783578 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a2b074-9955-4c74-b7c6-25868f8360fa None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:01.886301 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8171545e-ec70-475b-a57f-2185f61e2fb5 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:01.934818 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:01.949366 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e43650-1c36-451c-8a90-c2e673a990c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:01.950065 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e43650-1c36-451c-8a90-c2e673a990c6 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:01.950353 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e43650-1c36-451c-8a90-c2e673a990c6 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:01.950637 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e43650-1c36-451c-8a90-c2e673a990c6 None admin] PATH_INFO: `/v3/users` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:01.951528 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e43650-1c36-451c-8a90-c2e673a990c6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:01.951849 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e43650-1c36-451c-8a90-c2e673a990c6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:01.953422 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e43650-1c36-451c-8a90-c2e673a990c6 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:01.964811 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a2b074-9955-4c74-b7c6-25868f8360fa None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:01.980102 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 420/841] 10.222.0.36 () {56 vars in 1149 bytes} [Tue Jun 14 17:38:01 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:01.980102 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e43650-1c36-451c-8a90-c2e673a990c6 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:02.035800 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4735ba86-ebc3-40bf-ac40-330f0a959288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:02.036490 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4735ba86-ebc3-40bf-ac40-330f0a959288 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:02.036774 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4735ba86-ebc3-40bf-ac40-330f0a959288 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:02.037055 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4735ba86-ebc3-40bf-ac40-330f0a959288 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:02.037928 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4735ba86-ebc3-40bf-ac40-330f0a959288 None admin] RBAC: Adding query filter params (role.id=1348580877d04014bfdec4d866b98a74, scope.project.id=f3e1d023a52c42b98d018617987ef83c, user.id=e4696d396adb495ab300a9a5a5727595) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:02.038247 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4735ba86-ebc3-40bf-ac40-330f0a959288 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:02.039729 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4735ba86-ebc3-40bf-ac40-330f0a959288 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:02.055330 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 422/842] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 14 17:38:01 2022] GET /identity/v3/role_assignments?user.id=e4696d396adb495ab300a9a5a5727595&scope.project.id=f3e1d023a52c42b98d018617987ef83c&role.id=1348580877d04014bfdec4d866b98a74 => generated 608 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:02.055330 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4735ba86-ebc3-40bf-ac40-330f0a959288 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:02.082651 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:02.154760 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e43650-1c36-451c-8a90-c2e673a990c6 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:02.223114 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96d03c0-5630-46bf-94bb-3b3825f41f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:02.224685 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d03c0-5630-46bf-94bb-3b3825f41f30 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:02.225274 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d03c0-5630-46bf-94bb-3b3825f41f30 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:02.225952 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d03c0-5630-46bf-94bb-3b3825f41f30 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:02.227327 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96d03c0-5630-46bf-94bb-3b3825f41f30 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:02.230037 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96d03c0-5630-46bf-94bb-3b3825f41f30 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:02.259085 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-a96d03c0-5630-46bf-94bb-3b3825f41f30 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 14 17:38:02.259085 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:02.259085 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 14 17:38:02.259085 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 14 17:38:02.259085 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 14 17:38:02.259085 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 14 17:38:02.259085 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 14 17:38:02.259085 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 17:38:02.259085 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 14 17:38:02.259085 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:38:02.259085 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 14 17:38:02.259085 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:38:02.259085 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:02.259085 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:38:02.259085 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:38:02.259085 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:38:02.259085 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:38:02.261096 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:38:02.261096 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:38:02.261096 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:38:02.261096 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:38:02.261096 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:38:02.261096 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:38:02.261096 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 14 17:38:02.261096 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 14 17:38:02.261096 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 14 17:38:02.261096 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 14 17:38:02.261096 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:38:02.261096 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:38:02.261096 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:38:02.261096 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:38:02.261096 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:38:02.261096 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:38:02.262532 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:38:02.262532 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:38:02.262532 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:38:02.262532 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:38:02.262532 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:38:02.262532 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:38:02.262532 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:38:02.262532 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:38:02.262532 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:38:02.262532 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:38:02.262532 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 14 17:38:02.262532 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 17:38:02.262532 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 14 17:38:02.262532 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:38:02.262532 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 421/843] 10.222.0.36 () {56 vars in 1114 bytes} [Tue Jun 14 17:38:01 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:38:02.273213 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4735ba86-ebc3-40bf-ac40-330f0a959288 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:02.275031 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96d03c0-5630-46bf-94bb-3b3825f41f30 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:02.348430 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0385d024-d9b3-4ff7-a7ca-0cb15cf697a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:02.349509 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0385d024-d9b3-4ff7-a7ca-0cb15cf697a7 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:02.350204 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0385d024-d9b3-4ff7-a7ca-0cb15cf697a7 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:02.350532 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0385d024-d9b3-4ff7-a7ca-0cb15cf697a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:02.385111 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:02.438965 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96d03c0-5630-46bf-94bb-3b3825f41f30 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:02.476003 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:02.481431 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c07d86-cf4d-4c04-85b0-560ff5011429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:02.482126 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c07d86-cf4d-4c04-85b0-560ff5011429 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:02.482414 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c07d86-cf4d-4c04-85b0-560ff5011429 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:02.482770 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c07d86-cf4d-4c04-85b0-560ff5011429 None admin] PATH_INFO: `/v3/services` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:02.483632 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c07d86-cf4d-4c04-85b0-560ff5011429 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:02.484030 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c07d86-cf4d-4c04-85b0-560ff5011429 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:02.485993 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c07d86-cf4d-4c04-85b0-560ff5011429 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:02.491061 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0385d024-d9b3-4ff7-a7ca-0cb15cf697a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:02.491705 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 422/844] 10.222.0.36 () {56 vars in 1114 bytes} [Tue Jun 14 17:38:02 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:38:02.493790 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0385d024-d9b3-4ff7-a7ca-0cb15cf697a7 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:02.499586 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c07d86-cf4d-4c04-85b0-560ff5011429 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:02.714797 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 423/845] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 14 17:38:02 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 661 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 14 17:38:02.722691 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0385d024-d9b3-4ff7-a7ca-0cb15cf697a7 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:02.823662 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:02.847202 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c07d86-cf4d-4c04-85b0-560ff5011429 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:02.922658 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d48169c-e2b5-44e0-8fdd-f7e510489dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:02.924416 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d48169c-e2b5-44e0-8fdd-f7e510489dfa None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:02.925179 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d48169c-e2b5-44e0-8fdd-f7e510489dfa None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:02.926103 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d48169c-e2b5-44e0-8fdd-f7e510489dfa None admin] PATH_INFO: `/v3/services` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:02.927921 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d48169c-e2b5-44e0-8fdd-f7e510489dfa None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:02.928911 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d48169c-e2b5-44e0-8fdd-f7e510489dfa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:02.932033 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d48169c-e2b5-44e0-8fdd-f7e510489dfa None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:02.942723 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 423/846] 10.222.0.36 () {56 vars in 1114 bytes} [Tue Jun 14 17:38:02 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 443 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:02.951364 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0385d024-d9b3-4ff7-a7ca-0cb15cf697a7 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:03.012750 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431ad6e0-dd9b-46f2-905a-06a5a00dc40c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:03.013927 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431ad6e0-dd9b-46f2-905a-06a5a00dc40c None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:03.014393 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431ad6e0-dd9b-46f2-905a-06a5a00dc40c None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:03.015033 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431ad6e0-dd9b-46f2-905a-06a5a00dc40c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:03.036038 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431ad6e0-dd9b-46f2-905a-06a5a00dc40c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:03.038580 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431ad6e0-dd9b-46f2-905a-06a5a00dc40c None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:03.066897 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dff4629-5a03-4185-95b6-9d6547b2a768 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:03.067551 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dff4629-5a03-4185-95b6-9d6547b2a768 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:03.068136 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dff4629-5a03-4185-95b6-9d6547b2a768 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:03.071550 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-431ad6e0-dd9b-46f2-905a-06a5a00dc40c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:38:03.071550 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:03.071550 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:38:03.071550 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:38:03.071550 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:38:03.071550 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:38:03.071550 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:38:03.071550 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:38:03.071550 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:38:03.071550 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:38:03.071550 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:38:03.071550 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:38:03.071550 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:38:03.071550 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:38:03.071550 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:38:03.072476 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:38:03.072476 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:38:03.072476 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:38:03.072476 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:38:03.072476 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:38:03.072476 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:38:03.072476 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:38:03.072476 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:38:03.072476 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:38:03.072476 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:38:03.072476 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:38:03.072476 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:38:03.072476 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:38:03.072476 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:38:03.072476 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:38:03.072476 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:38:03.072476 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:38:03.073380 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:38:03.073380 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:38:03.073380 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:38:03.073380 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:38:03.074032 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 424/847] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 14 17:38:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:38:03.075666 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 424/848] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:38:03 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 14 17:38:03.083179 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dff4629-5a03-4185-95b6-9d6547b2a768 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:03.083682 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217682db-dcee-4007-a058-5fbf67ef15f7 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:03.084040 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217682db-dcee-4007-a058-5fbf67ef15f7 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:03.084383 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217682db-dcee-4007-a058-5fbf67ef15f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:03.112781 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-217682db-dcee-4007-a058-5fbf67ef15f7 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:38:03.114028 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-217682db-dcee-4007-a058-5fbf67ef15f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:38:03.215702 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:03.221370 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 425/849] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:38:03 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 17:38:03.267413 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217682db-dcee-4007-a058-5fbf67ef15f7 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:03.298652 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dff4629-5a03-4185-95b6-9d6547b2a768 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:03.318425 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:03.339630 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635af543-36f9-4f6e-ad53-8e33bc17ba17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:03.340316 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635af543-36f9-4f6e-ad53-8e33bc17ba17 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:03.340601 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635af543-36f9-4f6e-ad53-8e33bc17ba17 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:03.340878 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635af543-36f9-4f6e-ad53-8e33bc17ba17 None admin] PATH_INFO: `/v3/domains` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:03.341611 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635af543-36f9-4f6e-ad53-8e33bc17ba17 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:03.341925 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635af543-36f9-4f6e-ad53-8e33bc17ba17 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:03.343333 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635af543-36f9-4f6e-ad53-8e33bc17ba17 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:03.358253 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 425/850] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 14 17:38:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:38:03.365033 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635af543-36f9-4f6e-ad53-8e33bc17ba17 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:03.461158 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217682db-dcee-4007-a058-5fbf67ef15f7 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:03.483331 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635af543-36f9-4f6e-ad53-8e33bc17ba17 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:03.509834 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:03.526930 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7a6261-2717-4fae-86e8-c83f547bbdae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:03.527382 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511bfb42-3428-45f6-b800-2ca9b365c5b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:03.528015 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511bfb42-3428-45f6-b800-2ca9b365c5b2 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:03.528309 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7a6261-2717-4fae-86e8-c83f547bbdae None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:03.528554 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511bfb42-3428-45f6-b800-2ca9b365c5b2 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:03.528554 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511bfb42-3428-45f6-b800-2ca9b365c5b2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:03.529006 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7a6261-2717-4fae-86e8-c83f547bbdae None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:03.529259 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7a6261-2717-4fae-86e8-c83f547bbdae None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:03.537982 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511bfb42-3428-45f6-b800-2ca9b365c5b2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:03.540460 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511bfb42-3428-45f6-b800-2ca9b365c5b2 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:03.550607 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7a6261-2717-4fae-86e8-c83f547bbdae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:38:03.556815 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-511bfb42-3428-45f6-b800-2ca9b365c5b2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:38:03.556815 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:03.556815 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:38:03.556815 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:38:03.556815 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:38:03.556815 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:38:03.556815 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:38:03.556815 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:38:03.556815 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:38:03.556815 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:38:03.556815 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:38:03.556815 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:38:03.556815 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 14 17:38:03.556815 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 14 17:38:03.556815 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 14 17:38:03.560148 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 14 17:38:03.560148 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:38:03.560148 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:38:03.560148 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:38:03.560148 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:38:03.560148 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:38:03.560148 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:38:03.560148 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:38:03.560148 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:38:03.560148 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:38:03.560148 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:38:03.560148 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:38:03.560148 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:38:03.560148 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:38:03.560148 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:38:03.560148 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:38:03.560148 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:38:03.564209 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 14 17:38:03.564209 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 14 17:38:03.564209 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 14 17:38:03.564209 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 14 17:38:03.564209 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 14 17:38:03.564209 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 14 17:38:03.564209 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:38:03.564209 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:38:03.564209 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 426/851] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 14 17:38:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 17:38:03.571978 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511bfb42-3428-45f6-b800-2ca9b365c5b2 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:03.572129 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-ef7a6261-2717-4fae-86e8-c83f547bbdae None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 17:38:03.572129 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:03.572129 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:38:03.572129 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:38:03.572129 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:38:03.572129 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:38:03.572129 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:38:03.572129 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:38:03.572129 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:38:03.572129 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:38:03.572129 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:38:03.572129 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:38:03.572129 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:38:03.572129 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:38:03.572129 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:38:03.572129 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:38:03.573815 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:38:03.573815 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:38:03.573815 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:38:03.573815 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:38:03.573815 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:38:03.573815 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:38:03.573815 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:38:03.573815 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:38:03.573815 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:38:03.573815 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:38:03.573815 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:38:03.573815 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:38:03.573815 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:38:03.573815 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:38:03.573815 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:38:03.573815 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:38:03.575468 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:38:03.575468 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:38:03.575468 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:38:03.575468 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:38:03.575468 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:38:03.575468 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:38:03.575468 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:38:03.575468 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:38:03.575468 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:38:03.575468 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:38:03.575468 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 17:38:03.575468 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:38:03.575468 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 426/852] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jun 14 17:38:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 17:38:03.579475 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7a6261-2717-4fae-86e8-c83f547bbdae None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:03.685473 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511bfb42-3428-45f6-b800-2ca9b365c5b2 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:03.744734 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:03.747734 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9a23bd-d138-4986-9bf1-6551f836b780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:03.749927 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9a23bd-d138-4986-9bf1-6551f836b780 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:03.751749 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9a23bd-d138-4986-9bf1-6551f836b780 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:03.752582 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9a23bd-d138-4986-9bf1-6551f836b780 None admin] PATH_INFO: `/v3/projects` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:03.755803 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9a23bd-d138-4986-9bf1-6551f836b780 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:03.758524 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9a23bd-d138-4986-9bf1-6551f836b780 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:03.760541 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9a23bd-d138-4986-9bf1-6551f836b780 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:03.760781 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7a6261-2717-4fae-86e8-c83f547bbdae None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:03.796807 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 427/853] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jun 14 17:38:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:03.804183 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9a23bd-d138-4986-9bf1-6551f836b780 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:03.810417 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb64a1c-5cd5-4c95-b18a-59c573943377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:03.810944 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb64a1c-5cd5-4c95-b18a-59c573943377 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:03.811245 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb64a1c-5cd5-4c95-b18a-59c573943377 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:03.811586 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb64a1c-5cd5-4c95-b18a-59c573943377 None admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:03.812330 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb64a1c-5cd5-4c95-b18a-59c573943377 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:03.812651 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb64a1c-5cd5-4c95-b18a-59c573943377 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:03.815946 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb64a1c-5cd5-4c95-b18a-59c573943377 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:03.826525 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 427/854] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 14 17:38:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:03.836272 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb64a1c-5cd5-4c95-b18a-59c573943377 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:03.900785 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:04.007377 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9a23bd-d138-4986-9bf1-6551f836b780 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:04.037272 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb64a1c-5cd5-4c95-b18a-59c573943377 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:04.079734 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeb2eb3-cf9e-4aa1-8278-2a17b011ec0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:04.081302 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeb2eb3-cf9e-4aa1-8278-2a17b011ec0e None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:04.082055 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeb2eb3-cf9e-4aa1-8278-2a17b011ec0e None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:04.082797 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeb2eb3-cf9e-4aa1-8278-2a17b011ec0e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:04.084731 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aeb2eb3-cf9e-4aa1-8278-2a17b011ec0e None admin] RBAC: Adding query filter params (role.id=ed6a4c87428044ddbc5199cfb05de27e, scope.project.id=f3e1d023a52c42b98d018617987ef83c, user.id=f1e32638fe5c4d2d8d3e2e4ea8250aaa) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:04.085571 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aeb2eb3-cf9e-4aa1-8278-2a17b011ec0e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:04.088654 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aeb2eb3-cf9e-4aa1-8278-2a17b011ec0e None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:04.104051 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 428/855] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 14 17:38:03 2022] GET /identity/v3/role_assignments?user.id=f1e32638fe5c4d2d8d3e2e4ea8250aaa&scope.project.id=f3e1d023a52c42b98d018617987ef83c&role.id=ed6a4c87428044ddbc5199cfb05de27e => generated 608 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:04.118170 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18fd18f-f0b1-4aca-8d96-6c7cef7ca67b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:04.120127 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18fd18f-f0b1-4aca-8d96-6c7cef7ca67b None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:04.121005 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18fd18f-f0b1-4aca-8d96-6c7cef7ca67b None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:04.121760 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18fd18f-f0b1-4aca-8d96-6c7cef7ca67b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:04.146280 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18fd18f-f0b1-4aca-8d96-6c7cef7ca67b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:04.149558 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18fd18f-f0b1-4aca-8d96-6c7cef7ca67b None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:04.186586 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-d18fd18f-f0b1-4aca-8d96-6c7cef7ca67b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:38:04.186586 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:04.186586 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:38:04.186586 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:38:04.186586 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:38:04.186586 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:38:04.186586 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:38:04.186586 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:38:04.186586 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:38:04.186586 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:38:04.186586 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:38:04.186586 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:38:04.186586 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:38:04.186586 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:38:04.186586 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:38:04.188443 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:38:04.188443 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:38:04.188443 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:38:04.188443 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:38:04.188443 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:38:04.188443 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:38:04.188443 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:38:04.188443 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:38:04.188443 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:38:04.188443 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:38:04.188443 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:38:04.188443 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:38:04.188443 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:38:04.188443 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:38:04.188443 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:38:04.188443 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:38:04.188443 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:38:04.190204 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:38:04.190204 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:38:04.190204 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:38:04.190204 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:38:04.193819 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 428/856] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 14 17:38:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 358 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:38:04.202148 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeb2eb3-cf9e-4aa1-8278-2a17b011ec0e None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:04.374491 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeb2eb3-cf9e-4aa1-8278-2a17b011ec0e None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:04.379933 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:04.417020 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5689709f-45b6-4abf-86ef-f9e198567686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:04.417761 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5689709f-45b6-4abf-86ef-f9e198567686 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:04.418051 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5689709f-45b6-4abf-86ef-f9e198567686 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:04.418331 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5689709f-45b6-4abf-86ef-f9e198567686 None admin] PATH_INFO: `/v3/domains` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:04.419076 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5689709f-45b6-4abf-86ef-f9e198567686 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:04.420335 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5689709f-45b6-4abf-86ef-f9e198567686 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:04.421745 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5689709f-45b6-4abf-86ef-f9e198567686 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:04.436393 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 429/857] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 14 17:38:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:04.445491 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18fd18f-f0b1-4aca-8d96-6c7cef7ca67b None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:04.449772 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:04.649377 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18fd18f-f0b1-4aca-8d96-6c7cef7ca67b None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:04.719690 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d125f8a7-89fb-431e-b5c8-f21b51ba0ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:04.721625 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d125f8a7-89fb-431e-b5c8-f21b51ba0ba2 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:04.722125 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d125f8a7-89fb-431e-b5c8-f21b51ba0ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:04.722632 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d125f8a7-89fb-431e-b5c8-f21b51ba0ba2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:04.738982 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d125f8a7-89fb-431e-b5c8-f21b51ba0ba2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:04.741870 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d125f8a7-89fb-431e-b5c8-f21b51ba0ba2 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:04.772182 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-d125f8a7-89fb-431e-b5c8-f21b51ba0ba2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 14 17:38:04.772182 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:04.772182 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:38:04.772182 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:38:04.772182 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:38:04.772182 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:38:04.772182 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:38:04.772182 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:38:04.772182 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:38:04.772182 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:38:04.772182 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:38:04.772182 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:38:04.772182 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 14 17:38:04.772182 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 14 17:38:04.772182 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 14 17:38:04.772182 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 14 17:38:04.774044 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:38:04.774044 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:38:04.774044 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 14 17:38:04.774044 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:38:04.774044 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 14 17:38:04.774044 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:38:04.774044 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:38:04.774044 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:38:04.774044 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:38:04.774044 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:38:04.774044 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:38:04.774044 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:38:04.774044 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:38:04.774044 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:38:04.774044 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:38:04.774044 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:38:04.774044 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:38:04.774044 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:38:04.775418 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:38:04.775418 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:38:04.775418 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 14 17:38:04.775418 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 14 17:38:04.775418 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 14 17:38:04.775418 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 14 17:38:04.775418 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 14 17:38:04.775418 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 14 17:38:04.775418 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 14 17:38:04.775418 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:38:04.775418 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 429/858] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jun 14 17:38:04 2022] GET /identity/v3/users/swift => generated 83 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:38:04.787918 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5689709f-45b6-4abf-86ef-f9e198567686 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:05.003436 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5689709f-45b6-4abf-86ef-f9e198567686 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:05.066154 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa78c33a-70b1-44a0-84a2-e19677ded003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:05.067386 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa78c33a-70b1-44a0-84a2-e19677ded003 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:05.067900 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa78c33a-70b1-44a0-84a2-e19677ded003 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:05.068395 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa78c33a-70b1-44a0-84a2-e19677ded003 None admin] PATH_INFO: `/v3/users` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:05.069989 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa78c33a-70b1-44a0-84a2-e19677ded003 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:05.070524 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa78c33a-70b1-44a0-84a2-e19677ded003 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:05.073482 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa78c33a-70b1-44a0-84a2-e19677ded003 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:05.115971 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 430/859] 10.222.0.36 () {56 vars in 1135 bytes} [Tue Jun 14 17:38:04 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:05.123758 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d125f8a7-89fb-431e-b5c8-f21b51ba0ba2 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:05.260554 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:05.335523 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d125f8a7-89fb-431e-b5c8-f21b51ba0ba2 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:05.401534 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0cfca3-2de1-42b5-bfde-8ed543973326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:05.402655 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0cfca3-2de1-42b5-bfde-8ed543973326 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:05.403164 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0cfca3-2de1-42b5-bfde-8ed543973326 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:05.403699 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0cfca3-2de1-42b5-bfde-8ed543973326 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:05.552760 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0cfca3-2de1-42b5-bfde-8ed543973326 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:05.555648 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0cfca3-2de1-42b5-bfde-8ed543973326 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:05.609949 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dda977-4467-4e23-86ff-5d9acd060229 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:05.610892 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dda977-4467-4e23-86ff-5d9acd060229 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:05.611113 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dda977-4467-4e23-86ff-5d9acd060229 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:05.617127 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 431/860] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:38:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 14 17:38:05.619585 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bd5387-e0ce-4807-b3d6-38169d81c5b1 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:05.620004 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bd5387-e0ce-4807-b3d6-38169d81c5b1 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:05.620391 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bd5387-e0ce-4807-b3d6-38169d81c5b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:05.643893 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-46bd5387-e0ce-4807-b3d6-38169d81c5b1 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:38:05.645430 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-46bd5387-e0ce-4807-b3d6-38169d81c5b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:38:05.664231 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:05.667059 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:05.719795 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 430/861] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 14 17:38:05 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 597 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 14 17:38:05.726090 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0cfca3-2de1-42b5-bfde-8ed543973326 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:05.736033 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 432/862] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:38:05 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 17:38:05.757573 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bd5387-e0ce-4807-b3d6-38169d81c5b1 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:05.845536 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0cfca3-2de1-42b5-bfde-8ed543973326 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:05.877851 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bd5387-e0ce-4807-b3d6-38169d81c5b1 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:05.887154 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c4b704-2737-4556-a0fe-b0c49905a269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:05.888416 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c4b704-2737-4556-a0fe-b0c49905a269 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:05.888912 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c4b704-2737-4556-a0fe-b0c49905a269 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:05.889397 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c4b704-2737-4556-a0fe-b0c49905a269 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:05.902500 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c4b704-2737-4556-a0fe-b0c49905a269 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:05.904682 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c4b704-2737-4556-a0fe-b0c49905a269 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:05.927180 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-b2c4b704-2737-4556-a0fe-b0c49905a269 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:38:05.927180 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:05.927180 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:38:05.927180 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:38:05.927180 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:38:05.927180 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:38:05.927180 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:38:05.927180 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:38:05.927180 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:38:05.927180 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:38:05.927180 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:38:05.927180 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:38:05.927180 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:38:05.927180 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:38:05.927180 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:38:05.928315 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:38:05.928315 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:38:05.928315 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:38:05.928315 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:38:05.928315 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:38:05.928315 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:38:05.928315 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:38:05.928315 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:38:05.928315 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:38:05.928315 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:38:05.928315 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:38:05.928315 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:38:05.928315 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:38:05.928315 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:38:05.928315 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:38:05.928315 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:38:05.928315 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:38:05.929218 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:38:05.929218 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:38:05.929218 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:38:05.929218 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:38:05.929816 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ee51e9-392e-49de-81dc-d03c412fa87f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:05.930606 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ee51e9-392e-49de-81dc-d03c412fa87f None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:05.930897 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ee51e9-392e-49de-81dc-d03c412fa87f None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:05.931179 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ee51e9-392e-49de-81dc-d03c412fa87f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:05.932060 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ee51e9-392e-49de-81dc-d03c412fa87f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:05.936582 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ee51e9-392e-49de-81dc-d03c412fa87f None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:05.937182 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 431/863] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 14 17:38:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 17:38:05.938365 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c4b704-2737-4556-a0fe-b0c49905a269 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:05.948262 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-95ee51e9-392e-49de-81dc-d03c412fa87f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 14 17:38:05.948262 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:05.948262 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 14 17:38:05.948262 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 14 17:38:05.948262 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 14 17:38:05.948262 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 14 17:38:05.948262 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 14 17:38:05.948262 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 17:38:05.948262 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 14 17:38:05.948262 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:38:05.948262 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 14 17:38:05.948262 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:38:05.948262 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:05.948262 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:38:05.948262 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:38:05.948262 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:38:05.949299 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:38:05.949299 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:38:05.949299 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:38:05.949299 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:38:05.949299 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:38:05.949299 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:38:05.949299 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:38:05.949299 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 14 17:38:05.949299 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 14 17:38:05.949299 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 14 17:38:05.949299 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 14 17:38:05.949299 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:38:05.949299 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:38:05.949299 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:38:05.949299 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:38:05.949299 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:38:05.950138 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:38:05.950138 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:38:05.950138 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:38:05.950138 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:38:05.950138 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:38:05.950138 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:38:05.950138 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:38:05.950138 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:38:05.950138 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:38:05.950138 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:38:05.950138 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:38:05.950138 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 14 17:38:05.950138 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 17:38:05.950138 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 14 17:38:05.950138 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:38:05.955486 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 433/864] 10.222.0.36 () {56 vars in 1132 bytes} [Tue Jun 14 17:38:05 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 17:38:05.956788 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ee51e9-392e-49de-81dc-d03c412fa87f None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:05.962205 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:05.979992 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:06.068508 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c4b704-2737-4556-a0fe-b0c49905a269 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:06.083248 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ee51e9-392e-49de-81dc-d03c412fa87f None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:06.109974 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f64fe7-3097-4395-a861-b12d0b849caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:06.111226 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f64fe7-3097-4395-a861-b12d0b849caf None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:06.111849 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f64fe7-3097-4395-a861-b12d0b849caf None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:06.112362 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f64fe7-3097-4395-a861-b12d0b849caf None admin] PATH_INFO: `/v3/domains` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:06.113340 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f64fe7-3097-4395-a861-b12d0b849caf None admin] RBAC: Adding query filter params (name=Default) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:06.113861 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f64fe7-3097-4395-a861-b12d0b849caf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:06.115768 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f64fe7-3097-4395-a861-b12d0b849caf None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:06.124473 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f20e0cb-4297-4086-a38b-bbe20825adf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:06.125163 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f20e0cb-4297-4086-a38b-bbe20825adf9 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:06.125453 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f20e0cb-4297-4086-a38b-bbe20825adf9 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:06.126318 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f20e0cb-4297-4086-a38b-bbe20825adf9 None admin] PATH_INFO: `/v3/services` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:06.127077 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f20e0cb-4297-4086-a38b-bbe20825adf9 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:06.128088 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f20e0cb-4297-4086-a38b-bbe20825adf9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:06.129054 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f20e0cb-4297-4086-a38b-bbe20825adf9 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:06.135645 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 432/865] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 14 17:38:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:06.138456 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f64fe7-3097-4395-a861-b12d0b849caf None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:06.139642 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 434/866] 10.222.0.36 () {56 vars in 1126 bytes} [Tue Jun 14 17:38:05 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:06.141099 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f20e0cb-4297-4086-a38b-bbe20825adf9 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:06.228477 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:06.239587 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:06.263158 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f64fe7-3097-4395-a861-b12d0b849caf None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:06.264723 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f20e0cb-4297-4086-a38b-bbe20825adf9 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:06.305773 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d03f70-b862-4fc9-a654-d720699934c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:06.306185 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651a839c-7f37-49ad-ac2f-25a8bd481829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:06.306881 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651a839c-7f37-49ad-ac2f-25a8bd481829 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:06.307172 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651a839c-7f37-49ad-ac2f-25a8bd481829 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:06.307507 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651a839c-7f37-49ad-ac2f-25a8bd481829 None admin] PATH_INFO: `/v3/services` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:06.307879 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d03f70-b862-4fc9-a654-d720699934c9 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:06.308241 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651a839c-7f37-49ad-ac2f-25a8bd481829 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:06.308560 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651a839c-7f37-49ad-ac2f-25a8bd481829 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:06.308815 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d03f70-b862-4fc9-a654-d720699934c9 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:06.309284 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d03f70-b862-4fc9-a654-d720699934c9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:06.309948 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651a839c-7f37-49ad-ac2f-25a8bd481829 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:06.318414 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d03f70-b862-4fc9-a654-d720699934c9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:06.319397 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 435/867] 10.222.0.36 () {56 vars in 1126 bytes} [Tue Jun 14 17:38:06 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:38:06.320965 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cbf30a-ee18-4996-b2b8-70b4c9f3f65a None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:06.321280 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cbf30a-ee18-4996-b2b8-70b4c9f3f65a None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:06.321397 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d03f70-b862-4fc9-a654-d720699934c9 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:06.321559 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cbf30a-ee18-4996-b2b8-70b4c9f3f65a None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:06.323348 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 436/868] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:38:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:38:06.329670 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432a7a42-97e2-490b-a850-071d2c98b6d7 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:06.330104 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432a7a42-97e2-490b-a850-071d2c98b6d7 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:06.330278 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432a7a42-97e2-490b-a850-071d2c98b6d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:06.342080 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-18d03f70-b862-4fc9-a654-d720699934c9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:38:06.342080 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:06.342080 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:38:06.342080 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:38:06.342080 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:38:06.342080 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:38:06.342080 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:38:06.342080 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:38:06.342080 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:38:06.342080 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:38:06.342080 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:38:06.342080 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:38:06.342080 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 14 17:38:06.342080 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 14 17:38:06.342080 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 14 17:38:06.343061 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 14 17:38:06.343061 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:38:06.343061 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:38:06.343061 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:38:06.343061 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:38:06.343061 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:38:06.343061 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:38:06.343061 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:38:06.343061 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:38:06.343061 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:38:06.343061 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:38:06.343061 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:38:06.343061 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:38:06.343061 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:38:06.343061 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:38:06.343061 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:38:06.343061 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:38:06.344139 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 14 17:38:06.344139 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 14 17:38:06.344139 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 14 17:38:06.344139 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 14 17:38:06.344139 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 14 17:38:06.344139 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 14 17:38:06.344139 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:38:06.344139 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:38:06.352483 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-432a7a42-97e2-490b-a850-071d2c98b6d7 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:38:06.352483 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-432a7a42-97e2-490b-a850-071d2c98b6d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:38:06.353312 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 433/869] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 14 17:38:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:38:06.354646 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d03f70-b862-4fc9-a654-d720699934c9 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:06.439864 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 437/870] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:38:06 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 14 17:38:06.458776 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432a7a42-97e2-490b-a850-071d2c98b6d7 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:06.479561 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d03f70-b862-4fc9-a654-d720699934c9 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:06.530786 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9368fed-bc19-4ddb-9a49-0a66f7d8bd95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:06.531496 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9368fed-bc19-4ddb-9a49-0a66f7d8bd95 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:06.531783 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9368fed-bc19-4ddb-9a49-0a66f7d8bd95 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:06.532571 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9368fed-bc19-4ddb-9a49-0a66f7d8bd95 None admin] PATH_INFO: `/v3/projects` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:06.533844 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9368fed-bc19-4ddb-9a49-0a66f7d8bd95 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:06.534193 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9368fed-bc19-4ddb-9a49-0a66f7d8bd95 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:06.536498 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9368fed-bc19-4ddb-9a49-0a66f7d8bd95 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:06.538746 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:06.553273 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 434/871] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jun 14 17:38:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:06.559607 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9368fed-bc19-4ddb-9a49-0a66f7d8bd95 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:06.567787 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:06.596967 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432a7a42-97e2-490b-a850-071d2c98b6d7 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:06.637628 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32cb1e0-9b68-4d0b-b9fe-3c62fc480ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:06.638559 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32cb1e0-9b68-4d0b-b9fe-3c62fc480ea5 None admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:06.638993 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32cb1e0-9b68-4d0b-b9fe-3c62fc480ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:06.639501 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32cb1e0-9b68-4d0b-b9fe-3c62fc480ea5 None admin] PATH_INFO: `/v3/services` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:06.640493 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32cb1e0-9b68-4d0b-b9fe-3c62fc480ea5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:06.642648 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32cb1e0-9b68-4d0b-b9fe-3c62fc480ea5 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:06.694798 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9368fed-bc19-4ddb-9a49-0a66f7d8bd95 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:06.734594 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 438/872] 10.222.0.36 () {60 vars in 1141 bytes} [Tue Jun 14 17:38:06 2022] POST /identity/v3/services => generated 251 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 17:38:06.761862 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cb7884-35ff-4d73-94f5-1d3109d24b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:06.763066 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cb7884-35ff-4d73-94f5-1d3109d24b03 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:06.763649 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cb7884-35ff-4d73-94f5-1d3109d24b03 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:06.764170 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cb7884-35ff-4d73-94f5-1d3109d24b03 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:06.765960 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cb7884-35ff-4d73-94f5-1d3109d24b03 None admin] RBAC: Adding query filter params (role.id=1348580877d04014bfdec4d866b98a74, scope.project.id=f3e1d023a52c42b98d018617987ef83c, user.id=ba38b47a31b14526be0aa2054841881b) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:06.766592 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cb7884-35ff-4d73-94f5-1d3109d24b03 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:06.770186 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cb7884-35ff-4d73-94f5-1d3109d24b03 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:06.783010 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 435/873] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 14 17:38:06 2022] GET /identity/v3/role_assignments?user.id=ba38b47a31b14526be0aa2054841881b&scope.project.id=f3e1d023a52c42b98d018617987ef83c&role.id=1348580877d04014bfdec4d866b98a74 => generated 608 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:38:07.616535 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43177cc-07a8-4889-90a5-645a68520803 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:07.617105 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43177cc-07a8-4889-90a5-645a68520803 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:07.617533 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43177cc-07a8-4889-90a5-645a68520803 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:07.620693 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 439/874] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:38:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:38:07.630760 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e36ca27-6d45-4294-a585-804e2fae25ad None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:07.631401 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e36ca27-6d45-4294-a585-804e2fae25ad None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:07.631875 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e36ca27-6d45-4294-a585-804e2fae25ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:07.663444 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-6e36ca27-6d45-4294-a585-804e2fae25ad None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:38:07.665638 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-6e36ca27-6d45-4294-a585-804e2fae25ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:38:07.772794 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:07.811452 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 436/875] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:38:07 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 14 17:38:07.852432 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43177cc-07a8-4889-90a5-645a68520803 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:08.000658 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43177cc-07a8-4889-90a5-645a68520803 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:08.041485 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b4587e-105f-4682-9fd9-7d50399e48b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:08.042329 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b4587e-105f-4682-9fd9-7d50399e48b6 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:08.042621 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b4587e-105f-4682-9fd9-7d50399e48b6 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:08.042894 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b4587e-105f-4682-9fd9-7d50399e48b6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:08.045150 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:08.055875 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b4587e-105f-4682-9fd9-7d50399e48b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:38:08.065101 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-91b4587e-105f-4682-9fd9-7d50399e48b6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 14 17:38:08.065101 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:08.065101 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:38:08.065101 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:38:08.065101 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:38:08.065101 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:38:08.065101 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:38:08.065101 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:38:08.065101 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:38:08.065101 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:38:08.065101 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:38:08.065101 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:38:08.065101 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:38:08.065101 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:38:08.065101 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:38:08.065101 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:38:08.066060 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:38:08.066060 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:38:08.066060 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:38:08.066060 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:38:08.066060 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:38:08.066060 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:38:08.066060 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:38:08.066060 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:38:08.066060 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:38:08.066060 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:38:08.066060 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:38:08.066060 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:38:08.066060 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:38:08.066060 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:38:08.066060 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:38:08.066060 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:38:08.067031 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:38:08.067031 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:38:08.067031 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:38:08.067031 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:38:08.067031 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:38:08.067031 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:38:08.067031 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:38:08.067031 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:38:08.067031 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:38:08.067031 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:38:08.067031 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 14 17:38:08.067031 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:38:08.067031 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 440/876] 10.222.0.36 () {56 vars in 1120 bytes} [Tue Jun 14 17:38:07 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:38:08.072977 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e36ca27-6d45-4294-a585-804e2fae25ad None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:08.200291 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e36ca27-6d45-4294-a585-804e2fae25ad None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:08.244380 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a247f6d7-fc03-4006-9b83-9402261a3435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:08.245088 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a247f6d7-fc03-4006-9b83-9402261a3435 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:08.245378 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a247f6d7-fc03-4006-9b83-9402261a3435 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:08.245660 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a247f6d7-fc03-4006-9b83-9402261a3435 None admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:08.246425 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a247f6d7-fc03-4006-9b83-9402261a3435 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:08.246742 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a247f6d7-fc03-4006-9b83-9402261a3435 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:08.248273 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a247f6d7-fc03-4006-9b83-9402261a3435 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:08.258989 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 437/877] 10.222.0.36 () {56 vars in 1115 bytes} [Tue Jun 14 17:38:08 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:08.264716 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b4587e-105f-4682-9fd9-7d50399e48b6 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:08.383689 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b4587e-105f-4682-9fd9-7d50399e48b6 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:08.423727 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abc1b7a-b682-4fdb-9f5a-9380ea233fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:08.424621 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abc1b7a-b682-4fdb-9f5a-9380ea233fae None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:08.424916 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abc1b7a-b682-4fdb-9f5a-9380ea233fae None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:08.425226 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abc1b7a-b682-4fdb-9f5a-9380ea233fae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:08.437589 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abc1b7a-b682-4fdb-9f5a-9380ea233fae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:08.439333 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abc1b7a-b682-4fdb-9f5a-9380ea233fae None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:08.460196 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-0abc1b7a-b682-4fdb-9f5a-9380ea233fae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:38:08.460196 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:08.460196 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:38:08.460196 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:38:08.460196 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:38:08.460196 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:38:08.460196 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:38:08.460196 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:38:08.460196 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:38:08.460196 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:38:08.460196 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:38:08.460196 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:38:08.460196 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:38:08.460196 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:38:08.460196 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:38:08.461131 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:38:08.461131 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:38:08.461131 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:38:08.461131 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:38:08.461131 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:38:08.461131 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:38:08.461131 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:38:08.461131 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:38:08.461131 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:38:08.461131 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:38:08.461131 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:38:08.461131 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:38:08.461131 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:38:08.461131 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:38:08.461131 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:38:08.461131 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:38:08.461131 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:38:08.462066 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:38:08.462066 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:38:08.462066 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:38:08.462066 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:38:08.464474 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 441/878] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 14 17:38:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:38:08.470698 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a247f6d7-fc03-4006-9b83-9402261a3435 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:08.528232 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:08.595765 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a247f6d7-fc03-4006-9b83-9402261a3435 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:08.636020 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ac9789-3f8a-4b73-825a-7d6cf086e3a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:08.636762 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ac9789-3f8a-4b73-825a-7d6cf086e3a9 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:08.637060 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ac9789-3f8a-4b73-825a-7d6cf086e3a9 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:08.637378 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ac9789-3f8a-4b73-825a-7d6cf086e3a9 None admin] PATH_INFO: `/v3/domains` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:08.638145 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ac9789-3f8a-4b73-825a-7d6cf086e3a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:08.638461 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ac9789-3f8a-4b73-825a-7d6cf086e3a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:08.639889 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ac9789-3f8a-4b73-825a-7d6cf086e3a9 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:08.655105 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 438/879] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 14 17:38:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:08.664519 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abc1b7a-b682-4fdb-9f5a-9380ea233fae None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:08.725766 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:08.765315 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e197acf6-f165-445d-bb86-e4fd9fbb9417 None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:08.765639 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e197acf6-f165-445d-bb86-e4fd9fbb9417 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:08.766037 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e197acf6-f165-445d-bb86-e4fd9fbb9417 None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:08.768441 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 439/880] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:38:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:38:08.774054 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e063b98-0ee5-41b0-8a37-574c74651c10 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:08.774361 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e063b98-0ee5-41b0-8a37-574c74651c10 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:08.774628 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e063b98-0ee5-41b0-8a37-574c74651c10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:08.794551 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-4e063b98-0ee5-41b0-8a37-574c74651c10 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:38:08.796150 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-4e063b98-0ee5-41b0-8a37-574c74651c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:38:08.799720 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abc1b7a-b682-4fdb-9f5a-9380ea233fae None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:08.841807 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b915a02d-fb7f-49a9-911b-94d5efc0bbe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:08.842732 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b915a02d-fb7f-49a9-911b-94d5efc0bbe3 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:08.843019 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b915a02d-fb7f-49a9-911b-94d5efc0bbe3 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:08.843329 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b915a02d-fb7f-49a9-911b-94d5efc0bbe3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:08.852840 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b915a02d-fb7f-49a9-911b-94d5efc0bbe3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:08.854605 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b915a02d-fb7f-49a9-911b-94d5efc0bbe3 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:08.871657 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-b915a02d-fb7f-49a9-911b-94d5efc0bbe3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 14 17:38:08.871657 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:08.871657 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:38:08.871657 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:38:08.871657 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:38:08.871657 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:38:08.871657 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:38:08.871657 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:38:08.871657 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:38:08.871657 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:38:08.871657 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:38:08.871657 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:38:08.871657 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 14 17:38:08.871657 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 14 17:38:08.871657 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 14 17:38:08.871657 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 14 17:38:08.872672 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:38:08.872672 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:38:08.872672 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 14 17:38:08.872672 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:38:08.872672 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 14 17:38:08.872672 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:38:08.872672 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:38:08.872672 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:38:08.872672 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:38:08.872672 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:38:08.872672 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:38:08.872672 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:38:08.872672 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:38:08.872672 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:38:08.872672 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:38:08.872672 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:38:08.872672 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:38:08.872672 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:38:08.874068 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:38:08.874068 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:38:08.874068 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 14 17:38:08.874068 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 14 17:38:08.874068 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 14 17:38:08.874068 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 14 17:38:08.874068 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 14 17:38:08.874068 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 14 17:38:08.874068 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 14 17:38:08.874068 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:38:08.874068 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 442/881] 10.222.0.36 () {56 vars in 1117 bytes} [Tue Jun 14 17:38:08 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:38:08.880564 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b915a02d-fb7f-49a9-911b-94d5efc0bbe3 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:08.888511 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 440/882] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:38:08 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 14 17:38:08.922033 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e063b98-0ee5-41b0-8a37-574c74651c10 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:08.966606 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:09.015376 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b915a02d-fb7f-49a9-911b-94d5efc0bbe3 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:09.025407 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:09.059662 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ef30f3-97ca-48a9-a1f0-4930643576d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:09.061000 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ef30f3-97ca-48a9-a1f0-4930643576d2 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:09.061163 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e063b98-0ee5-41b0-8a37-574c74651c10 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:09.061469 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ef30f3-97ca-48a9-a1f0-4930643576d2 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:09.061847 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ef30f3-97ca-48a9-a1f0-4930643576d2 None admin] PATH_INFO: `/v3/users` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:09.062951 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ef30f3-97ca-48a9-a1f0-4930643576d2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:09.064062 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ef30f3-97ca-48a9-a1f0-4930643576d2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:09.066538 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ef30f3-97ca-48a9-a1f0-4930643576d2 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:09.087662 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 443/883] 10.222.0.36 () {56 vars in 1149 bytes} [Tue Jun 14 17:38:08 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:09.095345 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ef30f3-97ca-48a9-a1f0-4930643576d2 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:09.108018 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d58595-d2c2-4a82-a748-95a98c81fb50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:09.108825 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d58595-d2c2-4a82-a748-95a98c81fb50 None admin] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:09.109178 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d58595-d2c2-4a82-a748-95a98c81fb50 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:09.109523 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d58595-d2c2-4a82-a748-95a98c81fb50 None admin] PATH_INFO: `/v3/services` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:09.110598 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d58595-d2c2-4a82-a748-95a98c81fb50 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:09.112181 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d58595-d2c2-4a82-a748-95a98c81fb50 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:09.208472 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ef30f3-97ca-48a9-a1f0-4930643576d2 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:09.218566 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 441/884] 10.222.0.36 () {60 vars in 1141 bytes} [Tue Jun 14 17:38:08 2022] POST /identity/v3/services => generated 269 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 17:38:09.268617 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b50d935-7939-45e9-a708-1c3653dd5334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:09.269299 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b50d935-7939-45e9-a708-1c3653dd5334 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:09.269594 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b50d935-7939-45e9-a708-1c3653dd5334 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:09.269879 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b50d935-7939-45e9-a708-1c3653dd5334 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:09.309143 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:09.363375 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b50d935-7939-45e9-a708-1c3653dd5334 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:09.365066 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b50d935-7939-45e9-a708-1c3653dd5334 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:09.400311 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74e7795-5357-4079-acbd-dc97f753fe7e None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:09.400657 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74e7795-5357-4079-acbd-dc97f753fe7e None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:09.400944 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74e7795-5357-4079-acbd-dc97f753fe7e None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:09.406536 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 442/885] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:38:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 14 17:38:09.409236 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad5fab3-d453-446a-b221-b0d6c9d21dd6 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:09.409512 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad5fab3-d453-446a-b221-b0d6c9d21dd6 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:09.409785 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad5fab3-d453-446a-b221-b0d6c9d21dd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:09.432169 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-2ad5fab3-d453-446a-b221-b0d6c9d21dd6 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:38:09.433405 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-2ad5fab3-d453-446a-b221-b0d6c9d21dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:38:09.491716 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 444/886] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 14 17:38:09 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 14 17:38:09.493337 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b50d935-7939-45e9-a708-1c3653dd5334 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:09.527576 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 443/887] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:38:09 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 14 17:38:09.552591 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad5fab3-d453-446a-b221-b0d6c9d21dd6 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:09.571790 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:09.595869 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:09.619851 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b50d935-7939-45e9-a708-1c3653dd5334 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:09.663220 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0cff7a-e603-45d4-ae4c-b5024df5b6ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:09.664142 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0cff7a-e603-45d4-ae4c-b5024df5b6ac None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:09.664434 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0cff7a-e603-45d4-ae4c-b5024df5b6ac None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:09.664720 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0cff7a-e603-45d4-ae4c-b5024df5b6ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:09.676847 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0cff7a-e603-45d4-ae4c-b5024df5b6ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:09.678371 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0cff7a-e603-45d4-ae4c-b5024df5b6ac None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:09.699627 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad5fab3-d453-446a-b221-b0d6c9d21dd6 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:09.700180 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-6b0cff7a-e603-45d4-ae4c-b5024df5b6ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:38:09.700180 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:09.700180 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:38:09.700180 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:38:09.700180 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:38:09.700180 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:38:09.700180 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:38:09.700180 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:38:09.700180 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:38:09.700180 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:38:09.700180 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:38:09.700180 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:38:09.700180 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:38:09.700180 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:38:09.700180 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:38:09.701008 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:38:09.701008 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:38:09.701008 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:38:09.701008 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:38:09.701008 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:38:09.701008 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:38:09.701008 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:38:09.701008 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:38:09.701008 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:38:09.701008 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:38:09.701008 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:38:09.701008 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:38:09.701008 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:38:09.701008 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:38:09.701008 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:38:09.701008 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:38:09.701008 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:38:09.702370 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:38:09.702370 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:38:09.702370 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:38:09.702370 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:38:09.702370 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 445/888] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 14 17:38:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:38:09.708577 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0cff7a-e603-45d4-ae4c-b5024df5b6ac None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:09.744720 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e9bb80-3355-437a-938a-c19d1409ee48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:09.745946 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e9bb80-3355-437a-938a-c19d1409ee48 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:09.746433 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e9bb80-3355-437a-938a-c19d1409ee48 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:09.746908 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e9bb80-3355-437a-938a-c19d1409ee48 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:09.747847 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e9bb80-3355-437a-938a-c19d1409ee48 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:09.749555 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e9bb80-3355-437a-938a-c19d1409ee48 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:09.763751 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-00e9bb80-3355-437a-938a-c19d1409ee48 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 14 17:38:09.763751 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:09.763751 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 14 17:38:09.763751 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 14 17:38:09.763751 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 14 17:38:09.763751 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 14 17:38:09.763751 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 14 17:38:09.763751 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 17:38:09.763751 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 14 17:38:09.763751 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:38:09.763751 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 14 17:38:09.763751 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:38:09.763751 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:09.763751 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:38:09.763751 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:38:09.763751 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:38:09.763751 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:38:09.764792 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:38:09.764792 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:38:09.764792 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:38:09.764792 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:38:09.764792 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:38:09.764792 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:38:09.764792 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 14 17:38:09.764792 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 14 17:38:09.764792 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 14 17:38:09.764792 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 14 17:38:09.764792 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:38:09.764792 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:38:09.764792 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:38:09.764792 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:38:09.764792 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:38:09.764792 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:38:09.765675 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:38:09.765675 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:38:09.765675 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:38:09.765675 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:38:09.765675 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:38:09.765675 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:38:09.765675 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:38:09.765675 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:38:09.765675 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:38:09.765675 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:38:09.765675 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 14 17:38:09.765675 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 17:38:09.765675 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 14 17:38:09.765675 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:38:09.774129 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 444/889] 10.222.0.36 () {56 vars in 1126 bytes} [Tue Jun 14 17:38:09 2022] GET /identity/v3/services/object-store => generated 93 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 17:38:09.776698 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e9bb80-3355-437a-938a-c19d1409ee48 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:09.828612 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0cff7a-e603-45d4-ae4c-b5024df5b6ac None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:09.846096 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:09.871440 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4cbd24-30b8-4772-a1e8-52e95771c87a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:09.872131 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4cbd24-30b8-4772-a1e8-52e95771c87a None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:09.872422 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4cbd24-30b8-4772-a1e8-52e95771c87a None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:09.872707 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4cbd24-30b8-4772-a1e8-52e95771c87a None admin] PATH_INFO: `/v3/domains` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:09.873578 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4cbd24-30b8-4772-a1e8-52e95771c87a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:09.873899 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4cbd24-30b8-4772-a1e8-52e95771c87a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:09.875550 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4cbd24-30b8-4772-a1e8-52e95771c87a None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:09.899099 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 446/890] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 14 17:38:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:38:09.900232 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4cbd24-30b8-4772-a1e8-52e95771c87a None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:09.910030 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:09.924033 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e9bb80-3355-437a-938a-c19d1409ee48 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:09.979047 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58db80d-c7a4-47f6-ba68-df6ccfa5bbe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:09.980568 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58db80d-c7a4-47f6-ba68-df6ccfa5bbe6 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:09.981090 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58db80d-c7a4-47f6-ba68-df6ccfa5bbe6 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:09.981596 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58db80d-c7a4-47f6-ba68-df6ccfa5bbe6 None admin] PATH_INFO: `/v3/services` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:09.982873 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58db80d-c7a4-47f6-ba68-df6ccfa5bbe6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:09.983518 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58db80d-c7a4-47f6-ba68-df6ccfa5bbe6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:09.986943 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58db80d-c7a4-47f6-ba68-df6ccfa5bbe6 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:09.996148 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 445/891] 10.222.0.36 () {56 vars in 1122 bytes} [Tue Jun 14 17:38:09 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:38:10.004523 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58db80d-c7a4-47f6-ba68-df6ccfa5bbe6 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:10.031812 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4cbd24-30b8-4772-a1e8-52e95771c87a None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:10.071742 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdf18e6-adf5-4725-b003-8d1351a2a663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:10.072615 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdf18e6-adf5-4725-b003-8d1351a2a663 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:10.072903 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdf18e6-adf5-4725-b003-8d1351a2a663 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:10.073187 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdf18e6-adf5-4725-b003-8d1351a2a663 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:10.082246 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdf18e6-adf5-4725-b003-8d1351a2a663 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:10.083550 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdf18e6-adf5-4725-b003-8d1351a2a663 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:10.100469 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-1fdf18e6-adf5-4725-b003-8d1351a2a663 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:38:10.100469 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:10.100469 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:38:10.100469 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:38:10.100469 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:38:10.100469 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:38:10.100469 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:38:10.100469 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:38:10.100469 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:38:10.100469 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:38:10.100469 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:38:10.100469 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:38:10.100469 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 14 17:38:10.100469 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 14 17:38:10.100469 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 14 17:38:10.101435 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 14 17:38:10.101435 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:38:10.101435 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:38:10.101435 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:38:10.101435 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:38:10.101435 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:38:10.101435 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:38:10.101435 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:38:10.101435 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:38:10.101435 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:38:10.101435 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:38:10.101435 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:38:10.101435 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:38:10.101435 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:38:10.101435 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:38:10.101435 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:38:10.101435 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:38:10.102763 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 14 17:38:10.102763 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 14 17:38:10.102763 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 14 17:38:10.102763 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 14 17:38:10.102763 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 14 17:38:10.102763 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 14 17:38:10.102763 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:38:10.102763 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:38:10.102763 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 447/892] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 14 17:38:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 17:38:10.103242 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f500724-e66b-4eaf-9edb-3c56ada7a62b None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:10.103618 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f500724-e66b-4eaf-9edb-3c56ada7a62b None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:10.103727 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f500724-e66b-4eaf-9edb-3c56ada7a62b None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:10.105369 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 448/893] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:38:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:38:10.112741 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f500724-e66b-4eaf-9edb-3c56ada7a62b None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:10.142894 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58db80d-c7a4-47f6-ba68-df6ccfa5bbe6 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:10.151013 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:10.187699 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e306290-fbad-4a8a-b348-d6462bda0435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:10.188857 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e306290-fbad-4a8a-b348-d6462bda0435 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:10.189393 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e306290-fbad-4a8a-b348-d6462bda0435 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:10.189867 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e306290-fbad-4a8a-b348-d6462bda0435 None admin] PATH_INFO: `/v3/services` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:10.191034 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e306290-fbad-4a8a-b348-d6462bda0435 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:10.191632 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e306290-fbad-4a8a-b348-d6462bda0435 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:10.194103 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e306290-fbad-4a8a-b348-d6462bda0435 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:10.203134 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 446/894] 10.222.0.36 () {56 vars in 1122 bytes} [Tue Jun 14 17:38:10 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:10.205844 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cc8a19-f795-47d8-911a-f7b7cec8a668 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:10.206341 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cc8a19-f795-47d8-911a-f7b7cec8a668 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:10.207016 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cc8a19-f795-47d8-911a-f7b7cec8a668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:10.247541 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-d9cc8a19-f795-47d8-911a-f7b7cec8a668 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:38:10.248130 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f500724-e66b-4eaf-9edb-3c56ada7a62b None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:10.249783 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-d9cc8a19-f795-47d8-911a-f7b7cec8a668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:38:10.276628 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:10.319801 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152cd0b6-457e-487b-b731-1598d4ed32e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:10.320958 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152cd0b6-457e-487b-b731-1598d4ed32e2 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:10.321462 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152cd0b6-457e-487b-b731-1598d4ed32e2 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:10.321960 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152cd0b6-457e-487b-b731-1598d4ed32e2 None admin] PATH_INFO: `/v3/projects` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:10.323984 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152cd0b6-457e-487b-b731-1598d4ed32e2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:10.324667 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152cd0b6-457e-487b-b731-1598d4ed32e2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:10.330150 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152cd0b6-457e-487b-b731-1598d4ed32e2 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:10.355804 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 447/895] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:38:10 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 17:38:10.359950 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 449/896] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jun 14 17:38:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:38:10.365591 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cc8a19-f795-47d8-911a-f7b7cec8a668 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:10.375488 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152cd0b6-457e-487b-b731-1598d4ed32e2 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:10.512535 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:10.522784 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152cd0b6-457e-487b-b731-1598d4ed32e2 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:10.524005 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cc8a19-f795-47d8-911a-f7b7cec8a668 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:10.571356 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08bf387-24ec-49bd-9012-4e7f92d9bf8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:10.572104 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08bf387-24ec-49bd-9012-4e7f92d9bf8d None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:10.572400 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08bf387-24ec-49bd-9012-4e7f92d9bf8d None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:10.572689 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08bf387-24ec-49bd-9012-4e7f92d9bf8d None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:10.573362 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08bf387-24ec-49bd-9012-4e7f92d9bf8d None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:10.574934 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08bf387-24ec-49bd-9012-4e7f92d9bf8d None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:10.581801 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aa2ff6-c8cb-4875-a9b2-5d8aaad82d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:10.582818 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aa2ff6-c8cb-4875-a9b2-5d8aaad82d78 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:10.583270 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aa2ff6-c8cb-4875-a9b2-5d8aaad82d78 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:10.583727 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aa2ff6-c8cb-4875-a9b2-5d8aaad82d78 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:10.584743 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15aa2ff6-c8cb-4875-a9b2-5d8aaad82d78 None admin] RBAC: Adding query filter params (role.id=dca59aef7b5d4641b6c146c9be77d2fe, scope.project.id=f3e1d023a52c42b98d018617987ef83c, user.id=f1e32638fe5c4d2d8d3e2e4ea8250aaa) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:10.585212 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15aa2ff6-c8cb-4875-a9b2-5d8aaad82d78 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:10.586819 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15aa2ff6-c8cb-4875-a9b2-5d8aaad82d78 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:10.588194 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-e08bf387-24ec-49bd-9012-4e7f92d9bf8d None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 14 17:38:10.588194 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:10.588194 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 14 17:38:10.588194 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 14 17:38:10.588194 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 14 17:38:10.588194 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 14 17:38:10.588194 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 14 17:38:10.588194 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 17:38:10.588194 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 14 17:38:10.588194 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:38:10.588194 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 14 17:38:10.588194 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:38:10.588194 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:10.588194 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:38:10.588194 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:38:10.588194 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:38:10.588194 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:38:10.589364 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:38:10.589364 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:38:10.589364 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:38:10.589364 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:38:10.589364 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:38:10.589364 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:38:10.589364 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 14 17:38:10.589364 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 14 17:38:10.589364 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 14 17:38:10.589364 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 14 17:38:10.589364 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:38:10.589364 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:38:10.589364 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:38:10.589364 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:38:10.589364 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:38:10.589364 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:38:10.590337 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:38:10.590337 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:38:10.590337 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:38:10.590337 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:38:10.590337 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:38:10.590337 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:38:10.590337 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:38:10.590337 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:38:10.590337 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:38:10.590337 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:38:10.590337 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 14 17:38:10.590337 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 17:38:10.590337 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 14 17:38:10.590337 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:38:10.594811 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 450/897] 10.222.0.36 () {56 vars in 1114 bytes} [Tue Jun 14 17:38:10 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:38:10.596031 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08bf387-24ec-49bd-9012-4e7f92d9bf8d None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:10.597941 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 448/898] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 14 17:38:10 2022] GET /identity/v3/role_assignments?user.id=f1e32638fe5c4d2d8d3e2e4ea8250aaa&scope.project.id=f3e1d023a52c42b98d018617987ef83c&role.id=dca59aef7b5d4641b6c146c9be77d2fe => generated 259 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:10.724086 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08bf387-24ec-49bd-9012-4e7f92d9bf8d None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:10.796813 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05535b90-f570-4f35-adf0-11a2536ff792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:10.799648 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05535b90-f570-4f35-adf0-11a2536ff792 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:10.800425 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05535b90-f570-4f35-adf0-11a2536ff792 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:10.801123 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05535b90-f570-4f35-adf0-11a2536ff792 None admin] PATH_INFO: `/v3/services` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:10.802738 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05535b90-f570-4f35-adf0-11a2536ff792 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:10.803556 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05535b90-f570-4f35-adf0-11a2536ff792 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:10.806406 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05535b90-f570-4f35-adf0-11a2536ff792 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:10.818902 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 451/899] 10.222.0.36 () {56 vars in 1114 bytes} [Tue Jun 14 17:38:10 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:38:10.824480 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aa2ff6-c8cb-4875-a9b2-5d8aaad82d78 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:10.853244 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:10.977337 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aa2ff6-c8cb-4875-a9b2-5d8aaad82d78 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:11.017443 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3c080d-5f73-4b57-b2ef-df6726dfa3ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:11.018218 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3c080d-5f73-4b57-b2ef-df6726dfa3ee None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:11.018570 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3c080d-5f73-4b57-b2ef-df6726dfa3ee None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:11.018859 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3c080d-5f73-4b57-b2ef-df6726dfa3ee None admin] PATH_INFO: `/v3/services` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:11.019655 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3c080d-5f73-4b57-b2ef-df6726dfa3ee None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:11.019977 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3c080d-5f73-4b57-b2ef-df6726dfa3ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:11.021386 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3c080d-5f73-4b57-b2ef-df6726dfa3ee None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:11.027653 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 449/900] 10.222.0.36 () {56 vars in 1114 bytes} [Tue Jun 14 17:38:10 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:11.034141 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05535b90-f570-4f35-adf0-11a2536ff792 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:11.065921 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:11.214424 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05535b90-f570-4f35-adf0-11a2536ff792 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:11.260399 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7d887b-2fb2-4bac-93b8-8c64089a5c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:11.261449 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7d887b-2fb2-4bac-93b8-8c64089a5c31 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:11.261964 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7d887b-2fb2-4bac-93b8-8c64089a5c31 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:11.262452 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7d887b-2fb2-4bac-93b8-8c64089a5c31 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:11.263519 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7d887b-2fb2-4bac-93b8-8c64089a5c31 None admin] RBAC: Adding query filter params (interface=public, service_id=364e434544de4b47bb129b2355694b8d, region_id=RegionOne) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:11.264065 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7d887b-2fb2-4bac-93b8-8c64089a5c31 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:11.265684 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7d887b-2fb2-4bac-93b8-8c64089a5c31 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:11.274781 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 452/901] 10.222.0.36 () {56 vars in 1251 bytes} [Tue Jun 14 17:38:11 2022] GET /identity/v3/endpoints?service_id=364e434544de4b47bb129b2355694b8d&interface=public®ion_id=RegionOne => generated 194 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:11.280742 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3c080d-5f73-4b57-b2ef-df6726dfa3ee None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:11.371275 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:11.398186 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3c080d-5f73-4b57-b2ef-df6726dfa3ee None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:11.439158 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c63791a-c009-427d-91bc-5bd9476354c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:11.440266 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c63791a-c009-427d-91bc-5bd9476354c7 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:11.440763 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c63791a-c009-427d-91bc-5bd9476354c7 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:11.441248 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c63791a-c009-427d-91bc-5bd9476354c7 None admin] PATH_INFO: `/v3/services` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:11.442148 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c63791a-c009-427d-91bc-5bd9476354c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:11.443800 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c63791a-c009-427d-91bc-5bd9476354c7 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:11.450954 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 450/902] 10.222.0.36 () {56 vars in 1087 bytes} [Tue Jun 14 17:38:11 2022] GET /identity/v3/services => generated 1268 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 17:38:11.590303 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a5589-f099-4928-8a30-096e3cfd643e None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:11.590522 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a5589-f099-4928-8a30-096e3cfd643e None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:11.590779 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a5589-f099-4928-8a30-096e3cfd643e None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:11.592517 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 453/903] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:38:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:38:11.601282 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d90a38-4434-417e-b14e-017660a67d24 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:11.601282 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d90a38-4434-417e-b14e-017660a67d24 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:11.601282 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d90a38-4434-417e-b14e-017660a67d24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:11.633754 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-b2d90a38-4434-417e-b14e-017660a67d24 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:38:11.635360 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-b2d90a38-4434-417e-b14e-017660a67d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:38:11.783346 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 451/904] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:38:11 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 17:38:11.804001 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118a5589-f099-4928-8a30-096e3cfd643e None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:11.976945 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:12.007702 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118a5589-f099-4928-8a30-096e3cfd643e None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:12.076409 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc14538f-64b2-421c-bc34-30681b4b3e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:12.077747 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc14538f-64b2-421c-bc34-30681b4b3e69 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:12.078257 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc14538f-64b2-421c-bc34-30681b4b3e69 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:12.078869 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc14538f-64b2-421c-bc34-30681b4b3e69 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:12.080148 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc14538f-64b2-421c-bc34-30681b4b3e69 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:12.082747 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc14538f-64b2-421c-bc34-30681b4b3e69 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:12.111776 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-bc14538f-64b2-421c-bc34-30681b4b3e69 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 14 17:38:12.111776 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:12.111776 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 14 17:38:12.111776 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 14 17:38:12.111776 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 14 17:38:12.111776 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 14 17:38:12.111776 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 14 17:38:12.111776 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 17:38:12.111776 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 14 17:38:12.111776 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:38:12.111776 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 14 17:38:12.111776 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:38:12.111776 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:12.111776 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:38:12.111776 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:38:12.111776 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:38:12.112805 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:38:12.112805 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:38:12.112805 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:38:12.112805 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:38:12.112805 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:38:12.112805 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:38:12.112805 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:38:12.112805 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 14 17:38:12.112805 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 14 17:38:12.112805 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 14 17:38:12.112805 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 14 17:38:12.112805 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:38:12.112805 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:38:12.112805 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:38:12.112805 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:38:12.112805 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:38:12.113639 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:38:12.113639 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:38:12.113639 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:38:12.113639 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:38:12.113639 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:38:12.113639 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:38:12.113639 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:38:12.113639 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:38:12.113639 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:38:12.113639 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:38:12.113639 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:38:12.113639 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 14 17:38:12.113639 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 17:38:12.113639 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 14 17:38:12.113639 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:38:12.114848 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 454/905] 10.222.0.36 () {56 vars in 1132 bytes} [Tue Jun 14 17:38:11 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:38:12.123324 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d90a38-4434-417e-b14e-017660a67d24 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:12.226406 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:12.260721 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d90a38-4434-417e-b14e-017660a67d24 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:12.300303 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78882e5e-0c61-4ea4-a367-9b0cb43dafcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:12.300998 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78882e5e-0c61-4ea4-a367-9b0cb43dafcd None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:12.301287 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78882e5e-0c61-4ea4-a367-9b0cb43dafcd None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:12.301571 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78882e5e-0c61-4ea4-a367-9b0cb43dafcd None admin] PATH_INFO: `/v3/services` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:12.302296 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78882e5e-0c61-4ea4-a367-9b0cb43dafcd None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:12.302609 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78882e5e-0c61-4ea4-a367-9b0cb43dafcd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:12.304089 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78882e5e-0c61-4ea4-a367-9b0cb43dafcd None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:12.309842 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 452/906] 10.222.0.36 () {56 vars in 1126 bytes} [Tue Jun 14 17:38:12 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:12.319628 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc14538f-64b2-421c-bc34-30681b4b3e69 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:12.511017 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc14538f-64b2-421c-bc34-30681b4b3e69 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:12.583338 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f6344b-4cd4-4d8b-82eb-fa40d0afbfb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:12.584486 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f6344b-4cd4-4d8b-82eb-fa40d0afbfb8 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:12.584968 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f6344b-4cd4-4d8b-82eb-fa40d0afbfb8 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:12.585473 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f6344b-4cd4-4d8b-82eb-fa40d0afbfb8 None admin] PATH_INFO: `/v3/services` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:12.586913 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f6344b-4cd4-4d8b-82eb-fa40d0afbfb8 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:12.587471 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f6344b-4cd4-4d8b-82eb-fa40d0afbfb8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:12.590194 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f6344b-4cd4-4d8b-82eb-fa40d0afbfb8 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:12.601537 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 455/907] 10.222.0.36 () {56 vars in 1126 bytes} [Tue Jun 14 17:38:12 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:12.610990 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78882e5e-0c61-4ea4-a367-9b0cb43dafcd None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:12.767896 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78882e5e-0c61-4ea4-a367-9b0cb43dafcd None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:12.808466 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c165cc22-078c-49f8-a7fc-b1fb1f2d2558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:12.809162 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c165cc22-078c-49f8-a7fc-b1fb1f2d2558 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:12.809453 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c165cc22-078c-49f8-a7fc-b1fb1f2d2558 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:12.809735 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c165cc22-078c-49f8-a7fc-b1fb1f2d2558 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:12.810555 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c165cc22-078c-49f8-a7fc-b1fb1f2d2558 None admin] RBAC: Adding query filter params (interface=public, service_id=ac520f6f2ada4c3f9e408214db76484f, region_id=RegionOne) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:12.810873 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c165cc22-078c-49f8-a7fc-b1fb1f2d2558 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:12.812326 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c165cc22-078c-49f8-a7fc-b1fb1f2d2558 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:12.814945 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:12.819720 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 453/908] 10.222.0.36 () {56 vars in 1251 bytes} [Tue Jun 14 17:38:12 2022] GET /identity/v3/endpoints?service_id=ac520f6f2ada4c3f9e408214db76484f&interface=public®ion_id=RegionOne => generated 194 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:12.830187 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f6344b-4cd4-4d8b-82eb-fa40d0afbfb8 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:12.860577 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:13.053636 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f6344b-4cd4-4d8b-82eb-fa40d0afbfb8 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:13.128035 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e273c96-f68a-48f6-9914-9b3654127f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:13.129502 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e273c96-f68a-48f6-9914-9b3654127f4a None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:13.130024 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e273c96-f68a-48f6-9914-9b3654127f4a None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:13.130542 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e273c96-f68a-48f6-9914-9b3654127f4a None admin] PATH_INFO: `/v3/services` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:13.132079 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e273c96-f68a-48f6-9914-9b3654127f4a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:13.132939 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0798913f-385d-4cc6-8db6-e69811673716 None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:13.133393 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0798913f-385d-4cc6-8db6-e69811673716 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:13.133570 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0798913f-385d-4cc6-8db6-e69811673716 None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:13.134851 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e273c96-f68a-48f6-9914-9b3654127f4a None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:13.139271 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 454/909] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:38:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:38:13.141793 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d654b4-f2b5-4dff-af48-acea39a438c3 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:13.142173 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d654b4-f2b5-4dff-af48-acea39a438c3 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:13.142483 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d654b4-f2b5-4dff-af48-acea39a438c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:13.147956 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 456/910] 10.222.0.36 () {56 vars in 1087 bytes} [Tue Jun 14 17:38:12 2022] GET /identity/v3/services => generated 1268 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 17:38:13.162105 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-82d654b4-f2b5-4dff-af48-acea39a438c3 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:38:13.163416 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-82d654b4-f2b5-4dff-af48-acea39a438c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:38:13.247904 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 455/911] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:38:13 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 14 17:38:13.253238 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58727753-d180-4ca5-a395-9d915e010b2e None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:13.253238 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58727753-d180-4ca5-a395-9d915e010b2e None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:13.253238 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58727753-d180-4ca5-a395-9d915e010b2e None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:13.259441 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 457/912] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:38:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:38:13.264376 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927a54d2-c211-4a63-87e1-826290b2cd1c None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:13.265229 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927a54d2-c211-4a63-87e1-826290b2cd1c None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:13.265902 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927a54d2-c211-4a63-87e1-826290b2cd1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:13.278267 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58727753-d180-4ca5-a395-9d915e010b2e None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:13.300564 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-927a54d2-c211-4a63-87e1-826290b2cd1c None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:38:13.302799 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-927a54d2-c211-4a63-87e1-826290b2cd1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:38:13.450604 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:13.472855 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 456/913] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:38:13 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 17:38:13.500474 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927a54d2-c211-4a63-87e1-826290b2cd1c None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:13.511449 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58727753-d180-4ca5-a395-9d915e010b2e None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:13.575924 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:13.585405 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67d4764-e4bc-4f48-ab41-086fa21bbf92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:13.591002 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67d4764-e4bc-4f48-ab41-086fa21bbf92 None admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:13.591002 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67d4764-e4bc-4f48-ab41-086fa21bbf92 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:13.591002 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67d4764-e4bc-4f48-ab41-086fa21bbf92 None admin] PATH_INFO: `/v3/services` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:13.591002 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67d4764-e4bc-4f48-ab41-086fa21bbf92 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:13.591788 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67d4764-e4bc-4f48-ab41-086fa21bbf92 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:13.643008 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927a54d2-c211-4a63-87e1-826290b2cd1c None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:13.677458 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 458/914] 10.222.0.36 () {60 vars in 1141 bytes} [Tue Jun 14 17:38:13 2022] POST /identity/v3/services => generated 241 bytes in 399 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:38:13.748119 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70709f2-7784-459b-96dc-2728d8eeb42a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:13.749526 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70709f2-7784-459b-96dc-2728d8eeb42a None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:13.750045 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70709f2-7784-459b-96dc-2728d8eeb42a None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:13.750751 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70709f2-7784-459b-96dc-2728d8eeb42a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:13.773431 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70709f2-7784-459b-96dc-2728d8eeb42a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:38:13.790704 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-e70709f2-7784-459b-96dc-2728d8eeb42a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 14 17:38:13.790704 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:13.790704 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:38:13.790704 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:38:13.790704 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:38:13.790704 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:38:13.790704 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:38:13.790704 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:38:13.790704 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:38:13.790704 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:38:13.790704 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:38:13.790704 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:38:13.790704 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:38:13.790704 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:38:13.790704 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:38:13.790704 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:38:13.794028 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:38:13.794028 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:38:13.794028 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:38:13.794028 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:38:13.794028 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:38:13.794028 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:38:13.794028 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:38:13.794028 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:38:13.794028 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:38:13.794028 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:38:13.794028 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:38:13.794028 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:38:13.794028 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:38:13.794028 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:38:13.794028 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:38:13.794028 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:38:13.796136 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:38:13.796136 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:38:13.796136 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:38:13.796136 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:38:13.796136 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:38:13.796136 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:38:13.796136 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:38:13.796136 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:38:13.796136 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:38:13.796136 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:38:13.796136 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 14 17:38:13.796136 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:38:13.796136 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 457/915] 10.222.0.36 () {56 vars in 1120 bytes} [Tue Jun 14 17:38:13 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 17:38:13.809334 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67d4764-e4bc-4f48-ab41-086fa21bbf92 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:13.966174 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67d4764-e4bc-4f48-ab41-086fa21bbf92 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:14.006401 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1748757c-f833-4abb-becd-b7ea8302247f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:14.007007 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1748757c-f833-4abb-becd-b7ea8302247f None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:14.007287 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1748757c-f833-4abb-becd-b7ea8302247f None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:14.007620 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1748757c-f833-4abb-becd-b7ea8302247f None admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:14.008384 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1748757c-f833-4abb-becd-b7ea8302247f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:14.008701 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1748757c-f833-4abb-becd-b7ea8302247f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:14.010102 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1748757c-f833-4abb-becd-b7ea8302247f None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:14.013104 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:14.021279 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 459/916] 10.222.0.36 () {56 vars in 1115 bytes} [Tue Jun 14 17:38:13 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:14.028057 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70709f2-7784-459b-96dc-2728d8eeb42a None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:14.117446 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85488311-84f5-4703-b4dc-4bb1d43f622a None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:14.118125 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85488311-84f5-4703-b4dc-4bb1d43f622a None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:14.118604 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85488311-84f5-4703-b4dc-4bb1d43f622a None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:14.120596 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 460/917] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:38:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:38:14.130247 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1c11e5-8a03-428c-a484-9fe82b279870 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:14.130992 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1c11e5-8a03-428c-a484-9fe82b279870 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:14.131531 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1c11e5-8a03-428c-a484-9fe82b279870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:14.152710 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-2c1c11e5-8a03-428c-a484-9fe82b279870 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:38:14.155589 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-2c1c11e5-8a03-428c-a484-9fe82b279870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:38:14.194319 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70709f2-7784-459b-96dc-2728d8eeb42a None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:14.212781 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:14.239073 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e075d07f-4114-42e2-91a8-a370da5b7caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:14.240288 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e075d07f-4114-42e2-91a8-a370da5b7caa None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:14.240777 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e075d07f-4114-42e2-91a8-a370da5b7caa None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:14.241250 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e075d07f-4114-42e2-91a8-a370da5b7caa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:14.254640 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e075d07f-4114-42e2-91a8-a370da5b7caa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:14.256655 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e075d07f-4114-42e2-91a8-a370da5b7caa None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:14.277791 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-e075d07f-4114-42e2-91a8-a370da5b7caa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:38:14.277791 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:14.277791 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:38:14.277791 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:38:14.277791 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:38:14.277791 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:38:14.277791 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:38:14.277791 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:38:14.277791 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:38:14.277791 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:38:14.277791 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:38:14.277791 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:38:14.277791 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:38:14.277791 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:38:14.277791 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:38:14.278726 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:38:14.278726 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:38:14.278726 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:38:14.278726 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:38:14.278726 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:38:14.278726 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:38:14.278726 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:38:14.278726 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:38:14.278726 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:38:14.278726 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:38:14.278726 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:38:14.278726 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:38:14.278726 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:38:14.278726 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:38:14.278726 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:38:14.278726 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:38:14.278726 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:38:14.279659 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:38:14.279659 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:38:14.279659 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:38:14.279659 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:38:14.287186 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 458/918] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 14 17:38:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:38:14.288514 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e075d07f-4114-42e2-91a8-a370da5b7caa None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:14.292339 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 461/919] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:38:14 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 17:38:14.340685 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1c11e5-8a03-428c-a484-9fe82b279870 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:14.448103 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e075d07f-4114-42e2-91a8-a370da5b7caa None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:14.515576 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223442de-d9e4-4e2b-b7c4-d044bfd2903e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:14.517709 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223442de-d9e4-4e2b-b7c4-d044bfd2903e None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:14.518491 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223442de-d9e4-4e2b-b7c4-d044bfd2903e None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:14.519224 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223442de-d9e4-4e2b-b7c4-d044bfd2903e None admin] PATH_INFO: `/v3/domains` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:14.520835 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223442de-d9e4-4e2b-b7c4-d044bfd2903e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:14.521770 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223442de-d9e4-4e2b-b7c4-d044bfd2903e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:14.524595 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223442de-d9e4-4e2b-b7c4-d044bfd2903e None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:14.545608 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1c11e5-8a03-428c-a484-9fe82b279870 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:14.555711 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 459/920] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 14 17:38:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:14.559658 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223442de-d9e4-4e2b-b7c4-d044bfd2903e None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:14.601532 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:14.616758 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:14.629252 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42942afa-75df-4915-8697-58de24354221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:14.629252 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42942afa-75df-4915-8697-58de24354221 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:14.629252 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42942afa-75df-4915-8697-58de24354221 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:14.629252 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42942afa-75df-4915-8697-58de24354221 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:14.629804 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42942afa-75df-4915-8697-58de24354221 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:14.629804 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42942afa-75df-4915-8697-58de24354221 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:14.649498 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-42942afa-75df-4915-8697-58de24354221 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 14 17:38:14.649498 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:14.649498 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 14 17:38:14.649498 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 14 17:38:14.649498 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 14 17:38:14.649498 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 14 17:38:14.649498 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 14 17:38:14.649498 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 17:38:14.649498 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 14 17:38:14.649498 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:38:14.649498 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 14 17:38:14.649498 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:38:14.649498 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:14.649498 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:38:14.649498 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:38:14.649498 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:38:14.649498 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:38:14.651767 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:38:14.651767 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:38:14.651767 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:38:14.651767 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:38:14.651767 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:38:14.651767 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:38:14.651767 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 14 17:38:14.651767 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 14 17:38:14.651767 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 14 17:38:14.651767 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 14 17:38:14.651767 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:38:14.651767 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:38:14.651767 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:38:14.651767 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:38:14.651767 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:38:14.651767 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:38:14.653314 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:38:14.653314 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:38:14.653314 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:38:14.653314 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:38:14.653314 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:38:14.653314 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:38:14.653314 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:38:14.653314 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:38:14.653314 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:38:14.653314 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:38:14.653314 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 14 17:38:14.653314 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 17:38:14.653314 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 14 17:38:14.653314 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:38:14.655772 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 462/921] 10.222.0.36 () {56 vars in 1114 bytes} [Tue Jun 14 17:38:14 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:38:14.662162 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42942afa-75df-4915-8697-58de24354221 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:14.729213 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223442de-d9e4-4e2b-b7c4-d044bfd2903e None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:14.778580 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ca47a0-1161-449a-8002-f3dbb4c077d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:14.779872 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ca47a0-1161-449a-8002-f3dbb4c077d3 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:14.780409 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ca47a0-1161-449a-8002-f3dbb4c077d3 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:14.780972 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ca47a0-1161-449a-8002-f3dbb4c077d3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:14.795097 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ca47a0-1161-449a-8002-f3dbb4c077d3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:14.797066 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ca47a0-1161-449a-8002-f3dbb4c077d3 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:14.816339 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-41ca47a0-1161-449a-8002-f3dbb4c077d3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 14 17:38:14.816339 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:14.816339 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:38:14.816339 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:38:14.816339 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:38:14.816339 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:38:14.816339 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:38:14.816339 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:38:14.816339 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:38:14.816339 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:38:14.816339 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:38:14.816339 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:38:14.816339 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 14 17:38:14.816339 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 14 17:38:14.816339 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 14 17:38:14.816339 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 14 17:38:14.817388 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:38:14.817388 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:38:14.817388 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 14 17:38:14.817388 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:38:14.817388 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 14 17:38:14.817388 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:38:14.817388 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:38:14.817388 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:38:14.817388 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:38:14.817388 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:38:14.817388 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:38:14.817388 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:38:14.817388 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:38:14.817388 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:38:14.817388 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:38:14.817388 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:38:14.817388 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:38:14.817388 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:38:14.818332 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:38:14.818332 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:38:14.818332 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 14 17:38:14.818332 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 14 17:38:14.818332 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 14 17:38:14.818332 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 14 17:38:14.818332 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 14 17:38:14.818332 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 14 17:38:14.818332 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 14 17:38:14.818332 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:38:14.825697 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 460/922] 10.222.0.36 () {56 vars in 1117 bytes} [Tue Jun 14 17:38:14 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 17:38:14.826948 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ca47a0-1161-449a-8002-f3dbb4c077d3 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:14.876818 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42942afa-75df-4915-8697-58de24354221 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:14.933293 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:14.950872 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ca47a0-1161-449a-8002-f3dbb4c077d3 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:14.951105 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6100ff-9209-4ae4-a03a-031718709efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:14.952223 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6100ff-9209-4ae4-a03a-031718709efe None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:14.952739 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6100ff-9209-4ae4-a03a-031718709efe None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:14.953244 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6100ff-9209-4ae4-a03a-031718709efe None admin] PATH_INFO: `/v3/services` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:14.954697 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6100ff-9209-4ae4-a03a-031718709efe None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:14.955939 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6100ff-9209-4ae4-a03a-031718709efe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:14.957947 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6100ff-9209-4ae4-a03a-031718709efe None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:14.975852 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 463/923] 10.222.0.36 () {56 vars in 1114 bytes} [Tue Jun 14 17:38:14 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:14.980418 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6100ff-9209-4ae4-a03a-031718709efe None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:14.995798 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1d72c4-f6e9-4b3b-9f48-8a21c11d993e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:14.996877 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1d72c4-f6e9-4b3b-9f48-8a21c11d993e None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:14.997372 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1d72c4-f6e9-4b3b-9f48-8a21c11d993e None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:14.997856 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1d72c4-f6e9-4b3b-9f48-8a21c11d993e None admin] PATH_INFO: `/v3/users` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:14.999093 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1d72c4-f6e9-4b3b-9f48-8a21c11d993e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:14.999666 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1d72c4-f6e9-4b3b-9f48-8a21c11d993e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:15.001699 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1d72c4-f6e9-4b3b-9f48-8a21c11d993e None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:15.023276 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 461/924] 10.222.0.36 () {56 vars in 1149 bytes} [Tue Jun 14 17:38:14 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:15.028737 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1d72c4-f6e9-4b3b-9f48-8a21c11d993e None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:15.098733 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:15.153166 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1d72c4-f6e9-4b3b-9f48-8a21c11d993e None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:15.196208 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6100ff-9209-4ae4-a03a-031718709efe None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:15.201564 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a744fe-33b6-40a4-ab45-4bf8141ddc01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:15.202533 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a744fe-33b6-40a4-ab45-4bf8141ddc01 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:15.202691 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a744fe-33b6-40a4-ab45-4bf8141ddc01 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:15.202986 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a744fe-33b6-40a4-ab45-4bf8141ddc01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:15.215945 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a744fe-33b6-40a4-ab45-4bf8141ddc01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:15.217720 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a744fe-33b6-40a4-ab45-4bf8141ddc01 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:15.221875 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:15.239815 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-12a744fe-33b6-40a4-ab45-4bf8141ddc01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:38:15.239815 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:15.239815 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:38:15.239815 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:38:15.239815 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:38:15.239815 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:38:15.239815 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:38:15.239815 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:38:15.239815 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:38:15.239815 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:38:15.239815 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:38:15.239815 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:38:15.239815 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:38:15.239815 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:38:15.239815 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:38:15.244159 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:38:15.244159 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:38:15.244159 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:38:15.244159 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:38:15.244159 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:38:15.244159 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:38:15.244159 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:38:15.244159 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:38:15.244159 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:38:15.244159 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:38:15.244159 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:38:15.244159 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:38:15.244159 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:38:15.244159 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:38:15.244159 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:38:15.244159 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:38:15.244159 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:38:15.246530 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:38:15.246530 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:38:15.246530 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:38:15.246530 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:38:15.246530 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 462/925] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 14 17:38:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:38:15.247484 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a744fe-33b6-40a4-ab45-4bf8141ddc01 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:15.282598 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326150f2-2f53-40ed-8272-627edfee15f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:15.284335 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326150f2-2f53-40ed-8272-627edfee15f6 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:15.285267 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326150f2-2f53-40ed-8272-627edfee15f6 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:15.285824 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326150f2-2f53-40ed-8272-627edfee15f6 None admin] PATH_INFO: `/v3/services` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:15.287468 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326150f2-2f53-40ed-8272-627edfee15f6 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:15.288416 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326150f2-2f53-40ed-8272-627edfee15f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:15.291504 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326150f2-2f53-40ed-8272-627edfee15f6 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:15.307684 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 464/926] 10.222.0.36 () {56 vars in 1114 bytes} [Tue Jun 14 17:38:14 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:38:15.312516 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326150f2-2f53-40ed-8272-627edfee15f6 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:15.366231 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a744fe-33b6-40a4-ab45-4bf8141ddc01 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:15.407977 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfab73f7-7b92-4a40-a2c7-a309daeaebfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:15.409091 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfab73f7-7b92-4a40-a2c7-a309daeaebfe None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:15.409274 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfab73f7-7b92-4a40-a2c7-a309daeaebfe None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:15.409408 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfab73f7-7b92-4a40-a2c7-a309daeaebfe None admin] PATH_INFO: `/v3/domains` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:15.410236 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfab73f7-7b92-4a40-a2c7-a309daeaebfe None admin] RBAC: Adding query filter params (name=Default) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:15.410666 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfab73f7-7b92-4a40-a2c7-a309daeaebfe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:15.412234 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfab73f7-7b92-4a40-a2c7-a309daeaebfe None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:15.426536 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 463/927] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 14 17:38:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:15.432463 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfab73f7-7b92-4a40-a2c7-a309daeaebfe None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:15.486698 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326150f2-2f53-40ed-8272-627edfee15f6 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:15.527496 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:15.535372 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:15.546781 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bec477-19e2-4b6d-ad88-8fe99e19f200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:15.556906 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bec477-19e2-4b6d-ad88-8fe99e19f200 None admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:15.556906 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bec477-19e2-4b6d-ad88-8fe99e19f200 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:15.556906 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bec477-19e2-4b6d-ad88-8fe99e19f200 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:15.556906 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bec477-19e2-4b6d-ad88-8fe99e19f200 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:15.556906 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bec477-19e2-4b6d-ad88-8fe99e19f200 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:15.586012 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfab73f7-7b92-4a40-a2c7-a309daeaebfe None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:15.628051 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999526aa-14be-406d-b810-e49c5b133a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:15.629876 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999526aa-14be-406d-b810-e49c5b133a53 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:15.631772 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999526aa-14be-406d-b810-e49c5b133a53 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:15.632871 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999526aa-14be-406d-b810-e49c5b133a53 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:15.642505 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999526aa-14be-406d-b810-e49c5b133a53 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:15.644440 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999526aa-14be-406d-b810-e49c5b133a53 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:15.656548 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 465/928] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Jun 14 17:38:15 2022] POST /identity/v3/endpoints => generated 346 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 17:38:15.667069 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-999526aa-14be-406d-b810-e49c5b133a53 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:38:15.667069 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:15.667069 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:38:15.667069 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:38:15.667069 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:38:15.667069 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:38:15.667069 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:38:15.667069 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:38:15.667069 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:38:15.667069 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:38:15.667069 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:38:15.667069 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:38:15.667069 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 14 17:38:15.667069 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 14 17:38:15.667069 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 14 17:38:15.668949 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 14 17:38:15.668949 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:38:15.668949 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:38:15.668949 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:38:15.668949 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:38:15.668949 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:38:15.668949 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:38:15.668949 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:38:15.668949 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:38:15.668949 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:38:15.668949 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:38:15.668949 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:38:15.668949 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:38:15.668949 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:38:15.668949 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:38:15.668949 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:38:15.668949 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:38:15.671605 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 14 17:38:15.671605 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 14 17:38:15.671605 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 14 17:38:15.671605 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 14 17:38:15.671605 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 14 17:38:15.671605 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 14 17:38:15.671605 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:38:15.671605 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:38:15.671605 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 464/929] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 14 17:38:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:38:15.677516 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bec477-19e2-4b6d-ad88-8fe99e19f200 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:15.827508 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d5ab8c-61f7-45e8-9758-fa0bdd9ce63a None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:15.827857 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d5ab8c-61f7-45e8-9758-fa0bdd9ce63a None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:15.828101 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d5ab8c-61f7-45e8-9758-fa0bdd9ce63a None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:15.829971 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 465/930] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:38:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:38:15.835758 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261dbab7-2480-4a6d-be78-4e2d4d9c9145 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:15.836087 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261dbab7-2480-4a6d-be78-4e2d4d9c9145 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:15.836331 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261dbab7-2480-4a6d-be78-4e2d4d9c9145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:15.859982 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bec477-19e2-4b6d-ad88-8fe99e19f200 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:15.866327 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-261dbab7-2480-4a6d-be78-4e2d4d9c9145 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:38:15.867631 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-261dbab7-2480-4a6d-be78-4e2d4d9c9145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:38:15.920083 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95a6bb3-ecb2-484b-8d80-f8211ace40f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:15.920778 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95a6bb3-ecb2-484b-8d80-f8211ace40f5 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:15.921063 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95a6bb3-ecb2-484b-8d80-f8211ace40f5 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:15.921338 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95a6bb3-ecb2-484b-8d80-f8211ace40f5 None admin] PATH_INFO: `/v3/projects` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:15.922144 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95a6bb3-ecb2-484b-8d80-f8211ace40f5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:15.923443 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95a6bb3-ecb2-484b-8d80-f8211ace40f5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:15.925278 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95a6bb3-ecb2-484b-8d80-f8211ace40f5 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:15.943131 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 466/931] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jun 14 17:38:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:15.948239 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95a6bb3-ecb2-484b-8d80-f8211ace40f5 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:15.978112 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 466/932] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:38:15 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 14 17:38:15.999930 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:16.017190 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261dbab7-2480-4a6d-be78-4e2d4d9c9145 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:16.076736 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:16.129439 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95a6bb3-ecb2-484b-8d80-f8211ace40f5 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:16.140890 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261dbab7-2480-4a6d-be78-4e2d4d9c9145 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:16.182060 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e117a1-6a50-4e05-bdee-46c3b2cbd07f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:16.183002 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e117a1-6a50-4e05-bdee-46c3b2cbd07f None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:16.183288 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e117a1-6a50-4e05-bdee-46c3b2cbd07f None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:16.183600 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e117a1-6a50-4e05-bdee-46c3b2cbd07f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:16.184271 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e117a1-6a50-4e05-bdee-46c3b2cbd07f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:16.185736 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e117a1-6a50-4e05-bdee-46c3b2cbd07f None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:16.189207 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c135c9-5fbc-4e54-b0e4-22d95b9ca2e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:16.190331 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c135c9-5fbc-4e54-b0e4-22d95b9ca2e6 None admin] REQUEST_METHOD: `PUT` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:16.190691 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c135c9-5fbc-4e54-b0e4-22d95b9ca2e6 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:16.190972 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c135c9-5fbc-4e54-b0e4-22d95b9ca2e6 None admin] PATH_INFO: `/v3/projects/f3e1d023a52c42b98d018617987ef83c/users/f1e32638fe5c4d2d8d3e2e4ea8250aaa/roles/dca59aef7b5d4641b6c146c9be77d2fe` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:16.193750 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c135c9-5fbc-4e54-b0e4-22d95b9ca2e6 None admin] RBAC: Authorizing `identity:create_grant(project_id=f3e1d023a52c42b98d018617987ef83c, user_id=f1e32638fe5c4d2d8d3e2e4ea8250aaa, role_id=dca59aef7b5d4641b6c146c9be77d2fe)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:16.195378 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c135c9-5fbc-4e54-b0e4-22d95b9ca2e6 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:16.199615 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-b0e117a1-6a50-4e05-bdee-46c3b2cbd07f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 14 17:38:16.199615 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:16.199615 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 14 17:38:16.199615 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 14 17:38:16.199615 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 14 17:38:16.199615 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 14 17:38:16.199615 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 14 17:38:16.199615 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 17:38:16.199615 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 14 17:38:16.199615 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:38:16.199615 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 14 17:38:16.199615 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:38:16.199615 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:16.199615 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:38:16.199615 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:38:16.199615 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:38:16.201707 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:38:16.201707 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:38:16.201707 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:38:16.201707 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:38:16.201707 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:38:16.201707 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:38:16.201707 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:38:16.201707 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 14 17:38:16.201707 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 14 17:38:16.201707 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 14 17:38:16.201707 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 14 17:38:16.201707 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:38:16.201707 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:38:16.201707 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:38:16.201707 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:38:16.201707 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:38:16.205825 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:38:16.205825 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:38:16.205825 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:38:16.205825 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:38:16.205825 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:38:16.205825 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:38:16.205825 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:38:16.205825 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:38:16.205825 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:38:16.205825 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:38:16.205825 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:38:16.205825 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 14 17:38:16.205825 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 17:38:16.205825 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 14 17:38:16.205825 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:38:16.205825 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 467/933] 10.222.0.36 () {56 vars in 1132 bytes} [Tue Jun 14 17:38:16 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 17:38:16.209814 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e117a1-6a50-4e05-bdee-46c3b2cbd07f None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:16.280196 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 467/934] 10.222.0.36 () {58 vars in 1439 bytes} [Tue Jun 14 17:38:15 2022] PUT /identity/v3/projects/f3e1d023a52c42b98d018617987ef83c/users/f1e32638fe5c4d2d8d3e2e4ea8250aaa/roles/dca59aef7b5d4641b6c146c9be77d2fe => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:38:16.418741 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e117a1-6a50-4e05-bdee-46c3b2cbd07f None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:16.440630 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:16.489615 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da27facd-d996-4ef9-87ce-cfdb4fc77870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:16.490699 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da27facd-d996-4ef9-87ce-cfdb4fc77870 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:16.491153 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da27facd-d996-4ef9-87ce-cfdb4fc77870 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:16.491689 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da27facd-d996-4ef9-87ce-cfdb4fc77870 None admin] PATH_INFO: `/v3/services` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:16.493040 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da27facd-d996-4ef9-87ce-cfdb4fc77870 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:16.493582 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da27facd-d996-4ef9-87ce-cfdb4fc77870 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:16.496158 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da27facd-d996-4ef9-87ce-cfdb4fc77870 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:16.507659 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 468/935] 10.222.0.36 () {56 vars in 1126 bytes} [Tue Jun 14 17:38:16 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:16.513324 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c135c9-5fbc-4e54-b0e4-22d95b9ca2e6 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:16.682464 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:16.699854 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c135c9-5fbc-4e54-b0e4-22d95b9ca2e6 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:16.757138 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb23de15-bae0-438e-9c7d-3db1f06b7902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:16.758050 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb23de15-bae0-438e-9c7d-3db1f06b7902 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:16.758350 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb23de15-bae0-438e-9c7d-3db1f06b7902 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:16.758698 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb23de15-bae0-438e-9c7d-3db1f06b7902 None admin] PATH_INFO: `/v3/services` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:16.759974 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb23de15-bae0-438e-9c7d-3db1f06b7902 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:16.760476 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb23de15-bae0-438e-9c7d-3db1f06b7902 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:16.762086 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb23de15-bae0-438e-9c7d-3db1f06b7902 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:16.770738 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 468/936] 10.222.0.36 () {56 vars in 1126 bytes} [Tue Jun 14 17:38:16 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:16.778080 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da27facd-d996-4ef9-87ce-cfdb4fc77870 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:16.786986 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3166c4d1-60ef-4791-bad3-3df5c9554647 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:16.787543 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3166c4d1-60ef-4791-bad3-3df5c9554647 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:16.788057 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3166c4d1-60ef-4791-bad3-3df5c9554647 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:16.790820 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 469/937] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:38:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:38:16.797543 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19de039a-f24d-4b2b-8952-6b0735ae2224 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:16.797914 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19de039a-f24d-4b2b-8952-6b0735ae2224 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:16.798185 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19de039a-f24d-4b2b-8952-6b0735ae2224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:16.834812 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-19de039a-f24d-4b2b-8952-6b0735ae2224 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:38:16.836488 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-19de039a-f24d-4b2b-8952-6b0735ae2224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:38:16.927462 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 470/938] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:38:16 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 14 17:38:16.958321 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da27facd-d996-4ef9-87ce-cfdb4fc77870 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:16.967680 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19de039a-f24d-4b2b-8952-6b0735ae2224 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:17.004677 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9c0d06-dcb4-4eb6-a0c8-046aca853053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:17.006139 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9c0d06-dcb4-4eb6-a0c8-046aca853053 None admin] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:17.006695 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9c0d06-dcb4-4eb6-a0c8-046aca853053 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:17.007195 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9c0d06-dcb4-4eb6-a0c8-046aca853053 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:17.008470 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9c0d06-dcb4-4eb6-a0c8-046aca853053 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:17.010662 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9c0d06-dcb4-4eb6-a0c8-046aca853053 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:17.105511 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 469/939] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Jun 14 17:38:16 2022] POST /identity/v3/endpoints => generated 347 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 17:38:17.135811 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:17.166700 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19de039a-f24d-4b2b-8952-6b0735ae2224 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:17.233214 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d96aa15-9087-46bf-9fa5-f8c24fae71d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:17.233979 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d96aa15-9087-46bf-9fa5-f8c24fae71d1 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:17.234272 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d96aa15-9087-46bf-9fa5-f8c24fae71d1 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:17.234558 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d96aa15-9087-46bf-9fa5-f8c24fae71d1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:17.236313 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d96aa15-9087-46bf-9fa5-f8c24fae71d1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:17.237868 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d96aa15-9087-46bf-9fa5-f8c24fae71d1 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:17.252279 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-4d96aa15-9087-46bf-9fa5-f8c24fae71d1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 14 17:38:17.252279 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:17.252279 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 14 17:38:17.252279 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 14 17:38:17.252279 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 14 17:38:17.252279 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 14 17:38:17.252279 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 14 17:38:17.252279 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 17:38:17.252279 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 14 17:38:17.252279 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:38:17.252279 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 14 17:38:17.252279 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:38:17.252279 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:17.252279 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:38:17.252279 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:38:17.252279 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:38:17.252279 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:38:17.253355 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:38:17.253355 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:38:17.253355 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:38:17.253355 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:38:17.253355 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:38:17.253355 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:38:17.253355 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 14 17:38:17.253355 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 14 17:38:17.253355 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 14 17:38:17.253355 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 14 17:38:17.253355 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:38:17.253355 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:38:17.253355 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:38:17.253355 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:38:17.253355 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:38:17.253355 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:38:17.254474 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:38:17.254474 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:38:17.254474 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:38:17.254474 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:38:17.254474 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:38:17.254474 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:38:17.254474 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:38:17.254474 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:38:17.254474 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:38:17.254474 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:38:17.254474 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 14 17:38:17.254474 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 17:38:17.254474 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 14 17:38:17.254474 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:38:17.254474 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 471/940] 10.222.0.36 () {56 vars in 1126 bytes} [Tue Jun 14 17:38:16 2022] GET /identity/v3/services/object-store => generated 93 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:38:17.260675 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9c0d06-dcb4-4eb6-a0c8-046aca853053 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:17.303938 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:17.395333 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9c0d06-dcb4-4eb6-a0c8-046aca853053 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:17.436335 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33fae8d-3793-4dcb-ae90-a61881962e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:17.437023 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33fae8d-3793-4dcb-ae90-a61881962e8b None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:17.437312 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33fae8d-3793-4dcb-ae90-a61881962e8b None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:17.437670 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33fae8d-3793-4dcb-ae90-a61881962e8b None admin] PATH_INFO: `/v3/services` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:17.438866 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33fae8d-3793-4dcb-ae90-a61881962e8b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:17.439144 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33fae8d-3793-4dcb-ae90-a61881962e8b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:17.440670 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33fae8d-3793-4dcb-ae90-a61881962e8b None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:17.446700 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 470/941] 10.222.0.36 () {56 vars in 1122 bytes} [Tue Jun 14 17:38:17 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:17.452471 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d96aa15-9087-46bf-9fa5-f8c24fae71d1 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:17.624587 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d96aa15-9087-46bf-9fa5-f8c24fae71d1 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:17.688927 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0845a6e1-3f49-45ca-8118-7c81c7bbc3b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:17.690277 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0845a6e1-3f49-45ca-8118-7c81c7bbc3b4 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:17.690795 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0845a6e1-3f49-45ca-8118-7c81c7bbc3b4 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:17.691318 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0845a6e1-3f49-45ca-8118-7c81c7bbc3b4 None admin] PATH_INFO: `/v3/services` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:17.692517 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0845a6e1-3f49-45ca-8118-7c81c7bbc3b4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:17.693038 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0845a6e1-3f49-45ca-8118-7c81c7bbc3b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:17.695736 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0845a6e1-3f49-45ca-8118-7c81c7bbc3b4 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:17.705648 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 472/942] 10.222.0.36 () {56 vars in 1122 bytes} [Tue Jun 14 17:38:17 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:38:17.714855 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33fae8d-3793-4dcb-ae90-a61881962e8b None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:17.860240 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:17.867848 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33fae8d-3793-4dcb-ae90-a61881962e8b None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:17.942734 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40decbb6-4e09-452a-937a-c2f99c84b8cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:17.944036 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40decbb6-4e09-452a-937a-c2f99c84b8cb None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:17.944480 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40decbb6-4e09-452a-937a-c2f99c84b8cb None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:17.944953 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40decbb6-4e09-452a-937a-c2f99c84b8cb None admin] PATH_INFO: `/v3/endpoints` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:17.946359 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40decbb6-4e09-452a-937a-c2f99c84b8cb None admin] RBAC: Adding query filter params (interface=public, service_id=c1a6a3963dc94e169569edb4ebd870fe, region_id=RegionOne) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:17.946896 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40decbb6-4e09-452a-937a-c2f99c84b8cb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:17.949353 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40decbb6-4e09-452a-937a-c2f99c84b8cb None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:17.963875 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 471/943] 10.222.0.36 () {56 vars in 1251 bytes} [Tue Jun 14 17:38:17 2022] GET /identity/v3/endpoints?service_id=c1a6a3963dc94e169569edb4ebd870fe&interface=public®ion_id=RegionOne => generated 194 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:17.968879 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0845a6e1-3f49-45ca-8118-7c81c7bbc3b4 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:17.994352 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:18.115261 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0845a6e1-3f49-45ca-8118-7c81c7bbc3b4 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:18.158816 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecce55a1-8835-493b-8d4d-8433eb01b3be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:18.159866 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecce55a1-8835-493b-8d4d-8433eb01b3be None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:18.159866 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecce55a1-8835-493b-8d4d-8433eb01b3be None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:18.160135 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecce55a1-8835-493b-8d4d-8433eb01b3be None admin] PATH_INFO: `/v3/services` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:18.160722 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecce55a1-8835-493b-8d4d-8433eb01b3be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:18.162188 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecce55a1-8835-493b-8d4d-8433eb01b3be None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:18.169948 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 473/944] 10.222.0.36 () {56 vars in 1087 bytes} [Tue Jun 14 17:38:17 2022] GET /identity/v3/services => generated 1497 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 17:38:18.226437 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb283bcc-7e2a-468e-bf56-dd37561450f6 None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:18.227337 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb283bcc-7e2a-468e-bf56-dd37561450f6 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:18.228151 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb283bcc-7e2a-468e-bf56-dd37561450f6 None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:18.231417 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 472/945] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:38:18 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:38:18.239370 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa921ea1-c6c3-4c03-834f-2b4f0ac0c439 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:18.239370 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa921ea1-c6c3-4c03-834f-2b4f0ac0c439 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:18.239370 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa921ea1-c6c3-4c03-834f-2b4f0ac0c439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:18.259084 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-aa921ea1-c6c3-4c03-834f-2b4f0ac0c439 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:38:18.260373 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-aa921ea1-c6c3-4c03-834f-2b4f0ac0c439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:38:18.347069 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 474/946] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:38:18 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 17:38:18.371758 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb283bcc-7e2a-468e-bf56-dd37561450f6 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:18.517905 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb283bcc-7e2a-468e-bf56-dd37561450f6 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:18.558991 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b928719-79fd-49d1-a745-3a1ff7cd4c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:18.559715 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b928719-79fd-49d1-a745-3a1ff7cd4c97 None admin] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:18.560005 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b928719-79fd-49d1-a745-3a1ff7cd4c97 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:18.560287 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b928719-79fd-49d1-a745-3a1ff7cd4c97 None admin] PATH_INFO: `/v3/projects` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:18.561025 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b928719-79fd-49d1-a745-3a1ff7cd4c97 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:18.562677 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b928719-79fd-49d1-a745-3a1ff7cd4c97 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:18.564884 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: WARNING keystone.server.flask.common [None req-7b928719-79fd-49d1-a745-3a1ff7cd4c97 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 14 17:38:18.615362 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.sql.core [None req-7b928719-79fd-49d1-a745-3a1ff7cd4c97 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 14 17:38:18.615362 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 14 17:38:18.615362 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [parameters: {'id': '66bfc50f34794cbdb4f38cffc32152c3', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 14 17:38:18.615362 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87018) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 14 17:38:18.649645 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-7b928719-79fd-49d1-a745-3a1ff7cd4c97 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 66bfc50f34794cbdb4f38cffc32152c3.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 66bfc50f34794cbdb4f38cffc32152c3. Jun 14 17:38:18.649645 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:18.649645 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 14 17:38:18.649645 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 14 17:38:18.649645 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 14 17:38:18.649645 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 14 17:38:18.649645 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 14 17:38:18.649645 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application result = self._query(query) Jun 14 17:38:18.649645 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 14 17:38:18.649645 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application conn.query(q) Jun 14 17:38:18.649645 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 14 17:38:18.649645 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 14 17:38:18.649645 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 14 17:38:18.650574 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application result.read() Jun 14 17:38:18.650574 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 14 17:38:18.650574 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 14 17:38:18.650574 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 14 17:38:18.650574 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 14 17:38:18.650574 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 14 17:38:18.650574 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 14 17:38:18.650574 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 14 17:38:18.650574 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 14 17:38:18.650574 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 14 17:38:18.650574 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:38:18.650574 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 14 17:38:18.650574 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:38:18.650574 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:18.650574 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 14 17:38:18.650574 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 14 17:38:18.650574 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 14 17:38:18.650574 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 14 17:38:18.651557 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 14 17:38:18.651557 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application next(self.gen) Jun 14 17:38:18.651557 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 14 17:38:18.651557 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application yield resource Jun 14 17:38:18.651557 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 14 17:38:18.651557 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application next(self.gen) Jun 14 17:38:18.651557 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 14 17:38:18.651557 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application self.session.rollback() Jun 14 17:38:18.651557 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 14 17:38:18.651557 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application self.force_reraise() Jun 14 17:38:18.651557 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 14 17:38:18.651557 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise self.value Jun 14 17:38:18.651557 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 14 17:38:18.651557 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 14 17:38:18.651557 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 14 17:38:18.651557 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application session.commit() Jun 14 17:38:18.651557 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 14 17:38:18.652463 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 14 17:38:18.652463 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 14 17:38:18.652463 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application self._prepare_impl() Jun 14 17:38:18.652463 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 14 17:38:18.652463 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application self.session.flush() Jun 14 17:38:18.652463 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 14 17:38:18.652463 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application self._flush(objects) Jun 14 17:38:18.652463 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 14 17:38:18.652463 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 14 17:38:18.652463 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 14 17:38:18.652463 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application compat.raise_( Jun 14 17:38:18.652463 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 14 17:38:18.652463 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception Jun 14 17:38:18.652463 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 14 17:38:18.652463 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application flush_context.execute() Jun 14 17:38:18.652463 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 14 17:38:18.652463 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rec.execute(self) Jun 14 17:38:18.653499 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 14 17:38:18.653499 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 14 17:38:18.653499 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 14 17:38:18.653499 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 14 17:38:18.653499 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 14 17:38:18.653499 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 14 17:38:18.653499 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 14 17:38:18.653499 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 14 17:38:18.653499 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 14 17:38:18.653499 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 14 17:38:18.653499 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 14 17:38:18.653499 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 14 17:38:18.653499 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 14 17:38:18.653499 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 14 17:38:18.653499 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 14 17:38:18.654388 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 14 17:38:18.654388 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 14 17:38:18.654388 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception Jun 14 17:38:18.654388 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 14 17:38:18.654388 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 14 17:38:18.654388 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 14 17:38:18.654388 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 14 17:38:18.654388 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 14 17:38:18.654388 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application result = self._query(query) Jun 14 17:38:18.654388 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 14 17:38:18.654388 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application conn.query(q) Jun 14 17:38:18.654388 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 14 17:38:18.654388 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 14 17:38:18.654388 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 14 17:38:18.654388 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application result.read() Jun 14 17:38:18.654388 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 14 17:38:18.654388 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 14 17:38:18.655264 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 14 17:38:18.655264 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 14 17:38:18.655264 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 14 17:38:18.655264 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 14 17:38:18.655264 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 14 17:38:18.655264 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 14 17:38:18.655264 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 14 17:38:18.655264 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 14 17:38:18.655264 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [parameters: {'id': '66bfc50f34794cbdb4f38cffc32152c3', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 14 17:38:18.655264 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 14 17:38:18.655264 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:38:18.655264 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 14 17:38:18.655264 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:38:18.655264 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:18.655264 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 14 17:38:18.656096 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 14 17:38:18.656096 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 14 17:38:18.656096 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 14 17:38:18.656096 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 14 17:38:18.656096 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:38:18.656096 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 14 17:38:18.656096 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:38:18.656096 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:18.656096 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:38:18.656096 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:38:18.656096 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:38:18.656096 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:38:18.656096 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:38:18.656096 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:38:18.656096 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:38:18.656096 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:38:18.656096 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:38:18.657213 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:38:18.657213 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 14 17:38:18.657213 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 14 17:38:18.657213 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:38:18.657213 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:38:18.657213 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 14 17:38:18.657213 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 14 17:38:18.657213 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 66bfc50f34794cbdb4f38cffc32152c3. Jun 14 17:38:18.657213 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:38:18.657213 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 473/947] 10.222.0.36 () {60 vars in 1140 bytes} [Tue Jun 14 17:38:18 2022] POST /identity/v3/projects => generated 262 bytes in 281 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:38:18.664799 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa921ea1-c6c3-4c03-834f-2b4f0ac0c439 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:18.670236 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:18.881463 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa921ea1-c6c3-4c03-834f-2b4f0ac0c439 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:18.919342 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c5019e-2945-4fd9-aecc-e10b75342671 None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:18.919342 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c5019e-2945-4fd9-aecc-e10b75342671 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:18.919342 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c5019e-2945-4fd9-aecc-e10b75342671 None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:18.928620 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 474/948] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:38:18 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 14 17:38:18.930201 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a468e294-3bba-47aa-93b3-a1be0a00382e None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:18.930569 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a468e294-3bba-47aa-93b3-a1be0a00382e None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:18.930998 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a468e294-3bba-47aa-93b3-a1be0a00382e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:18.952026 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-a468e294-3bba-47aa-93b3-a1be0a00382e None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:38:18.954527 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-a468e294-3bba-47aa-93b3-a1be0a00382e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:38:18.968619 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:18.972159 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c240953-cb73-4bfe-8345-3c6e66fb717c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:18.973954 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c240953-cb73-4bfe-8345-3c6e66fb717c None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:18.974777 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c240953-cb73-4bfe-8345-3c6e66fb717c None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:18.975576 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c240953-cb73-4bfe-8345-3c6e66fb717c None admin] PATH_INFO: `/v3/projects/service` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:18.989794 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c240953-cb73-4bfe-8345-3c6e66fb717c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:18.993354 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c240953-cb73-4bfe-8345-3c6e66fb717c None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:19.023001 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-4c240953-cb73-4bfe-8345-3c6e66fb717c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:38:19.023001 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:19.023001 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:38:19.023001 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:38:19.023001 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:38:19.023001 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:38:19.023001 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:38:19.023001 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:38:19.023001 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:38:19.023001 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:38:19.023001 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:38:19.023001 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:38:19.023001 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 14 17:38:19.023001 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 14 17:38:19.023001 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 14 17:38:19.024798 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 14 17:38:19.024798 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:38:19.024798 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:38:19.024798 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:38:19.024798 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:38:19.024798 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:38:19.024798 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:38:19.024798 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:38:19.024798 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:38:19.024798 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:38:19.024798 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:38:19.024798 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:38:19.024798 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:38:19.024798 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:38:19.024798 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:38:19.024798 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:38:19.024798 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:38:19.026605 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 14 17:38:19.026605 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 14 17:38:19.026605 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 14 17:38:19.026605 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 14 17:38:19.026605 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 14 17:38:19.026605 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 14 17:38:19.026605 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:38:19.026605 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:38:19.031028 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 475/949] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 14 17:38:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 367 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:38:19.040751 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c240953-cb73-4bfe-8345-3c6e66fb717c None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:19.055854 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 475/950] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:38:18 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 17:38:19.081463 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a468e294-3bba-47aa-93b3-a1be0a00382e None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:19.167909 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:19.201870 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a468e294-3bba-47aa-93b3-a1be0a00382e None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:19.243793 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c240953-cb73-4bfe-8345-3c6e66fb717c None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:19.244340 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fdf861-0b8b-44b6-abad-9e4f379aef6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:19.245407 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fdf861-0b8b-44b6-abad-9e4f379aef6d None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:19.245851 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fdf861-0b8b-44b6-abad-9e4f379aef6d None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:19.246324 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fdf861-0b8b-44b6-abad-9e4f379aef6d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:19.259858 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fdf861-0b8b-44b6-abad-9e4f379aef6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:38:19.269518 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-79fdf861-0b8b-44b6-abad-9e4f379aef6d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 14 17:38:19.269518 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:19.269518 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:38:19.269518 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:38:19.269518 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:38:19.269518 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:38:19.269518 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:38:19.269518 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:38:19.269518 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:38:19.269518 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:38:19.269518 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:38:19.269518 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:38:19.269518 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:38:19.269518 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:38:19.269518 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:38:19.269518 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:38:19.270611 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:38:19.270611 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:38:19.270611 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:38:19.270611 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:38:19.270611 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:38:19.270611 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:38:19.270611 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:38:19.270611 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:38:19.270611 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:38:19.270611 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:38:19.270611 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:38:19.270611 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:38:19.270611 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:38:19.270611 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:38:19.270611 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:38:19.270611 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:38:19.271563 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:38:19.271563 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:38:19.271563 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:38:19.271563 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:38:19.271563 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:38:19.271563 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:38:19.271563 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:38:19.271563 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:38:19.271563 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:38:19.271563 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:38:19.271563 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 14 17:38:19.271563 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:38:19.279408 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 476/951] 10.222.0.36 () {56 vars in 1120 bytes} [Tue Jun 14 17:38:19 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:38:19.280642 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fdf861-0b8b-44b6-abad-9e4f379aef6d None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:19.285721 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:19.314143 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a77bea-eb4f-4494-ad80-bcb0f39a0230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:19.315682 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a77bea-eb4f-4494-ad80-bcb0f39a0230 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:19.316876 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a77bea-eb4f-4494-ad80-bcb0f39a0230 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:19.318190 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a77bea-eb4f-4494-ad80-bcb0f39a0230 None admin] PATH_INFO: `/v3/projects` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:19.319920 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a77bea-eb4f-4494-ad80-bcb0f39a0230 None admin] RBAC: Adding query filter params (name=service) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:19.320877 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a77bea-eb4f-4494-ad80-bcb0f39a0230 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:19.323960 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a77bea-eb4f-4494-ad80-bcb0f39a0230 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:19.367587 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 476/952] 10.222.0.36 () {56 vars in 1112 bytes} [Tue Jun 14 17:38:19 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:19.411608 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fdf861-0b8b-44b6-abad-9e4f379aef6d None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:19.455445 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73d4c01-7972-4268-905e-38ea4705909b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:19.456102 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73d4c01-7972-4268-905e-38ea4705909b None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:19.456395 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73d4c01-7972-4268-905e-38ea4705909b None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:19.456678 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73d4c01-7972-4268-905e-38ea4705909b None admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:19.457495 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73d4c01-7972-4268-905e-38ea4705909b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:19.457806 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73d4c01-7972-4268-905e-38ea4705909b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:19.459421 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73d4c01-7972-4268-905e-38ea4705909b None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:19.470866 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 477/953] 10.222.0.36 () {56 vars in 1115 bytes} [Tue Jun 14 17:38:19 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:19.476831 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a77bea-eb4f-4494-ad80-bcb0f39a0230 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:19.600237 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fff5774-e942-42f9-89fa-bbfea73850fe None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:19.600893 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fff5774-e942-42f9-89fa-bbfea73850fe None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:19.601401 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fff5774-e942-42f9-89fa-bbfea73850fe None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:19.603395 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 478/954] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:38:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:38:19.609331 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430875ed-07e8-4e3e-b247-3617498e38c8 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:19.610156 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430875ed-07e8-4e3e-b247-3617498e38c8 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:19.610931 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430875ed-07e8-4e3e-b247-3617498e38c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:19.636049 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-430875ed-07e8-4e3e-b247-3617498e38c8 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:38:19.638095 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-430875ed-07e8-4e3e-b247-3617498e38c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:38:19.662690 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a77bea-eb4f-4494-ad80-bcb0f39a0230 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:19.701984 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:19.721387 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bb3e4d-27da-4b39-b59e-8e650f5c8566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:19.722650 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bb3e4d-27da-4b39-b59e-8e650f5c8566 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:19.723513 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bb3e4d-27da-4b39-b59e-8e650f5c8566 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:19.724205 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bb3e4d-27da-4b39-b59e-8e650f5c8566 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:19.744222 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bb3e4d-27da-4b39-b59e-8e650f5c8566 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:19.747431 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bb3e4d-27da-4b39-b59e-8e650f5c8566 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:19.750774 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:19.756848 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 479/955] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:38:19 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 14 17:38:19.784110 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430875ed-07e8-4e3e-b247-3617498e38c8 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:19.791506 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-e7bb3e4d-27da-4b39-b59e-8e650f5c8566 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:38:19.791506 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:19.791506 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:38:19.791506 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:38:19.791506 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:38:19.791506 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:38:19.791506 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:38:19.791506 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:38:19.791506 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:38:19.791506 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:38:19.791506 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:38:19.791506 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:38:19.791506 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:38:19.791506 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:38:19.791506 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:38:19.793826 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:38:19.793826 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:38:19.793826 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:38:19.793826 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:38:19.793826 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:38:19.793826 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:38:19.793826 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:38:19.793826 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:38:19.793826 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:38:19.793826 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:38:19.793826 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:38:19.793826 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:38:19.793826 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:38:19.793826 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:38:19.793826 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:38:19.793826 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:38:19.793826 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:38:19.795736 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:38:19.795736 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:38:19.795736 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:38:19.795736 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:38:19.795736 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 477/956] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 14 17:38:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:38:19.800405 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bb3e4d-27da-4b39-b59e-8e650f5c8566 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:19.947683 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430875ed-07e8-4e3e-b247-3617498e38c8 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:19.991483 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250e9db2-3dfe-49b6-91d7-4e292feca951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:19.992036 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bb3e4d-27da-4b39-b59e-8e650f5c8566 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:19.992863 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250e9db2-3dfe-49b6-91d7-4e292feca951 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:19.993308 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250e9db2-3dfe-49b6-91d7-4e292feca951 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:19.993744 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250e9db2-3dfe-49b6-91d7-4e292feca951 None admin] PATH_INFO: `/v3/services/compute` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:19.994585 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250e9db2-3dfe-49b6-91d7-4e292feca951 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:19.996206 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250e9db2-3dfe-49b6-91d7-4e292feca951 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:20.009890 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-250e9db2-3dfe-49b6-91d7-4e292feca951 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 14 17:38:20.009890 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:20.009890 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 14 17:38:20.009890 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 14 17:38:20.009890 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 14 17:38:20.009890 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 14 17:38:20.009890 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 14 17:38:20.009890 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 17:38:20.009890 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 14 17:38:20.009890 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:38:20.009890 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 14 17:38:20.009890 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:38:20.009890 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:20.009890 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:38:20.009890 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:38:20.009890 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:38:20.009890 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:38:20.011270 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:38:20.011270 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:38:20.011270 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:38:20.011270 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:38:20.011270 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:38:20.011270 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:38:20.011270 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 14 17:38:20.011270 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 14 17:38:20.011270 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 14 17:38:20.011270 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 14 17:38:20.011270 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:38:20.011270 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:38:20.011270 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:38:20.011270 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:38:20.011270 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:38:20.011270 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:38:20.012366 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:38:20.012366 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:38:20.012366 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:38:20.012366 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:38:20.012366 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:38:20.012366 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:38:20.012366 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:38:20.012366 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:38:20.012366 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:38:20.012366 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:38:20.012366 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 14 17:38:20.012366 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 17:38:20.012366 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 14 17:38:20.012366 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:38:20.015445 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 480/957] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 14 17:38:19 2022] GET /identity/v3/services/compute => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 17:38:20.023350 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250e9db2-3dfe-49b6-91d7-4e292feca951 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:20.068924 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2882c1-9250-4b46-8b9e-fb7949f58291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:20.070384 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2882c1-9250-4b46-8b9e-fb7949f58291 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:20.071015 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2882c1-9250-4b46-8b9e-fb7949f58291 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:20.071855 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2882c1-9250-4b46-8b9e-fb7949f58291 None admin] PATH_INFO: `/v3/domains` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:20.073536 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2882c1-9250-4b46-8b9e-fb7949f58291 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:20.074228 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2882c1-9250-4b46-8b9e-fb7949f58291 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:20.077530 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2882c1-9250-4b46-8b9e-fb7949f58291 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:20.103578 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 478/958] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 14 17:38:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:20.112749 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2882c1-9250-4b46-8b9e-fb7949f58291 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:20.114152 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:20.156221 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:20.177188 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250e9db2-3dfe-49b6-91d7-4e292feca951 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:20.224462 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516f08d2-148d-42c1-a73c-902c6f197994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:20.225590 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516f08d2-148d-42c1-a73c-902c6f197994 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:20.226181 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516f08d2-148d-42c1-a73c-902c6f197994 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:20.226776 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516f08d2-148d-42c1-a73c-902c6f197994 None admin] PATH_INFO: `/v3/services` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:20.227767 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516f08d2-148d-42c1-a73c-902c6f197994 None admin] RBAC: Adding query filter params (name=compute) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:20.228367 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516f08d2-148d-42c1-a73c-902c6f197994 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:20.230292 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516f08d2-148d-42c1-a73c-902c6f197994 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:20.237718 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2882c1-9250-4b46-8b9e-fb7949f58291 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:20.238244 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 481/959] 10.222.0.36 () {56 vars in 1112 bytes} [Tue Jun 14 17:38:20 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:38:20.243431 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516f08d2-148d-42c1-a73c-902c6f197994 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:20.283088 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd5a46-b45e-40df-a5c6-825046747dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:20.283959 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd5a46-b45e-40df-a5c6-825046747dcd None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:20.284245 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd5a46-b45e-40df-a5c6-825046747dcd None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:20.284526 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd5a46-b45e-40df-a5c6-825046747dcd None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:20.293067 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdd5a46-b45e-40df-a5c6-825046747dcd None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:20.294536 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdd5a46-b45e-40df-a5c6-825046747dcd None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:20.311028 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-bbdd5a46-b45e-40df-a5c6-825046747dcd None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 14 17:38:20.311028 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:20.311028 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:38:20.311028 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:38:20.311028 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:38:20.311028 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:38:20.311028 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:38:20.311028 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:38:20.311028 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:38:20.311028 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:38:20.311028 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:38:20.311028 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:38:20.311028 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 14 17:38:20.311028 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 14 17:38:20.311028 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 14 17:38:20.311028 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 14 17:38:20.312101 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:38:20.312101 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:38:20.312101 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 14 17:38:20.312101 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:38:20.312101 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 14 17:38:20.312101 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:38:20.312101 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:38:20.312101 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:38:20.312101 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:38:20.312101 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:38:20.312101 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:38:20.312101 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:38:20.312101 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:38:20.312101 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:38:20.312101 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:38:20.312101 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:38:20.312101 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:38:20.312101 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:38:20.314085 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:38:20.314085 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:38:20.314085 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 14 17:38:20.314085 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 14 17:38:20.314085 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 14 17:38:20.314085 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 14 17:38:20.314085 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 14 17:38:20.314085 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 14 17:38:20.314085 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 14 17:38:20.314085 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:38:20.318537 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 479/960] 10.222.0.36 () {56 vars in 1117 bytes} [Tue Jun 14 17:38:20 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 17:38:20.319844 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd5a46-b45e-40df-a5c6-825046747dcd None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:20.390204 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516f08d2-148d-42c1-a73c-902c6f197994 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:20.426376 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:20.448106 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fe876d-9cf8-47ea-8f48-8ea1f571f818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:20.449225 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fe876d-9cf8-47ea-8f48-8ea1f571f818 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:20.450596 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fe876d-9cf8-47ea-8f48-8ea1f571f818 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:20.451334 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fe876d-9cf8-47ea-8f48-8ea1f571f818 None admin] PATH_INFO: `/v3/services` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:20.452663 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fe876d-9cf8-47ea-8f48-8ea1f571f818 None admin] RBAC: Adding query filter params (type=compute) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:20.453669 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fe876d-9cf8-47ea-8f48-8ea1f571f818 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:20.456187 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fe876d-9cf8-47ea-8f48-8ea1f571f818 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:20.459769 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:20.467679 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 482/961] 10.222.0.36 () {56 vars in 1112 bytes} [Tue Jun 14 17:38:20 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:38:20.473519 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd5a46-b45e-40df-a5c6-825046747dcd None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:20.523565 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7185a696-155c-43d2-b074-6da838cb610c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:20.524198 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7185a696-155c-43d2-b074-6da838cb610c None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:20.524485 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7185a696-155c-43d2-b074-6da838cb610c None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:20.524767 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7185a696-155c-43d2-b074-6da838cb610c None admin] PATH_INFO: `/v3/users` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:20.525741 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7185a696-155c-43d2-b074-6da838cb610c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:20.526061 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7185a696-155c-43d2-b074-6da838cb610c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:20.527586 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7185a696-155c-43d2-b074-6da838cb610c None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:20.555818 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 480/962] 10.222.0.36 () {56 vars in 1149 bytes} [Tue Jun 14 17:38:20 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:20.557912 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fe876d-9cf8-47ea-8f48-8ea1f571f818 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:20.692393 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fe876d-9cf8-47ea-8f48-8ea1f571f818 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:20.738097 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3310e1f6-52ce-4663-95c2-81034554969b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:20.739183 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3310e1f6-52ce-4663-95c2-81034554969b None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:20.739789 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3310e1f6-52ce-4663-95c2-81034554969b None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:20.740279 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3310e1f6-52ce-4663-95c2-81034554969b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:20.842683 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:20.868704 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3310e1f6-52ce-4663-95c2-81034554969b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:20.871342 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3310e1f6-52ce-4663-95c2-81034554969b None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:21.040191 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 483/963] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 14 17:38:20 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 14 17:38:21.050772 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7185a696-155c-43d2-b074-6da838cb610c None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:21.258457 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7185a696-155c-43d2-b074-6da838cb610c None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:21.332272 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d08bec-f8b5-4f4b-91cb-9303b081dd26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:21.334199 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d08bec-f8b5-4f4b-91cb-9303b081dd26 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:21.334996 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d08bec-f8b5-4f4b-91cb-9303b081dd26 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:21.335839 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d08bec-f8b5-4f4b-91cb-9303b081dd26 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:21.357559 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d08bec-f8b5-4f4b-91cb-9303b081dd26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:21.362163 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d08bec-f8b5-4f4b-91cb-9303b081dd26 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:21.398256 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-e7d08bec-f8b5-4f4b-91cb-9303b081dd26 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:38:21.398256 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:21.398256 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:38:21.398256 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:38:21.398256 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:38:21.398256 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:38:21.398256 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:38:21.398256 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:38:21.398256 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:38:21.398256 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:38:21.398256 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:38:21.398256 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:38:21.398256 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:38:21.398256 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:38:21.398256 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:38:21.399650 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:38:21.399650 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:38:21.399650 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:38:21.399650 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:38:21.399650 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:38:21.399650 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:38:21.399650 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:38:21.399650 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:38:21.399650 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:38:21.399650 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:38:21.399650 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:38:21.399650 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:38:21.399650 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:38:21.399650 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:38:21.399650 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:38:21.399650 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:38:21.399650 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:38:21.401065 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:38:21.401065 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:38:21.401065 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:38:21.401065 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:38:21.404306 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 481/964] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 14 17:38:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 355 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:38:21.416742 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3310e1f6-52ce-4663-95c2-81034554969b None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:21.541812 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd8cb18-9269-4063-8413-fca4da9bfd6d None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:21.542051 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd8cb18-9269-4063-8413-fca4da9bfd6d None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:21.542368 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd8cb18-9269-4063-8413-fca4da9bfd6d None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:21.544117 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 482/965] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:38:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:38:21.550521 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463d6a23-0ea8-4e36-bc5d-b6b6e2ed3cb7 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:21.550794 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463d6a23-0ea8-4e36-bc5d-b6b6e2ed3cb7 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:21.551086 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463d6a23-0ea8-4e36-bc5d-b6b6e2ed3cb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:21.563510 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:21.577354 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-463d6a23-0ea8-4e36-bc5d-b6b6e2ed3cb7 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:38:21.581042 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-463d6a23-0ea8-4e36-bc5d-b6b6e2ed3cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:38:21.582755 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:21.597880 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3310e1f6-52ce-4663-95c2-81034554969b None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:21.643637 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6bc1b8-2b67-4fdb-bf41-5141383de0bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:21.644440 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6bc1b8-2b67-4fdb-bf41-5141383de0bb None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:21.644797 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6bc1b8-2b67-4fdb-bf41-5141383de0bb None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:21.645147 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6bc1b8-2b67-4fdb-bf41-5141383de0bb None admin] PATH_INFO: `/v3/domains` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:21.645984 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6bc1b8-2b67-4fdb-bf41-5141383de0bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:21.646373 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6bc1b8-2b67-4fdb-bf41-5141383de0bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:21.647973 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6bc1b8-2b67-4fdb-bf41-5141383de0bb None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:21.664851 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 484/966] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 14 17:38:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:21.674177 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6bc1b8-2b67-4fdb-bf41-5141383de0bb None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:21.760886 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 483/967] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:38:21 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 17:38:21.781468 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463d6a23-0ea8-4e36-bc5d-b6b6e2ed3cb7 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:21.843521 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6bc1b8-2b67-4fdb-bf41-5141383de0bb None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:21.915578 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7540886e-91ce-4b2c-b91a-7a598fb63f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:21.917079 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7540886e-91ce-4b2c-b91a-7a598fb63f97 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:21.917582 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7540886e-91ce-4b2c-b91a-7a598fb63f97 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:21.918079 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7540886e-91ce-4b2c-b91a-7a598fb63f97 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:21.933560 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7540886e-91ce-4b2c-b91a-7a598fb63f97 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:21.934497 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463d6a23-0ea8-4e36-bc5d-b6b6e2ed3cb7 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:21.936201 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7540886e-91ce-4b2c-b91a-7a598fb63f97 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:21.968261 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-7540886e-91ce-4b2c-b91a-7a598fb63f97 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:38:21.968261 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:21.968261 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:38:21.968261 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:38:21.968261 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:38:21.968261 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:38:21.968261 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:38:21.968261 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:38:21.968261 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:38:21.968261 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:38:21.968261 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:38:21.968261 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:38:21.968261 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 14 17:38:21.968261 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 14 17:38:21.968261 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 14 17:38:21.970194 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 14 17:38:21.970194 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:38:21.970194 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:38:21.970194 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:38:21.970194 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:38:21.970194 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:38:21.970194 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:38:21.970194 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:38:21.970194 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:38:21.970194 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:38:21.970194 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:38:21.970194 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:38:21.970194 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:38:21.970194 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:38:21.970194 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:38:21.970194 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:38:21.970194 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:38:21.971263 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 14 17:38:21.971263 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 14 17:38:21.971263 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 14 17:38:21.971263 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 14 17:38:21.971263 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 14 17:38:21.971263 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 14 17:38:21.971263 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:38:21.971263 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:38:21.978578 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c948d3c-a798-423a-9db2-f5332df977db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:21.979390 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 485/968] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 14 17:38:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:38:21.980195 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c948d3c-a798-423a-9db2-f5332df977db None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:21.980700 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c948d3c-a798-423a-9db2-f5332df977db None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:21.981215 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c948d3c-a798-423a-9db2-f5332df977db None admin] PATH_INFO: `/v3/services/object-store` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:21.981323 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7540886e-91ce-4b2c-b91a-7a598fb63f97 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:21.982334 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c948d3c-a798-423a-9db2-f5332df977db None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:21.984121 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c948d3c-a798-423a-9db2-f5332df977db None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:21.988068 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:21.998919 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-9c948d3c-a798-423a-9db2-f5332df977db None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 14 17:38:21.998919 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:21.998919 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 14 17:38:21.998919 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 14 17:38:21.998919 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 14 17:38:21.998919 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 14 17:38:21.998919 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 14 17:38:21.998919 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 17:38:21.998919 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 14 17:38:21.998919 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:38:21.998919 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 14 17:38:21.998919 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:38:21.998919 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:21.998919 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:38:21.998919 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:38:21.998919 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:38:21.998919 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:38:22.006699 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:38:22.006699 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:38:22.006699 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:38:22.006699 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:38:22.006699 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:38:22.006699 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:38:22.006699 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 14 17:38:22.006699 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 14 17:38:22.006699 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 14 17:38:22.006699 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 14 17:38:22.006699 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:38:22.006699 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:38:22.006699 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:38:22.006699 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:38:22.006699 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:38:22.006699 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:38:22.007597 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:38:22.007597 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:38:22.007597 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:38:22.007597 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:38:22.007597 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:38:22.007597 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:38:22.007597 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:38:22.007597 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:38:22.007597 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:38:22.007597 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:38:22.007597 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 14 17:38:22.007597 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 17:38:22.007597 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 14 17:38:22.007597 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:38:22.007597 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 484/969] 10.222.0.36 () {56 vars in 1126 bytes} [Tue Jun 14 17:38:21 2022] GET /identity/v3/services/object-store => generated 93 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 17:38:22.010914 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c948d3c-a798-423a-9db2-f5332df977db None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:22.015659 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:22.138014 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c948d3c-a798-423a-9db2-f5332df977db None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:22.176942 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7540886e-91ce-4b2c-b91a-7a598fb63f97 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:22.178213 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2c8f28-aed7-4f5e-b0b3-f4f82e551c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:22.179101 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2c8f28-aed7-4f5e-b0b3-f4f82e551c63 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:22.179636 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2c8f28-aed7-4f5e-b0b3-f4f82e551c63 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:22.180166 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2c8f28-aed7-4f5e-b0b3-f4f82e551c63 None admin] PATH_INFO: `/v3/services` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:22.181219 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2c8f28-aed7-4f5e-b0b3-f4f82e551c63 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:22.181849 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2c8f28-aed7-4f5e-b0b3-f4f82e551c63 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:22.183522 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2c8f28-aed7-4f5e-b0b3-f4f82e551c63 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:22.190883 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 485/970] 10.222.0.36 () {56 vars in 1122 bytes} [Tue Jun 14 17:38:22 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:22.198507 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2c8f28-aed7-4f5e-b0b3-f4f82e551c63 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:22.232405 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693a6125-f660-49c0-9988-f1bf36405362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:22.233096 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693a6125-f660-49c0-9988-f1bf36405362 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:22.233763 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693a6125-f660-49c0-9988-f1bf36405362 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:22.234061 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693a6125-f660-49c0-9988-f1bf36405362 None admin] PATH_INFO: `/v3/projects` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:22.235564 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693a6125-f660-49c0-9988-f1bf36405362 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:22.235894 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693a6125-f660-49c0-9988-f1bf36405362 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:22.238096 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693a6125-f660-49c0-9988-f1bf36405362 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:22.255246 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 486/971] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jun 14 17:38:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:38:22.261393 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693a6125-f660-49c0-9988-f1bf36405362 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:22.291854 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:22.343566 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2c8f28-aed7-4f5e-b0b3-f4f82e551c63 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:22.383350 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:22.410362 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1860c940-a6af-4ee0-aee4-612d52f35935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:22.411546 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1860c940-a6af-4ee0-aee4-612d52f35935 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:22.412139 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1860c940-a6af-4ee0-aee4-612d52f35935 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:22.412875 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1860c940-a6af-4ee0-aee4-612d52f35935 None admin] PATH_INFO: `/v3/services` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:22.414213 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1860c940-a6af-4ee0-aee4-612d52f35935 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:22.415073 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1860c940-a6af-4ee0-aee4-612d52f35935 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:22.418071 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1860c940-a6af-4ee0-aee4-612d52f35935 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:22.427884 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693a6125-f660-49c0-9988-f1bf36405362 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:22.429051 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 486/972] 10.222.0.36 () {56 vars in 1122 bytes} [Tue Jun 14 17:38:22 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:22.434774 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1860c940-a6af-4ee0-aee4-612d52f35935 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:22.498427 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc02c01e-3fc6-4e61-9570-82ff0faecbf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:22.499575 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc02c01e-3fc6-4e61-9570-82ff0faecbf9 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:22.500127 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc02c01e-3fc6-4e61-9570-82ff0faecbf9 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:22.500631 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc02c01e-3fc6-4e61-9570-82ff0faecbf9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:22.501713 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc02c01e-3fc6-4e61-9570-82ff0faecbf9 None admin] RBAC: Adding query filter params (role.id=dca59aef7b5d4641b6c146c9be77d2fe, scope.project.id=f3e1d023a52c42b98d018617987ef83c, user.id=f1e32638fe5c4d2d8d3e2e4ea8250aaa) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:22.502294 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc02c01e-3fc6-4e61-9570-82ff0faecbf9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:22.504355 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc02c01e-3fc6-4e61-9570-82ff0faecbf9 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:22.511932 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 487/973] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 14 17:38:22 2022] GET /identity/v3/role_assignments?user.id=f1e32638fe5c4d2d8d3e2e4ea8250aaa&scope.project.id=f3e1d023a52c42b98d018617987ef83c&role.id=dca59aef7b5d4641b6c146c9be77d2fe => generated 608 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:22.563857 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1860c940-a6af-4ee0-aee4-612d52f35935 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:22.597287 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:22.606816 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056d7a0f-e60c-41d8-9292-b78464a21b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:22.614944 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056d7a0f-e60c-41d8-9292-b78464a21b29 None admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:22.614944 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056d7a0f-e60c-41d8-9292-b78464a21b29 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:22.614944 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056d7a0f-e60c-41d8-9292-b78464a21b29 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:22.614944 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056d7a0f-e60c-41d8-9292-b78464a21b29 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:22.614944 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056d7a0f-e60c-41d8-9292-b78464a21b29 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:22.668042 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 487/974] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Jun 14 17:38:22 2022] POST /identity/v3/endpoints => generated 349 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 17:38:22.868048 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb445b6e-b639-4419-8886-fdf1c9201edb None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:22.869062 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb445b6e-b639-4419-8886-fdf1c9201edb None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:22.869575 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb445b6e-b639-4419-8886-fdf1c9201edb None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:22.871695 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 488/975] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:38:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:38:22.878777 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de73f25b-84cb-43b4-86e1-03ceb8ef2ae6 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:22.879720 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de73f25b-84cb-43b4-86e1-03ceb8ef2ae6 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:22.880227 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de73f25b-84cb-43b4-86e1-03ceb8ef2ae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:22.901443 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-de73f25b-84cb-43b4-86e1-03ceb8ef2ae6 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:38:22.902697 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-de73f25b-84cb-43b4-86e1-03ceb8ef2ae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:38:22.999564 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 488/976] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:38:22 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 17:38:23.021484 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb445b6e-b639-4419-8886-fdf1c9201edb None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:23.150572 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb445b6e-b639-4419-8886-fdf1c9201edb None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:23.187688 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:23.193795 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578c8cfc-89b3-47e4-8560-ea3d44ebbf0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:23.194905 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c8cfc-89b3-47e4-8560-ea3d44ebbf0a None admin] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:23.195702 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c8cfc-89b3-47e4-8560-ea3d44ebbf0a None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:23.196160 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c8cfc-89b3-47e4-8560-ea3d44ebbf0a None admin] PATH_INFO: `/v3/users` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:23.197060 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578c8cfc-89b3-47e4-8560-ea3d44ebbf0a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:23.198810 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578c8cfc-89b3-47e4-8560-ea3d44ebbf0a None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:23.254232 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.sql.core [None req-578c8cfc-89b3-47e4-8560-ea3d44ebbf0a None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 14 17:38:23.254232 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 14 17:38:23.254232 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [parameters: {'user_id': 'd9ae0847ed994c39aa7c09b1ca3e1f03', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 14 17:38:23.254232 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87018) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 14 17:38:23.272086 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-578c8cfc-89b3-47e4-8560-ea3d44ebbf0a None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 14 17:38:23.272086 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:23.272086 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 14 17:38:23.272086 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 14 17:38:23.272086 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 14 17:38:23.272086 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 14 17:38:23.272086 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 14 17:38:23.272086 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application result = self._query(query) Jun 14 17:38:23.272086 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 14 17:38:23.272086 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application conn.query(q) Jun 14 17:38:23.272086 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 14 17:38:23.272086 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 14 17:38:23.272086 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 14 17:38:23.272086 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application result.read() Jun 14 17:38:23.272086 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 14 17:38:23.273654 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 14 17:38:23.273654 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 14 17:38:23.273654 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 14 17:38:23.273654 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 14 17:38:23.273654 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 14 17:38:23.273654 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 14 17:38:23.273654 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 14 17:38:23.273654 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 14 17:38:23.273654 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:38:23.273654 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 14 17:38:23.273654 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:38:23.273654 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:23.273654 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 14 17:38:23.273654 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 14 17:38:23.273654 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 14 17:38:23.273654 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 14 17:38:23.273654 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 14 17:38:23.273654 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application next(self.gen) Jun 14 17:38:23.275615 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 14 17:38:23.275615 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application yield resource Jun 14 17:38:23.275615 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 14 17:38:23.275615 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application next(self.gen) Jun 14 17:38:23.275615 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 14 17:38:23.275615 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application self.session.rollback() Jun 14 17:38:23.275615 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 14 17:38:23.275615 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application self.force_reraise() Jun 14 17:38:23.275615 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 14 17:38:23.275615 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise self.value Jun 14 17:38:23.275615 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 14 17:38:23.275615 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 14 17:38:23.275615 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 14 17:38:23.275615 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application session.commit() Jun 14 17:38:23.275615 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 14 17:38:23.275615 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 14 17:38:23.275615 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 14 17:38:23.279909 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application self._prepare_impl() Jun 14 17:38:23.279909 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 14 17:38:23.279909 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application self.session.flush() Jun 14 17:38:23.279909 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 14 17:38:23.279909 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application self._flush(objects) Jun 14 17:38:23.279909 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 14 17:38:23.279909 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 14 17:38:23.279909 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 14 17:38:23.279909 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application compat.raise_( Jun 14 17:38:23.279909 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 14 17:38:23.279909 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception Jun 14 17:38:23.279909 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 14 17:38:23.279909 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application flush_context.execute() Jun 14 17:38:23.279909 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 14 17:38:23.279909 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rec.execute(self) Jun 14 17:38:23.279909 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 14 17:38:23.279909 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 14 17:38:23.282910 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 14 17:38:23.282910 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 14 17:38:23.282910 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 14 17:38:23.282910 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 14 17:38:23.282910 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 14 17:38:23.282910 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 14 17:38:23.282910 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 14 17:38:23.282910 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 14 17:38:23.282910 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 14 17:38:23.282910 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 14 17:38:23.282910 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 14 17:38:23.282910 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 14 17:38:23.282910 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 14 17:38:23.282910 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 14 17:38:23.282910 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 14 17:38:23.282910 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception Jun 14 17:38:23.285002 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 14 17:38:23.285002 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 14 17:38:23.285002 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 14 17:38:23.285002 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 14 17:38:23.285002 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 14 17:38:23.285002 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application result = self._query(query) Jun 14 17:38:23.285002 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 14 17:38:23.285002 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application conn.query(q) Jun 14 17:38:23.285002 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 14 17:38:23.285002 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 14 17:38:23.285002 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 14 17:38:23.285002 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application result.read() Jun 14 17:38:23.285002 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 14 17:38:23.285002 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 14 17:38:23.285002 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 14 17:38:23.285002 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 14 17:38:23.288674 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 14 17:38:23.288674 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 14 17:38:23.288674 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 14 17:38:23.288674 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 14 17:38:23.288674 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 14 17:38:23.288674 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 14 17:38:23.288674 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [parameters: {'user_id': 'd9ae0847ed994c39aa7c09b1ca3e1f03', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 14 17:38:23.288674 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 14 17:38:23.288674 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:38:23.288674 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 14 17:38:23.288674 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:38:23.288674 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:23.288674 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:38:23.288674 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:38:23.288674 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:38:23.291120 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:38:23.291120 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:38:23.291120 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:38:23.291120 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:38:23.291120 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:38:23.291120 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:38:23.291120 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:38:23.291120 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 14 17:38:23.291120 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 14 17:38:23.291120 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:38:23.291120 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:38:23.291120 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 14 17:38:23.291120 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:38:23.291120 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 14 17:38:23.291120 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:38:23.291120 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 14 17:38:23.291120 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 14 17:38:23.293597 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 14 17:38:23.293597 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 14 17:38:23.293597 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 14 17:38:23.293597 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 14 17:38:23.293597 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 14 17:38:23.293597 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:38:23.293597 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 489/977] 10.222.0.36 () {60 vars in 1131 bytes} [Tue Jun 14 17:38:23 2022] POST /identity/v3/users => generated 160 bytes in 269 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 14 17:38:23.300281 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de73f25b-84cb-43b4-86e1-03ceb8ef2ae6 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:23.492241 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de73f25b-84cb-43b4-86e1-03ceb8ef2ae6 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:23.515199 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:23.544800 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28d854a-5a6f-46ef-a1e0-1d97bc11aa08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:23.545591 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28d854a-5a6f-46ef-a1e0-1d97bc11aa08 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:23.545870 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28d854a-5a6f-46ef-a1e0-1d97bc11aa08 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:23.546148 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28d854a-5a6f-46ef-a1e0-1d97bc11aa08 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:23.555334 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28d854a-5a6f-46ef-a1e0-1d97bc11aa08 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:23.557076 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28d854a-5a6f-46ef-a1e0-1d97bc11aa08 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:23.574197 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-f28d854a-5a6f-46ef-a1e0-1d97bc11aa08 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 14 17:38:23.574197 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:23.574197 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:38:23.574197 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:38:23.574197 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:38:23.574197 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:38:23.574197 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:38:23.574197 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:38:23.574197 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:38:23.574197 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:38:23.574197 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:38:23.574197 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:38:23.574197 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 14 17:38:23.574197 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 14 17:38:23.574197 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 14 17:38:23.574197 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 14 17:38:23.577070 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:38:23.577070 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:38:23.577070 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 14 17:38:23.577070 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:38:23.577070 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 14 17:38:23.577070 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:38:23.577070 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:38:23.577070 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:38:23.577070 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:38:23.577070 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:38:23.577070 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:38:23.577070 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:38:23.577070 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:38:23.577070 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:38:23.577070 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:38:23.577070 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:38:23.577070 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:38:23.577070 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:38:23.579393 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:38:23.579393 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:38:23.579393 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 14 17:38:23.579393 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 14 17:38:23.579393 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 14 17:38:23.579393 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 14 17:38:23.579393 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 14 17:38:23.579393 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 14 17:38:23.579393 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 14 17:38:23.579393 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:38:23.579393 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 489/978] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 14 17:38:23 2022] GET /identity/v3/users/cinder => generated 84 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:38:23.584977 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578c8cfc-89b3-47e4-8560-ea3d44ebbf0a None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:23.717843 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578c8cfc-89b3-47e4-8560-ea3d44ebbf0a None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:23.788924 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303cc2a5-c393-4512-abf8-d31f68a26385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:23.790059 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303cc2a5-c393-4512-abf8-d31f68a26385 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:23.790585 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303cc2a5-c393-4512-abf8-d31f68a26385 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:23.791100 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303cc2a5-c393-4512-abf8-d31f68a26385 None admin] PATH_INFO: `/v3/users` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:23.792835 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303cc2a5-c393-4512-abf8-d31f68a26385 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:23.793406 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303cc2a5-c393-4512-abf8-d31f68a26385 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:23.796793 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303cc2a5-c393-4512-abf8-d31f68a26385 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:23.870695 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68d62c1-9653-40c6-98c9-f73ef31af5c5 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:23.871043 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68d62c1-9653-40c6-98c9-f73ef31af5c5 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:23.871264 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68d62c1-9653-40c6-98c9-f73ef31af5c5 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:23.872944 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 490/979] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:38:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:38:23.877233 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 490/980] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Jun 14 17:38:23 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:23.880087 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbad88c5-11c5-49cf-b8df-15374b1f52ac None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:23.880373 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbad88c5-11c5-49cf-b8df-15374b1f52ac None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:23.880652 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbad88c5-11c5-49cf-b8df-15374b1f52ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:23.900551 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-dbad88c5-11c5-49cf-b8df-15374b1f52ac None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:38:23.902316 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-dbad88c5-11c5-49cf-b8df-15374b1f52ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:38:23.990050 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 491/981] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:38:23 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 17:38:24.021433 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303cc2a5-c393-4512-abf8-d31f68a26385 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:24.144597 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:24.244072 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303cc2a5-c393-4512-abf8-d31f68a26385 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:24.312885 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3f6d86-c6a0-4193-94e8-3bdef6f94430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:24.314040 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3f6d86-c6a0-4193-94e8-3bdef6f94430 None admin] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:24.314527 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3f6d86-c6a0-4193-94e8-3bdef6f94430 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:24.315064 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3f6d86-c6a0-4193-94e8-3bdef6f94430 None admin] PATH_INFO: `/v3/services` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:24.316445 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3f6d86-c6a0-4193-94e8-3bdef6f94430 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:24.319073 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3f6d86-c6a0-4193-94e8-3bdef6f94430 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:24.410674 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 491/982] 10.222.0.36 () {60 vars in 1141 bytes} [Tue Jun 14 17:38:24 2022] POST /identity/v3/services => generated 242 bytes in 390 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:38:25.134454 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315d0f92-3e20-4b96-99c4-ac93686d0108 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:25.135001 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315d0f92-3e20-4b96-99c4-ac93686d0108 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:25.135514 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315d0f92-3e20-4b96-99c4-ac93686d0108 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:25.137984 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 492/983] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:38:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:38:25.147438 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50378346-bc5a-4b28-8651-f19b6c77771d None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:25.148204 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50378346-bc5a-4b28-8651-f19b6c77771d None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:25.148204 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50378346-bc5a-4b28-8651-f19b6c77771d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:25.174285 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-50378346-bc5a-4b28-8651-f19b6c77771d None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:38:25.176993 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-50378346-bc5a-4b28-8651-f19b6c77771d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:38:25.318917 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 492/984] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:38:25 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 17:38:25.360843 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315d0f92-3e20-4b96-99c4-ac93686d0108 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:25.525564 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4609472-0290-4d95-8067-7f3ce551965a None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:25.525965 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4609472-0290-4d95-8067-7f3ce551965a None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:25.526458 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4609472-0290-4d95-8067-7f3ce551965a None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:25.530119 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 493/985] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:38:25 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:38:25.539327 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2a0ed8-f7a4-418e-8a57-a72e12749983 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:25.539843 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2a0ed8-f7a4-418e-8a57-a72e12749983 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:25.540337 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2a0ed8-f7a4-418e-8a57-a72e12749983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:25.561442 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:25.564801 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-6b2a0ed8-f7a4-418e-8a57-a72e12749983 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:38:25.566176 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-6b2a0ed8-f7a4-418e-8a57-a72e12749983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:38:25.569144 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315d0f92-3e20-4b96-99c4-ac93686d0108 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:25.616685 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:25.619738 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c57255-c279-46a2-8477-e980f8c205b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:25.620763 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c57255-c279-46a2-8477-e980f8c205b6 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:25.621234 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c57255-c279-46a2-8477-e980f8c205b6 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:25.621697 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c57255-c279-46a2-8477-e980f8c205b6 None admin] PATH_INFO: `/v3/services/image` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:25.622562 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c57255-c279-46a2-8477-e980f8c205b6 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:25.624407 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c57255-c279-46a2-8477-e980f8c205b6 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:25.640192 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-58c57255-c279-46a2-8477-e980f8c205b6 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 14 17:38:25.640192 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:25.640192 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 14 17:38:25.640192 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 14 17:38:25.640192 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 14 17:38:25.640192 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 14 17:38:25.640192 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 14 17:38:25.640192 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 17:38:25.640192 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 14 17:38:25.640192 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:38:25.640192 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 14 17:38:25.640192 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:38:25.640192 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:25.640192 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:38:25.640192 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:38:25.640192 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:38:25.640192 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:38:25.643574 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:38:25.643574 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:38:25.643574 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:38:25.643574 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:38:25.643574 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:38:25.643574 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:38:25.643574 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 14 17:38:25.643574 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 14 17:38:25.643574 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 14 17:38:25.643574 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 14 17:38:25.643574 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:38:25.643574 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:38:25.643574 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:38:25.643574 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:38:25.643574 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:38:25.643574 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:38:25.647981 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:38:25.647981 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:38:25.647981 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:38:25.647981 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:38:25.647981 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:38:25.647981 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:38:25.647981 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:38:25.647981 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:38:25.647981 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:38:25.647981 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:38:25.647981 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 14 17:38:25.647981 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 17:38:25.647981 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 14 17:38:25.647981 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:38:25.647981 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 493/986] 10.222.0.36 () {56 vars in 1105 bytes} [Tue Jun 14 17:38:25 2022] GET /identity/v3/services/image => generated 86 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:38:25.652448 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c57255-c279-46a2-8477-e980f8c205b6 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:25.689472 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 494/987] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:38:25 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 14 17:38:25.718072 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2a0ed8-f7a4-418e-8a57-a72e12749983 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:25.827104 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c57255-c279-46a2-8477-e980f8c205b6 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:25.887140 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0824e576-ddf9-4e3d-ba1a-a3bcdac6b8b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:25.888013 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0824e576-ddf9-4e3d-ba1a-a3bcdac6b8b0 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:25.888412 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0824e576-ddf9-4e3d-ba1a-a3bcdac6b8b0 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:25.888803 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0824e576-ddf9-4e3d-ba1a-a3bcdac6b8b0 None admin] PATH_INFO: `/v3/services` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:25.889661 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0824e576-ddf9-4e3d-ba1a-a3bcdac6b8b0 None admin] RBAC: Adding query filter params (name=image) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:25.890128 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0824e576-ddf9-4e3d-ba1a-a3bcdac6b8b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:25.892269 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0824e576-ddf9-4e3d-ba1a-a3bcdac6b8b0 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:25.910102 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2a0ed8-f7a4-418e-8a57-a72e12749983 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:25.913267 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 494/988] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 14 17:38:25 2022] GET /identity/v3/services?name=image => generated 122 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:25.914755 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0824e576-ddf9-4e3d-ba1a-a3bcdac6b8b0 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:25.968443 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc96747-66f1-409c-94d8-13af9b7b3e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:25.969989 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc96747-66f1-409c-94d8-13af9b7b3e79 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:25.970449 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc96747-66f1-409c-94d8-13af9b7b3e79 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:25.971191 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:25.971765 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc96747-66f1-409c-94d8-13af9b7b3e79 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:25.972800 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc96747-66f1-409c-94d8-13af9b7b3e79 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:25.974544 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc96747-66f1-409c-94d8-13af9b7b3e79 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:25.989244 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-4fc96747-66f1-409c-94d8-13af9b7b3e79 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 14 17:38:25.989244 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:25.989244 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 14 17:38:25.989244 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 14 17:38:25.989244 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 14 17:38:25.989244 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 14 17:38:25.989244 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 14 17:38:25.989244 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 17:38:25.989244 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 14 17:38:25.989244 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:38:25.989244 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 14 17:38:25.989244 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:38:25.989244 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:25.989244 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:38:25.989244 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:38:25.989244 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:38:25.989244 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:38:25.991546 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:38:25.991546 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:38:25.991546 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:38:25.991546 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:38:25.991546 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:38:25.991546 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:38:25.991546 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 14 17:38:25.991546 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 14 17:38:25.991546 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 14 17:38:25.991546 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 14 17:38:25.991546 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:38:25.991546 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:38:25.991546 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:38:25.991546 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:38:25.991546 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:38:25.991546 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:38:25.993691 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:38:25.993691 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:38:25.993691 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:38:25.993691 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:38:25.993691 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:38:25.993691 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:38:25.993691 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:38:25.993691 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:38:25.993691 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:38:25.993691 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:38:25.993691 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 14 17:38:25.993691 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 17:38:25.993691 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 14 17:38:25.993691 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:38:25.998053 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 495/989] 10.222.0.36 () {56 vars in 1126 bytes} [Tue Jun 14 17:38:25 2022] GET /identity/v3/services/object-store => generated 93 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:38:25.999680 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc96747-66f1-409c-94d8-13af9b7b3e79 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:26.043956 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:26.118608 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0824e576-ddf9-4e3d-ba1a-a3bcdac6b8b0 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:26.162132 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc96747-66f1-409c-94d8-13af9b7b3e79 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:26.177660 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9b9642-8ae4-4a43-8659-941493ef7b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:26.178686 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9b9642-8ae4-4a43-8659-941493ef7b6c None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:26.179061 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9b9642-8ae4-4a43-8659-941493ef7b6c None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:26.179494 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9b9642-8ae4-4a43-8659-941493ef7b6c None admin] PATH_INFO: `/v3/services` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:26.180331 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9b9642-8ae4-4a43-8659-941493ef7b6c None admin] RBAC: Adding query filter params (type=image) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:26.180734 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9b9642-8ae4-4a43-8659-941493ef7b6c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:26.182268 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9b9642-8ae4-4a43-8659-941493ef7b6c None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:26.195752 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 495/990] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 14 17:38:25 2022] GET /identity/v3/services?type=image => generated 122 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:26.214848 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e1a61b-7d76-4fd1-8fce-fae83cbc63b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:26.215813 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e1a61b-7d76-4fd1-8fce-fae83cbc63b5 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:26.216199 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e1a61b-7d76-4fd1-8fce-fae83cbc63b5 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:26.216592 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e1a61b-7d76-4fd1-8fce-fae83cbc63b5 None admin] PATH_INFO: `/v3/services` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:26.217442 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e1a61b-7d76-4fd1-8fce-fae83cbc63b5 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:26.217857 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e1a61b-7d76-4fd1-8fce-fae83cbc63b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:26.220084 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e1a61b-7d76-4fd1-8fce-fae83cbc63b5 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:26.226745 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 496/991] 10.222.0.36 () {56 vars in 1122 bytes} [Tue Jun 14 17:38:25 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:26.232624 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9b9642-8ae4-4a43-8659-941493ef7b6c None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:26.401353 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:26.411551 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9b9642-8ae4-4a43-8659-941493ef7b6c None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:26.451912 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebde34b-a3aa-49bf-861f-c9f7eae15535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:26.452604 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebde34b-a3aa-49bf-861f-c9f7eae15535 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:26.452893 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebde34b-a3aa-49bf-861f-c9f7eae15535 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:26.453919 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebde34b-a3aa-49bf-861f-c9f7eae15535 None admin] PATH_INFO: `/v3/services` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:26.454456 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebde34b-a3aa-49bf-861f-c9f7eae15535 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:26.454753 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebde34b-a3aa-49bf-861f-c9f7eae15535 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:26.456230 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebde34b-a3aa-49bf-861f-c9f7eae15535 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:26.462202 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 496/992] 10.222.0.36 () {56 vars in 1122 bytes} [Tue Jun 14 17:38:26 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:38:26.472726 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e1a61b-7d76-4fd1-8fce-fae83cbc63b5 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:26.633374 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:26.640110 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e1a61b-7d76-4fd1-8fce-fae83cbc63b5 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:26.682206 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693155da-c04a-48ea-b25a-b56f1d199fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:26.682887 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693155da-c04a-48ea-b25a-b56f1d199fcc None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:26.683170 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693155da-c04a-48ea-b25a-b56f1d199fcc None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:26.683472 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693155da-c04a-48ea-b25a-b56f1d199fcc None admin] PATH_INFO: `/v3/endpoints` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:26.684284 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693155da-c04a-48ea-b25a-b56f1d199fcc None admin] RBAC: Adding query filter params (interface=admin, service_id=c1a6a3963dc94e169569edb4ebd870fe, region_id=RegionOne) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:26.684599 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693155da-c04a-48ea-b25a-b56f1d199fcc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:26.686000 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693155da-c04a-48ea-b25a-b56f1d199fcc None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:26.692884 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 497/993] 10.222.0.36 () {56 vars in 1249 bytes} [Tue Jun 14 17:38:26 2022] GET /identity/v3/endpoints?service_id=c1a6a3963dc94e169569edb4ebd870fe&interface=admin®ion_id=RegionOne => generated 193 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:26.698923 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebde34b-a3aa-49bf-861f-c9f7eae15535 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:26.821480 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebde34b-a3aa-49bf-861f-c9f7eae15535 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:26.857100 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41b743a-3e86-4f94-a918-3878d4be8993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:26.857842 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41b743a-3e86-4f94-a918-3878d4be8993 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:26.858128 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41b743a-3e86-4f94-a918-3878d4be8993 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:26.858404 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41b743a-3e86-4f94-a918-3878d4be8993 None admin] PATH_INFO: `/v3/services` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:26.859095 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41b743a-3e86-4f94-a918-3878d4be8993 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:26.861130 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41b743a-3e86-4f94-a918-3878d4be8993 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:26.875736 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 497/994] 10.222.0.36 () {56 vars in 1087 bytes} [Tue Jun 14 17:38:26 2022] GET /identity/v3/services => generated 1727 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 14 17:38:27.912129 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80eac6f-b279-4edc-a7e9-1b0d686bd56e None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:27.912955 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80eac6f-b279-4edc-a7e9-1b0d686bd56e None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:27.912955 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80eac6f-b279-4edc-a7e9-1b0d686bd56e None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:27.914396 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 498/995] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:38:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 14 17:38:27.924702 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6304d03e-df38-43da-8e29-4b7b719efe69 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:27.926249 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6304d03e-df38-43da-8e29-4b7b719efe69 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:27.927051 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6304d03e-df38-43da-8e29-4b7b719efe69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:27.956691 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-6304d03e-df38-43da-8e29-4b7b719efe69 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:38:27.959232 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-6304d03e-df38-43da-8e29-4b7b719efe69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:38:27.987768 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:28.097840 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 498/996] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:38:27 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 17:38:28.138617 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80eac6f-b279-4edc-a7e9-1b0d686bd56e None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:28.337083 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80eac6f-b279-4edc-a7e9-1b0d686bd56e None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:28.404515 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc27a612-68e1-4f19-b569-660536ca121e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:28.405878 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc27a612-68e1-4f19-b569-660536ca121e None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:28.406954 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc27a612-68e1-4f19-b569-660536ca121e None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:28.407605 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc27a612-68e1-4f19-b569-660536ca121e None admin] PATH_INFO: `/v3/services/compute` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:28.408664 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc27a612-68e1-4f19-b569-660536ca121e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:28.411418 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc27a612-68e1-4f19-b569-660536ca121e None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:28.435797 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-dc27a612-68e1-4f19-b569-660536ca121e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 14 17:38:28.435797 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:28.435797 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 14 17:38:28.435797 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 14 17:38:28.435797 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 14 17:38:28.435797 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 14 17:38:28.435797 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 14 17:38:28.435797 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 17:38:28.435797 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 14 17:38:28.435797 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:38:28.435797 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 14 17:38:28.435797 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:38:28.435797 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:28.435797 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:38:28.435797 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:38:28.435797 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:38:28.435797 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:38:28.438358 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:38:28.438358 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:38:28.438358 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:38:28.438358 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:38:28.438358 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:38:28.438358 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:38:28.438358 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 14 17:38:28.438358 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 14 17:38:28.438358 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 14 17:38:28.438358 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 14 17:38:28.438358 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:38:28.438358 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:38:28.438358 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:38:28.438358 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:38:28.438358 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:38:28.438358 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:38:28.441363 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:38:28.441363 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:38:28.441363 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:38:28.441363 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:38:28.441363 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:38:28.441363 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:38:28.441363 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:38:28.441363 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:38:28.441363 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:38:28.441363 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:38:28.441363 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 14 17:38:28.441363 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 17:38:28.441363 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 14 17:38:28.441363 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:38:28.444483 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 499/997] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 14 17:38:28 2022] GET /identity/v3/services/compute => generated 88 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:38:28.449250 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6304d03e-df38-43da-8e29-4b7b719efe69 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:28.535530 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39fa04f-d8f4-4468-8b69-0c770ed8b759 None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:28.535827 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39fa04f-d8f4-4468-8b69-0c770ed8b759 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:28.536131 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39fa04f-d8f4-4468-8b69-0c770ed8b759 None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:28.537528 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 500/998] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:38:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 14 17:38:28.543074 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d97710b-5e98-42d7-9322-2f060e8c23bc None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:28.543441 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d97710b-5e98-42d7-9322-2f060e8c23bc None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:28.543753 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d97710b-5e98-42d7-9322-2f060e8c23bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:28.563357 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-4d97710b-5e98-42d7-9322-2f060e8c23bc None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:38:28.564607 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-4d97710b-5e98-42d7-9322-2f060e8c23bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:38:28.586930 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:28.640664 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6304d03e-df38-43da-8e29-4b7b719efe69 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:28.660273 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 501/999] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:38:28 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 14 17:38:28.687743 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d97710b-5e98-42d7-9322-2f060e8c23bc None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:28.720352 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0bcf4e-4f6f-4974-b941-40e829283355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:28.721513 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0bcf4e-4f6f-4974-b941-40e829283355 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:28.722029 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0bcf4e-4f6f-4974-b941-40e829283355 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:28.722541 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0bcf4e-4f6f-4974-b941-40e829283355 None admin] PATH_INFO: `/v3/services` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:28.723940 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0bcf4e-4f6f-4974-b941-40e829283355 None admin] RBAC: Adding query filter params (name=compute) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:28.724508 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0bcf4e-4f6f-4974-b941-40e829283355 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:28.726762 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0bcf4e-4f6f-4974-b941-40e829283355 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:28.743463 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 499/1000] 10.222.0.36 () {56 vars in 1112 bytes} [Tue Jun 14 17:38:28 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:28.746561 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0bcf4e-4f6f-4974-b941-40e829283355 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:28.773121 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:28.863594 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d97710b-5e98-42d7-9322-2f060e8c23bc None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:28.932636 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a50d45d-fc06-4a55-9169-0a96ccb14f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:28.933998 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a50d45d-fc06-4a55-9169-0a96ccb14f92 None admin] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:28.934497 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a50d45d-fc06-4a55-9169-0a96ccb14f92 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:28.935223 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a50d45d-fc06-4a55-9169-0a96ccb14f92 None admin] PATH_INFO: `/v3/services` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:28.937004 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a50d45d-fc06-4a55-9169-0a96ccb14f92 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:28.939708 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a50d45d-fc06-4a55-9169-0a96ccb14f92 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:28.940143 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0bcf4e-4f6f-4974-b941-40e829283355 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:28.985927 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de283f58-2464-45ef-aa1c-ff55b5f94c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:28.986836 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de283f58-2464-45ef-aa1c-ff55b5f94c23 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:28.987240 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de283f58-2464-45ef-aa1c-ff55b5f94c23 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:28.987664 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de283f58-2464-45ef-aa1c-ff55b5f94c23 None admin] PATH_INFO: `/v3/services` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:28.988548 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de283f58-2464-45ef-aa1c-ff55b5f94c23 None admin] RBAC: Adding query filter params (type=compute) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:28.988990 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de283f58-2464-45ef-aa1c-ff55b5f94c23 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:28.990652 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de283f58-2464-45ef-aa1c-ff55b5f94c23 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:28.997167 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 500/1001] 10.222.0.36 () {56 vars in 1112 bytes} [Tue Jun 14 17:38:28 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:38:29.004634 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de283f58-2464-45ef-aa1c-ff55b5f94c23 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:29.022804 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 502/1002] 10.222.0.36 () {60 vars in 1141 bytes} [Tue Jun 14 17:38:28 2022] POST /identity/v3/services => generated 242 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 17:38:29.162074 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:29.191987 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de283f58-2464-45ef-aa1c-ff55b5f94c23 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:29.249898 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ee9b57-3370-49e8-af7d-a6c754c5376b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:29.250883 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ee9b57-3370-49e8-af7d-a6c754c5376b None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:29.251439 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ee9b57-3370-49e8-af7d-a6c754c5376b None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:29.251940 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ee9b57-3370-49e8-af7d-a6c754c5376b None admin] PATH_INFO: `/v3/endpoints` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:29.252968 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ee9b57-3370-49e8-af7d-a6c754c5376b None admin] RBAC: Adding query filter params (interface=public, service_id=14cf5485c79e4f6886fcd441fe409164, region_id=RegionOne) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:29.253435 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ee9b57-3370-49e8-af7d-a6c754c5376b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:29.255429 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ee9b57-3370-49e8-af7d-a6c754c5376b None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:29.262533 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 501/1003] 10.222.0.36 () {56 vars in 1251 bytes} [Tue Jun 14 17:38:29 2022] GET /identity/v3/endpoints?service_id=14cf5485c79e4f6886fcd441fe409164&interface=public®ion_id=RegionOne => generated 194 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:29.268990 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a50d45d-fc06-4a55-9169-0a96ccb14f92 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:29.289515 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:29.330600 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b8f73f-7b1e-46ea-946e-7dea5625452c None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:29.331063 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b8f73f-7b1e-46ea-946e-7dea5625452c None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:29.332732 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b8f73f-7b1e-46ea-946e-7dea5625452c None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:29.333533 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 502/1004] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:38:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 14 17:38:29.340768 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79615618-93a7-4e4f-a84f-994a06c869ca None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:29.341236 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79615618-93a7-4e4f-a84f-994a06c869ca None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:29.342441 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79615618-93a7-4e4f-a84f-994a06c869ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:29.367512 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-79615618-93a7-4e4f-a84f-994a06c869ca None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:38:29.369014 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-79615618-93a7-4e4f-a84f-994a06c869ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:38:29.446898 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a50d45d-fc06-4a55-9169-0a96ccb14f92 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:29.471600 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 503/1005] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:38:29 2022] POST /identity/v3/auth/tokens => generated 1656 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 14 17:38:29.498489 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79615618-93a7-4e4f-a84f-994a06c869ca None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:29.516986 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaa9bb8-be6e-4b6d-b924-9a01854c0d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:29.518131 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaa9bb8-be6e-4b6d-b924-9a01854c0d30 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:29.518639 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaa9bb8-be6e-4b6d-b924-9a01854c0d30 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:29.519385 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaa9bb8-be6e-4b6d-b924-9a01854c0d30 None admin] PATH_INFO: `/v3/services` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:29.520660 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaa9bb8-be6e-4b6d-b924-9a01854c0d30 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:29.523142 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaa9bb8-be6e-4b6d-b924-9a01854c0d30 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:29.546081 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 503/1006] 10.222.0.36 () {56 vars in 1087 bytes} [Tue Jun 14 17:38:29 2022] GET /identity/v3/services => generated 1957 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 14 17:38:29.619848 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:29.686397 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79615618-93a7-4e4f-a84f-994a06c869ca None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:29.756075 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56d265a-ee4e-471c-9bec-28636af3eec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:29.758146 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56d265a-ee4e-471c-9bec-28636af3eec8 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:29.758955 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56d265a-ee4e-471c-9bec-28636af3eec8 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:29.759753 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56d265a-ee4e-471c-9bec-28636af3eec8 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:29.761305 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56d265a-ee4e-471c-9bec-28636af3eec8 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:29.764226 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56d265a-ee4e-471c-9bec-28636af3eec8 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:29.790367 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-d56d265a-ee4e-471c-9bec-28636af3eec8 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 14 17:38:29.790367 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:29.790367 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 14 17:38:29.790367 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 14 17:38:29.790367 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 14 17:38:29.790367 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 14 17:38:29.790367 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 14 17:38:29.790367 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 17:38:29.790367 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 14 17:38:29.790367 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:38:29.790367 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 14 17:38:29.790367 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:38:29.790367 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:29.790367 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:38:29.790367 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:38:29.790367 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:38:29.790367 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:38:29.792320 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:38:29.792320 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:38:29.792320 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:38:29.792320 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:38:29.792320 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:38:29.792320 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:38:29.792320 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 14 17:38:29.792320 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 14 17:38:29.792320 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 14 17:38:29.792320 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 14 17:38:29.792320 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:38:29.792320 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:38:29.792320 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:38:29.792320 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:38:29.792320 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:38:29.792320 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:38:29.793949 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:38:29.793949 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:38:29.793949 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:38:29.793949 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:38:29.793949 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:38:29.793949 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:38:29.793949 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:38:29.793949 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:38:29.793949 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:38:29.793949 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:38:29.793949 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 14 17:38:29.793949 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 17:38:29.793949 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 14 17:38:29.793949 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:38:29.793949 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 504/1007] 10.222.0.36 () {56 vars in 1126 bytes} [Tue Jun 14 17:38:29 2022] GET /identity/v3/services/object-store => generated 93 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 17:38:29.800381 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaa9bb8-be6e-4b6d-b924-9a01854c0d30 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:29.923143 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:29.947215 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaa9bb8-be6e-4b6d-b924-9a01854c0d30 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:29.989782 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5acdf8-b2ff-4648-bbaa-c06f7bffa582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:29.990466 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5acdf8-b2ff-4648-bbaa-c06f7bffa582 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:29.990760 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5acdf8-b2ff-4648-bbaa-c06f7bffa582 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:29.991026 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5acdf8-b2ff-4648-bbaa-c06f7bffa582 None admin] PATH_INFO: `/v3/services` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:29.991787 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5acdf8-b2ff-4648-bbaa-c06f7bffa582 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:29.992099 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5acdf8-b2ff-4648-bbaa-c06f7bffa582 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:29.993500 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5acdf8-b2ff-4648-bbaa-c06f7bffa582 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:29.999385 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 504/1008] 10.222.0.36 () {56 vars in 1122 bytes} [Tue Jun 14 17:38:29 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:30.006063 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56d265a-ee4e-471c-9bec-28636af3eec8 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:30.117740 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56d265a-ee4e-471c-9bec-28636af3eec8 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:30.154495 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:30.160513 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70483f8-81db-4724-9c03-df1f6c752d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:30.161503 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70483f8-81db-4724-9c03-df1f6c752d69 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:30.161957 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70483f8-81db-4724-9c03-df1f6c752d69 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:30.168118 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70483f8-81db-4724-9c03-df1f6c752d69 None admin] PATH_INFO: `/v3/services` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:30.168118 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70483f8-81db-4724-9c03-df1f6c752d69 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:30.168118 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70483f8-81db-4724-9c03-df1f6c752d69 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:30.168118 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70483f8-81db-4724-9c03-df1f6c752d69 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:30.171108 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 505/1009] 10.222.0.36 () {56 vars in 1122 bytes} [Tue Jun 14 17:38:30 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:38:30.180231 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5acdf8-b2ff-4648-bbaa-c06f7bffa582 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:30.304651 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5acdf8-b2ff-4648-bbaa-c06f7bffa582 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:30.345456 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53909abb-5690-4973-aa39-8ee498cb5c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:30.346141 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53909abb-5690-4973-aa39-8ee498cb5c96 None admin] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:30.346431 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53909abb-5690-4973-aa39-8ee498cb5c96 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:30.346717 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53909abb-5690-4973-aa39-8ee498cb5c96 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:30.347503 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53909abb-5690-4973-aa39-8ee498cb5c96 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:30.348895 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53909abb-5690-4973-aa39-8ee498cb5c96 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:30.439341 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 505/1010] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Jun 14 17:38:30 2022] POST /identity/v3/endpoints => generated 325 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:38:31.895758 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3a687b-72c7-4c04-b87a-cc1b0c2ed1e6 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:31.896311 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3a687b-72c7-4c04-b87a-cc1b0c2ed1e6 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:31.896777 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3a687b-72c7-4c04-b87a-cc1b0c2ed1e6 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:31.903146 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 506/1011] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:38:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:38:31.909432 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29a6af9-adb8-45f7-a1fa-c8d0b51eac8b None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:31.909432 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29a6af9-adb8-45f7-a1fa-c8d0b51eac8b None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:31.910155 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29a6af9-adb8-45f7-a1fa-c8d0b51eac8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:31.917840 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:31.936759 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-a29a6af9-adb8-45f7-a1fa-c8d0b51eac8b None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:38:31.938727 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-a29a6af9-adb8-45f7-a1fa-c8d0b51eac8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:38:32.071512 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 506/1012] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:38:31 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 17:38:32.102565 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b85b78e-2980-4a4f-874e-7c6562e9a5eb None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:32.102921 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b85b78e-2980-4a4f-874e-7c6562e9a5eb None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:32.103126 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b85b78e-2980-4a4f-874e-7c6562e9a5eb None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:32.104554 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 507/1013] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:38:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:38:32.111187 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c2fbd5-adaf-450a-8c21-b7cbeaa7db8c None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:32.111532 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c2fbd5-adaf-450a-8c21-b7cbeaa7db8c None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:32.111818 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c2fbd5-adaf-450a-8c21-b7cbeaa7db8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:32.115817 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b85b78e-2980-4a4f-874e-7c6562e9a5eb None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:32.130485 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-50c2fbd5-adaf-450a-8c21-b7cbeaa7db8c None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:38:32.131743 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-50c2fbd5-adaf-450a-8c21-b7cbeaa7db8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:38:32.259969 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 507/1014] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:38:32 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 17:38:32.285796 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c2fbd5-adaf-450a-8c21-b7cbeaa7db8c None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:32.287284 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b85b78e-2980-4a4f-874e-7c6562e9a5eb None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:32.333219 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3770a609-8c2f-4828-8320-bbc0dd547dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:32.334024 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3770a609-8c2f-4828-8320-bbc0dd547dcd None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:32.334311 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3770a609-8c2f-4828-8320-bbc0dd547dcd None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:32.334595 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3770a609-8c2f-4828-8320-bbc0dd547dcd None admin] PATH_INFO: `/v3/services/image` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:32.335272 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3770a609-8c2f-4828-8320-bbc0dd547dcd None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:32.336701 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3770a609-8c2f-4828-8320-bbc0dd547dcd None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:32.351357 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-3770a609-8c2f-4828-8320-bbc0dd547dcd None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 14 17:38:32.351357 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:32.351357 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 14 17:38:32.351357 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 14 17:38:32.351357 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 14 17:38:32.351357 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 14 17:38:32.351357 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 14 17:38:32.351357 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 17:38:32.351357 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 14 17:38:32.351357 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:38:32.351357 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 14 17:38:32.351357 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:38:32.351357 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:32.351357 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:38:32.351357 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:38:32.351357 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:38:32.351357 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:38:32.353391 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:38:32.353391 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:38:32.353391 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:38:32.353391 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:38:32.353391 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:38:32.353391 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:38:32.353391 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 14 17:38:32.353391 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 14 17:38:32.353391 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 14 17:38:32.353391 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 14 17:38:32.353391 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:38:32.353391 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:38:32.353391 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:38:32.353391 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:38:32.353391 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:38:32.353391 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:38:32.355098 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:38:32.355098 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:38:32.355098 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:38:32.355098 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:38:32.355098 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:38:32.355098 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:38:32.355098 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:38:32.355098 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:38:32.355098 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:38:32.355098 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:38:32.355098 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 14 17:38:32.355098 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 17:38:32.355098 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 14 17:38:32.355098 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:38:32.355098 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 508/1015] 10.222.0.36 () {56 vars in 1105 bytes} [Tue Jun 14 17:38:32 2022] GET /identity/v3/services/image => generated 86 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:38:32.364636 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3770a609-8c2f-4828-8320-bbc0dd547dcd None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:32.366379 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:32.422507 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c2fbd5-adaf-450a-8c21-b7cbeaa7db8c None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:32.474335 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928afb7f-578c-4c24-9619-b3c465438ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:32.475151 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928afb7f-578c-4c24-9619-b3c465438ba5 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:32.475461 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928afb7f-578c-4c24-9619-b3c465438ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:32.475733 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928afb7f-578c-4c24-9619-b3c465438ba5 None admin] PATH_INFO: `/v3/services/compute` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:32.476406 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928afb7f-578c-4c24-9619-b3c465438ba5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:32.477140 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:32.477898 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928afb7f-578c-4c24-9619-b3c465438ba5 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:32.491664 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-928afb7f-578c-4c24-9619-b3c465438ba5 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 14 17:38:32.491664 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:32.491664 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 14 17:38:32.491664 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 14 17:38:32.491664 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 14 17:38:32.491664 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 14 17:38:32.491664 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 14 17:38:32.491664 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 17:38:32.491664 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 14 17:38:32.491664 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:38:32.491664 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 14 17:38:32.491664 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:38:32.491664 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:32.491664 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:38:32.491664 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:38:32.491664 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:38:32.491664 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:38:32.500990 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:38:32.500990 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:38:32.500990 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:38:32.500990 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:38:32.500990 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:38:32.500990 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:38:32.500990 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 14 17:38:32.500990 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 14 17:38:32.500990 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 14 17:38:32.500990 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 14 17:38:32.500990 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:38:32.500990 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:38:32.500990 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:38:32.500990 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:38:32.500990 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:38:32.500990 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:38:32.502836 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:38:32.502836 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:38:32.502836 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:38:32.502836 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:38:32.502836 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:38:32.502836 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:38:32.502836 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:38:32.502836 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:38:32.502836 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:38:32.502836 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:38:32.502836 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 14 17:38:32.502836 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 17:38:32.502836 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 14 17:38:32.502836 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:38:32.502836 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 508/1016] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 14 17:38:32 2022] GET /identity/v3/services/compute => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:38:32.505626 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928afb7f-578c-4c24-9619-b3c465438ba5 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:32.560363 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3770a609-8c2f-4828-8320-bbc0dd547dcd None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:32.627325 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f72dec3-7e9f-487b-a6d3-eb4b6e7b1d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:32.628475 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f72dec3-7e9f-487b-a6d3-eb4b6e7b1d03 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:32.629234 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f72dec3-7e9f-487b-a6d3-eb4b6e7b1d03 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:32.629740 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f72dec3-7e9f-487b-a6d3-eb4b6e7b1d03 None admin] PATH_INFO: `/v3/services` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:32.631131 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f72dec3-7e9f-487b-a6d3-eb4b6e7b1d03 None admin] RBAC: Adding query filter params (name=image) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:32.631750 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f72dec3-7e9f-487b-a6d3-eb4b6e7b1d03 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:32.634267 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f72dec3-7e9f-487b-a6d3-eb4b6e7b1d03 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:32.641617 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928afb7f-578c-4c24-9619-b3c465438ba5 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:32.651825 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 509/1017] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 14 17:38:32 2022] GET /identity/v3/services?name=image => generated 122 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:38:32.654005 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f72dec3-7e9f-487b-a6d3-eb4b6e7b1d03 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:32.672097 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:32.690119 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57afc97-52d0-40f1-89f0-c5eb9bcbd3de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:32.691101 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57afc97-52d0-40f1-89f0-c5eb9bcbd3de None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:32.691551 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57afc97-52d0-40f1-89f0-c5eb9bcbd3de None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:32.692034 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57afc97-52d0-40f1-89f0-c5eb9bcbd3de None admin] PATH_INFO: `/v3/services` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:32.693180 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57afc97-52d0-40f1-89f0-c5eb9bcbd3de None admin] RBAC: Adding query filter params (name=compute) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:32.693689 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57afc97-52d0-40f1-89f0-c5eb9bcbd3de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:32.695258 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57afc97-52d0-40f1-89f0-c5eb9bcbd3de None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:32.707573 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 509/1018] 10.222.0.36 () {56 vars in 1112 bytes} [Tue Jun 14 17:38:32 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:32.708988 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57afc97-52d0-40f1-89f0-c5eb9bcbd3de None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:32.851779 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f72dec3-7e9f-487b-a6d3-eb4b6e7b1d03 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:32.897131 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:32.911330 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ae933e-26c8-4831-a34c-2853cfd22a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:32.911638 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ae933e-26c8-4831-a34c-2853cfd22a6f None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:32.912114 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ae933e-26c8-4831-a34c-2853cfd22a6f None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:32.912569 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ae933e-26c8-4831-a34c-2853cfd22a6f None admin] PATH_INFO: `/v3/services` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:32.913735 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ae933e-26c8-4831-a34c-2853cfd22a6f None admin] RBAC: Adding query filter params (type=image) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:32.914255 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ae933e-26c8-4831-a34c-2853cfd22a6f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:32.916481 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57afc97-52d0-40f1-89f0-c5eb9bcbd3de None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:32.917267 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ae933e-26c8-4831-a34c-2853cfd22a6f None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:32.924936 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 510/1019] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 14 17:38:32 2022] GET /identity/v3/services?type=image => generated 350 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:38:32.931281 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ae933e-26c8-4831-a34c-2853cfd22a6f None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:32.985485 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3b112f-53ed-4130-b7a2-2507f3159a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:32.986676 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b112f-53ed-4130-b7a2-2507f3159a34 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:32.987212 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b112f-53ed-4130-b7a2-2507f3159a34 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:32.987758 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b112f-53ed-4130-b7a2-2507f3159a34 None admin] PATH_INFO: `/v3/services` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:32.989073 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3b112f-53ed-4130-b7a2-2507f3159a34 None admin] RBAC: Adding query filter params (type=compute) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:32.989995 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3b112f-53ed-4130-b7a2-2507f3159a34 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:32.992254 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3b112f-53ed-4130-b7a2-2507f3159a34 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:33.007342 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 510/1020] 10.222.0.36 () {56 vars in 1112 bytes} [Tue Jun 14 17:38:32 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:38:33.012120 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3b112f-53ed-4130-b7a2-2507f3159a34 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:33.071523 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ae933e-26c8-4831-a34c-2853cfd22a6f None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:33.112751 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:33.135794 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a9de72-a0ce-4e09-a562-f5eb14304cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:33.136843 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a9de72-a0ce-4e09-a562-f5eb14304cda None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:33.137319 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a9de72-a0ce-4e09-a562-f5eb14304cda None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:33.137871 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a9de72-a0ce-4e09-a562-f5eb14304cda None admin] PATH_INFO: `/v3/endpoints` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:33.138920 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a9de72-a0ce-4e09-a562-f5eb14304cda None admin] RBAC: Adding query filter params (interface=public, service_id=4b36a7680e814d09b7109003b987f32c, region_id=RegionOne) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:33.139507 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a9de72-a0ce-4e09-a562-f5eb14304cda None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:33.141607 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a9de72-a0ce-4e09-a562-f5eb14304cda None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:33.148454 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 511/1021] 10.222.0.36 () {56 vars in 1251 bytes} [Tue Jun 14 17:38:32 2022] GET /identity/v3/endpoints?service_id=4b36a7680e814d09b7109003b987f32c&interface=public®ion_id=RegionOne => generated 194 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:33.154377 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a9de72-a0ce-4e09-a562-f5eb14304cda None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:33.198364 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3b112f-53ed-4130-b7a2-2507f3159a34 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:33.246372 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daedacc6-c681-40e4-9c0d-596a591ea59b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:33.247923 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daedacc6-c681-40e4-9c0d-596a591ea59b None admin] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:33.248705 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daedacc6-c681-40e4-9c0d-596a591ea59b None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:33.249390 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daedacc6-c681-40e4-9c0d-596a591ea59b None admin] PATH_INFO: `/v3/endpoints` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:33.251666 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daedacc6-c681-40e4-9c0d-596a591ea59b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:33.254615 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daedacc6-c681-40e4-9c0d-596a591ea59b None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:33.262300 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:33.342570 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 511/1022] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Jun 14 17:38:33 2022] POST /identity/v3/endpoints => generated 334 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 17:38:33.345579 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a9de72-a0ce-4e09-a562-f5eb14304cda None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:33.402659 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b89d6b1-d67c-4010-9d32-f90e273864a9 None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:33.403102 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b89d6b1-d67c-4010-9d32-f90e273864a9 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:33.403580 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b89d6b1-d67c-4010-9d32-f90e273864a9 None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:33.406770 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 512/1023] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:38:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:38:33.412719 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a4bc1b-8dd1-4479-9c5b-c36a7715f287 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:33.413006 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a4bc1b-8dd1-4479-9c5b-c36a7715f287 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:33.413306 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a4bc1b-8dd1-4479-9c5b-c36a7715f287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:33.434070 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-f0a4bc1b-8dd1-4479-9c5b-c36a7715f287 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:38:33.434513 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066c6cb7-fd12-4e30-a3e5-64437336a6ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:33.435419 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-f0a4bc1b-8dd1-4479-9c5b-c36a7715f287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:38:33.435594 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066c6cb7-fd12-4e30-a3e5-64437336a6ff None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:33.436052 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066c6cb7-fd12-4e30-a3e5-64437336a6ff None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:33.436564 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066c6cb7-fd12-4e30-a3e5-64437336a6ff None admin] PATH_INFO: `/v3/services` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:33.438304 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066c6cb7-fd12-4e30-a3e5-64437336a6ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:33.440828 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066c6cb7-fd12-4e30-a3e5-64437336a6ff None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:33.449988 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 512/1024] 10.222.0.36 () {56 vars in 1087 bytes} [Tue Jun 14 17:38:33 2022] GET /identity/v3/services => generated 1957 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 14 17:38:33.539712 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 513/1025] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:38:33 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 14 17:38:33.569868 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066c6cb7-fd12-4e30-a3e5-64437336a6ff None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:33.732537 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066c6cb7-fd12-4e30-a3e5-64437336a6ff None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:33.749020 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:33.774865 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354586e2-5537-44b9-9ecd-ee50647a6c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:33.775711 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354586e2-5537-44b9-9ecd-ee50647a6c88 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:33.775999 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354586e2-5537-44b9-9ecd-ee50647a6c88 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:33.776285 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354586e2-5537-44b9-9ecd-ee50647a6c88 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:33.777553 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354586e2-5537-44b9-9ecd-ee50647a6c88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:33.779012 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354586e2-5537-44b9-9ecd-ee50647a6c88 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:33.786297 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 513/1026] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 14 17:38:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:33.790065 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a4bc1b-8dd1-4479-9c5b-c36a7715f287 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:33.854133 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:33.982707 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a4bc1b-8dd1-4479-9c5b-c36a7715f287 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:34.044864 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdb320b-0cf6-4a27-b462-b88d09cb950a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:34.046462 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdb320b-0cf6-4a27-b462-b88d09cb950a None admin] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:34.046701 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdb320b-0cf6-4a27-b462-b88d09cb950a None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:34.047185 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdb320b-0cf6-4a27-b462-b88d09cb950a None admin] PATH_INFO: `/v3/projects` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:34.048553 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdb320b-0cf6-4a27-b462-b88d09cb950a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:34.051345 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdb320b-0cf6-4a27-b462-b88d09cb950a None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:34.160600 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 514/1027] 10.222.0.36 () {60 vars in 1141 bytes} [Tue Jun 14 17:38:33 2022] POST /identity/v3/projects => generated 311 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:38:35.881689 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d17543-1b87-47e2-ae3f-010f042fbe3e None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:35.882485 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d17543-1b87-47e2-ae3f-010f042fbe3e None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:35.882624 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d17543-1b87-47e2-ae3f-010f042fbe3e None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:35.884565 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 514/1028] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:38:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:38:35.892645 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b633c5c-a7b4-4750-985d-ab2bc3428bd3 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:35.893449 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b633c5c-a7b4-4750-985d-ab2bc3428bd3 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:35.893621 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b633c5c-a7b4-4750-985d-ab2bc3428bd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:35.916546 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-8b633c5c-a7b4-4750-985d-ab2bc3428bd3 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:38:35.917762 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-8b633c5c-a7b4-4750-985d-ab2bc3428bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:38:36.004146 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 515/1029] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:38:35 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 17:38:36.024308 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d17543-1b87-47e2-ae3f-010f042fbe3e None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:36.082132 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475ffd56-813a-48b1-8351-e196d7173133 None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:36.082403 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475ffd56-813a-48b1-8351-e196d7173133 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:36.082686 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475ffd56-813a-48b1-8351-e196d7173133 None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:36.084933 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 516/1030] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:38:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:38:36.090606 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6653a9b0-fda6-4f72-8cfd-accb359c6ec8 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:36.090832 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6653a9b0-fda6-4f72-8cfd-accb359c6ec8 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:36.091194 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6653a9b0-fda6-4f72-8cfd-accb359c6ec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:36.110146 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-6653a9b0-fda6-4f72-8cfd-accb359c6ec8 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:38:36.111613 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-6653a9b0-fda6-4f72-8cfd-accb359c6ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:38:36.130180 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:36.157282 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d17543-1b87-47e2-ae3f-010f042fbe3e None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:36.200401 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d94ac0-4cbb-4d47-a4ce-76805a2087ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:36.201729 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d94ac0-4cbb-4d47-a4ce-76805a2087ff None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:36.202329 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d94ac0-4cbb-4d47-a4ce-76805a2087ff None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:36.203217 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d94ac0-4cbb-4d47-a4ce-76805a2087ff None admin] PATH_INFO: `/v3/services/image` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:36.205244 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d94ac0-4cbb-4d47-a4ce-76805a2087ff None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:36.207914 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d94ac0-4cbb-4d47-a4ce-76805a2087ff None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:36.208607 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 517/1031] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:38:36 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 14 17:38:36.227487 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-59d94ac0-4cbb-4d47-a4ce-76805a2087ff None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 14 17:38:36.227487 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:36.227487 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 14 17:38:36.227487 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 14 17:38:36.227487 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 14 17:38:36.227487 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 14 17:38:36.227487 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 14 17:38:36.227487 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 17:38:36.227487 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 14 17:38:36.227487 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:38:36.227487 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 14 17:38:36.227487 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:38:36.227487 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:36.227487 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:38:36.227487 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:38:36.227487 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:38:36.227487 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:38:36.236564 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:38:36.236564 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:38:36.236564 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:38:36.236564 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:38:36.236564 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:38:36.236564 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:38:36.236564 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 14 17:38:36.236564 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 14 17:38:36.236564 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 14 17:38:36.236564 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 14 17:38:36.236564 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:38:36.236564 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:38:36.236564 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:38:36.236564 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:38:36.236564 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:38:36.236564 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:38:36.238594 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:38:36.238594 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:38:36.238594 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:38:36.238594 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:38:36.238594 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:38:36.238594 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:38:36.238594 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:38:36.238594 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:38:36.238594 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:38:36.238594 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:38:36.238594 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 14 17:38:36.238594 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 17:38:36.238594 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 14 17:38:36.238594 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:38:36.238594 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 515/1032] 10.222.0.36 () {56 vars in 1105 bytes} [Tue Jun 14 17:38:36 2022] GET /identity/v3/services/image => generated 86 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 17:38:36.240824 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6653a9b0-fda6-4f72-8cfd-accb359c6ec8 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:36.244853 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d94ac0-4cbb-4d47-a4ce-76805a2087ff None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:36.304150 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:36.399423 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d94ac0-4cbb-4d47-a4ce-76805a2087ff None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:36.419178 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6653a9b0-fda6-4f72-8cfd-accb359c6ec8 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:36.461195 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed54b77-9475-451e-91af-d165ce6208ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:36.462167 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10af03e7-435a-4b52-ad3d-d60bb873b8f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:36.462330 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed54b77-9475-451e-91af-d165ce6208ed None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:36.462810 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed54b77-9475-451e-91af-d165ce6208ed None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:36.462994 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10af03e7-435a-4b52-ad3d-d60bb873b8f2 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:36.463282 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10af03e7-435a-4b52-ad3d-d60bb873b8f2 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:36.463464 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed54b77-9475-451e-91af-d165ce6208ed None admin] PATH_INFO: `/v3/services` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:36.463598 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10af03e7-435a-4b52-ad3d-d60bb873b8f2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:36.464663 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed54b77-9475-451e-91af-d165ce6208ed None admin] RBAC: Adding query filter params (name=image) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:36.465219 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed54b77-9475-451e-91af-d165ce6208ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:36.467906 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed54b77-9475-451e-91af-d165ce6208ed None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:36.475231 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10af03e7-435a-4b52-ad3d-d60bb873b8f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:38:36.482312 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 516/1033] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 14 17:38:36 2022] GET /identity/v3/services?name=image => generated 122 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:38:36.482312 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ebb164-0ea4-4644-a287-88f5018d02be None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:36.482312 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ebb164-0ea4-4644-a287-88f5018d02be None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:36.482312 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ebb164-0ea4-4644-a287-88f5018d02be None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:36.483418 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 517/1034] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:38:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:38:36.483826 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-10af03e7-435a-4b52-ad3d-d60bb873b8f2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 14 17:38:36.483826 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:36.483826 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:38:36.483826 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:38:36.483826 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:38:36.483826 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:38:36.483826 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:38:36.483826 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:38:36.483826 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:38:36.483826 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:38:36.483826 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:38:36.483826 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:38:36.483826 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:38:36.483826 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:38:36.483826 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:38:36.483826 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:38:36.486105 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:38:36.486105 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:38:36.486105 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:38:36.486105 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:38:36.486105 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:38:36.486105 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:38:36.486105 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:38:36.486105 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:38:36.486105 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:38:36.486105 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:38:36.486105 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:38:36.486105 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:38:36.486105 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:38:36.486105 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:38:36.486105 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:38:36.486105 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:38:36.487793 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:38:36.487793 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:38:36.487793 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:38:36.487793 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:38:36.487793 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:38:36.487793 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:38:36.487793 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:38:36.487793 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:38:36.487793 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:38:36.487793 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:38:36.487793 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 14 17:38:36.487793 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:38:36.489081 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ebb164-0ea4-4644-a287-88f5018d02be None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:36.489215 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 518/1035] 10.222.0.36 () {56 vars in 1120 bytes} [Tue Jun 14 17:38:36 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 17:38:36.492069 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecf68f3-5fb8-43b0-991d-a992f2d6a52b None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:36.492389 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecf68f3-5fb8-43b0-991d-a992f2d6a52b None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:36.492637 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecf68f3-5fb8-43b0-991d-a992f2d6a52b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:36.510740 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-2ecf68f3-5fb8-43b0-991d-a992f2d6a52b None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:38:36.511992 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-2ecf68f3-5fb8-43b0-991d-a992f2d6a52b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:38:36.514294 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:36.590929 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 519/1036] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:38:36 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 14 17:38:36.591724 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecf68f3-5fb8-43b0-991d-a992f2d6a52b None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:36.651658 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ebb164-0ea4-4644-a287-88f5018d02be None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:36.663252 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:36.691442 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df92b9fa-53ab-42d5-bc47-255f1c4f94a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:36.692055 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df92b9fa-53ab-42d5-bc47-255f1c4f94a9 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:36.692348 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df92b9fa-53ab-42d5-bc47-255f1c4f94a9 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:36.692630 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df92b9fa-53ab-42d5-bc47-255f1c4f94a9 None admin] PATH_INFO: `/v3/services` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:36.693356 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df92b9fa-53ab-42d5-bc47-255f1c4f94a9 None admin] RBAC: Adding query filter params (type=image) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:36.693955 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df92b9fa-53ab-42d5-bc47-255f1c4f94a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:36.695920 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df92b9fa-53ab-42d5-bc47-255f1c4f94a9 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:36.701546 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 518/1037] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 14 17:38:36 2022] GET /identity/v3/services?type=image => generated 350 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:36.702381 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df92b9fa-53ab-42d5-bc47-255f1c4f94a9 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:36.721520 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecf68f3-5fb8-43b0-991d-a992f2d6a52b None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:36.768181 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eab381-fddd-49f9-884d-05b9152cd471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:36.768891 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eab381-fddd-49f9-884d-05b9152cd471 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:36.769174 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eab381-fddd-49f9-884d-05b9152cd471 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:36.769456 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eab381-fddd-49f9-884d-05b9152cd471 None admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:36.770253 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04eab381-fddd-49f9-884d-05b9152cd471 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:36.770560 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04eab381-fddd-49f9-884d-05b9152cd471 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:36.772037 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04eab381-fddd-49f9-884d-05b9152cd471 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:36.778659 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:36.783164 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 520/1038] 10.222.0.36 () {56 vars in 1115 bytes} [Tue Jun 14 17:38:36 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:36.784248 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eab381-fddd-49f9-884d-05b9152cd471 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:36.847564 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df92b9fa-53ab-42d5-bc47-255f1c4f94a9 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:36.889619 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d785fe-bf2d-43d3-9ee0-e575a4cfd6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:36.889619 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d785fe-bf2d-43d3-9ee0-e575a4cfd6bb None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:36.889619 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d785fe-bf2d-43d3-9ee0-e575a4cfd6bb None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:36.889619 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d785fe-bf2d-43d3-9ee0-e575a4cfd6bb None admin] PATH_INFO: `/v3/domains/default` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:36.893139 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d785fe-bf2d-43d3-9ee0-e575a4cfd6bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:36.893139 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d785fe-bf2d-43d3-9ee0-e575a4cfd6bb None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:36.894893 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 519/1039] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 14 17:38:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:36.895747 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d785fe-bf2d-43d3-9ee0-e575a4cfd6bb None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:36.938429 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eab381-fddd-49f9-884d-05b9152cd471 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:36.950415 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:37.001501 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b234727-44ca-4986-81d1-dc0a1bb30f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:37.002640 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b234727-44ca-4986-81d1-dc0a1bb30f4b None admin] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:37.003158 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b234727-44ca-4986-81d1-dc0a1bb30f4b None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:37.003675 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b234727-44ca-4986-81d1-dc0a1bb30f4b None admin] PATH_INFO: `/v3/endpoints` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:37.005248 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b234727-44ca-4986-81d1-dc0a1bb30f4b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:37.007883 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b234727-44ca-4986-81d1-dc0a1bb30f4b None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:37.019504 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d785fe-bf2d-43d3-9ee0-e575a4cfd6bb None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:37.057214 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce101af-e87b-4ca3-a726-361649c53291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:37.058028 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce101af-e87b-4ca3-a726-361649c53291 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:37.058319 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce101af-e87b-4ca3-a726-361649c53291 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:37.058600 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce101af-e87b-4ca3-a726-361649c53291 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:37.070728 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce101af-e87b-4ca3-a726-361649c53291 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:37.072278 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce101af-e87b-4ca3-a726-361649c53291 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:37.089872 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 521/1040] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Jun 14 17:38:36 2022] POST /identity/v3/endpoints => generated 327 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:38:37.090809 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b234727-44ca-4986-81d1-dc0a1bb30f4b None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:37.097978 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-bce101af-e87b-4ca3-a726-361649c53291 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:38:37.097978 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:37.097978 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:38:37.097978 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:38:37.097978 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:38:37.097978 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:38:37.097978 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:38:37.097978 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:38:37.097978 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:38:37.097978 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:38:37.097978 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:38:37.097978 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:38:37.097978 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:38:37.097978 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:38:37.097978 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:38:37.099039 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:38:37.099039 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:38:37.099039 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:38:37.099039 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:38:37.099039 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:38:37.099039 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:38:37.099039 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:38:37.099039 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:38:37.099039 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:38:37.099039 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:38:37.099039 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:38:37.099039 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:38:37.099039 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:38:37.099039 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:38:37.099039 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:38:37.099039 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:38:37.099039 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:38:37.100528 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:38:37.100528 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:38:37.100528 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:38:37.100528 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:38:37.100528 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 520/1041] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 14 17:38:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:38:37.108250 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce101af-e87b-4ca3-a726-361649c53291 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:37.193696 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:37.261507 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:37.277429 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b234727-44ca-4986-81d1-dc0a1bb30f4b None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:37.278993 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce101af-e87b-4ca3-a726-361649c53291 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:37.321841 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be118dc4-fadd-46da-9b66-9580956bc972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:37.322518 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be118dc4-fadd-46da-9b66-9580956bc972 None admin] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:37.323277 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be118dc4-fadd-46da-9b66-9580956bc972 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:37.323659 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be118dc4-fadd-46da-9b66-9580956bc972 None admin] PATH_INFO: `/v3/users` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:37.324387 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be118dc4-fadd-46da-9b66-9580956bc972 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:37.325837 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be118dc4-fadd-46da-9b66-9580956bc972 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:37.350135 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bbdafa-9cdb-445e-9ef3-20dbda9bfac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:37.350874 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bbdafa-9cdb-445e-9ef3-20dbda9bfac8 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:37.351160 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bbdafa-9cdb-445e-9ef3-20dbda9bfac8 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:37.352985 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bbdafa-9cdb-445e-9ef3-20dbda9bfac8 None admin] PATH_INFO: `/v3/domains` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:37.352985 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bbdafa-9cdb-445e-9ef3-20dbda9bfac8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:37.352985 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bbdafa-9cdb-445e-9ef3-20dbda9bfac8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:37.354167 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bbdafa-9cdb-445e-9ef3-20dbda9bfac8 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:37.373528 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 521/1042] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 14 17:38:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:38:37.381893 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bbdafa-9cdb-445e-9ef3-20dbda9bfac8 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:37.437504 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 522/1043] 10.222.0.36 () {60 vars in 1132 bytes} [Tue Jun 14 17:38:37 2022] POST /identity/v3/users => generated 285 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:38:37.590220 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bbdafa-9cdb-445e-9ef3-20dbda9bfac8 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:37.647557 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c673ae97-dfd9-4142-bb48-2d43a6110197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:37.648389 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c673ae97-dfd9-4142-bb48-2d43a6110197 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:37.648666 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c673ae97-dfd9-4142-bb48-2d43a6110197 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:37.648945 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c673ae97-dfd9-4142-bb48-2d43a6110197 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:37.659399 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c673ae97-dfd9-4142-bb48-2d43a6110197 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:37.660947 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c673ae97-dfd9-4142-bb48-2d43a6110197 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:37.678340 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-c673ae97-dfd9-4142-bb48-2d43a6110197 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 14 17:38:37.678340 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:37.678340 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:38:37.678340 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:38:37.678340 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:38:37.678340 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:38:37.678340 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:38:37.678340 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:38:37.678340 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:38:37.678340 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:38:37.678340 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:38:37.678340 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:38:37.678340 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 14 17:38:37.678340 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 14 17:38:37.678340 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 14 17:38:37.678340 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 14 17:38:37.680536 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:38:37.680536 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:38:37.680536 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 14 17:38:37.680536 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:38:37.680536 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 14 17:38:37.680536 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:38:37.680536 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:38:37.680536 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:38:37.680536 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:38:37.680536 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:38:37.680536 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:38:37.680536 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:38:37.680536 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:38:37.680536 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:38:37.680536 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:38:37.680536 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:38:37.680536 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:38:37.680536 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:38:37.682679 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:38:37.682679 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:38:37.682679 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 14 17:38:37.682679 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 14 17:38:37.682679 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 14 17:38:37.682679 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 14 17:38:37.682679 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 14 17:38:37.682679 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 14 17:38:37.682679 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 14 17:38:37.682679 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:38:37.682679 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 522/1044] 10.222.0.36 () {56 vars in 1093 bytes} [Tue Jun 14 17:38:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 17:38:37.688956 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be118dc4-fadd-46da-9b66-9580956bc972 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:37.852845 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be118dc4-fadd-46da-9b66-9580956bc972 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:37.870548 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:37.917131 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baf2159-1ba7-4c7b-9ae6-7647809a7938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:37.918265 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baf2159-1ba7-4c7b-9ae6-7647809a7938 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:37.918839 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baf2159-1ba7-4c7b-9ae6-7647809a7938 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:37.919459 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baf2159-1ba7-4c7b-9ae6-7647809a7938 None admin] PATH_INFO: `/v3/users` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:37.921064 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baf2159-1ba7-4c7b-9ae6-7647809a7938 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:37.922492 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baf2159-1ba7-4c7b-9ae6-7647809a7938 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:37.925298 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baf2159-1ba7-4c7b-9ae6-7647809a7938 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:37.964631 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 523/1045] 10.222.0.36 () {56 vars in 1133 bytes} [Tue Jun 14 17:38:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:37.966389 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c673ae97-dfd9-4142-bb48-2d43a6110197 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:37.995504 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:38.162322 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c673ae97-dfd9-4142-bb48-2d43a6110197 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:38.226641 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09559bbd-7640-4b5a-8b7f-8c5b7dbbfe69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:38.227846 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09559bbd-7640-4b5a-8b7f-8c5b7dbbfe69 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:38.228348 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09559bbd-7640-4b5a-8b7f-8c5b7dbbfe69 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:38.228831 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09559bbd-7640-4b5a-8b7f-8c5b7dbbfe69 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:38.362091 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09559bbd-7640-4b5a-8b7f-8c5b7dbbfe69 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:38.364655 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09559bbd-7640-4b5a-8b7f-8c5b7dbbfe69 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:38.391502 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:38.495877 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 523/1046] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 14 17:38:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 530 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 14 17:38:38.503353 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baf2159-1ba7-4c7b-9ae6-7647809a7938 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:38.658510 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baf2159-1ba7-4c7b-9ae6-7647809a7938 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:38.699433 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e52714-27df-48cb-bd6b-dda93ee9b4b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:38.700240 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e52714-27df-48cb-bd6b-dda93ee9b4b2 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:38.700526 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e52714-27df-48cb-bd6b-dda93ee9b4b2 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:38.700819 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e52714-27df-48cb-bd6b-dda93ee9b4b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:38.719844 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e52714-27df-48cb-bd6b-dda93ee9b4b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:38.722516 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e52714-27df-48cb-bd6b-dda93ee9b4b2 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:38.757150 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-a0e52714-27df-48cb-bd6b-dda93ee9b4b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:38:38.757150 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:38.757150 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:38:38.757150 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:38:38.757150 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:38:38.757150 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:38:38.757150 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:38:38.757150 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:38:38.757150 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:38:38.757150 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:38:38.757150 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:38:38.757150 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:38:38.757150 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:38:38.757150 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:38:38.757150 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:38:38.758931 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:38:38.758931 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:38:38.758931 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:38:38.758931 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:38:38.758931 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:38:38.758931 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:38:38.758931 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:38:38.758931 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:38:38.758931 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:38:38.758931 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:38:38.758931 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:38:38.758931 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:38:38.758931 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:38:38.758931 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:38:38.758931 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:38:38.758931 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:38:38.758931 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:38:38.761972 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:38:38.761972 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:38:38.761972 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:38:38.761972 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:38:38.761972 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 524/1047] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 14 17:38:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:38:38.765953 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09559bbd-7640-4b5a-8b7f-8c5b7dbbfe69 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:38.900559 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09559bbd-7640-4b5a-8b7f-8c5b7dbbfe69 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:38.923785 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:38.966585 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fce4c04-b162-4167-9250-13103b2bdcb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:38.968895 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fce4c04-b162-4167-9250-13103b2bdcb3 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:38.969961 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fce4c04-b162-4167-9250-13103b2bdcb3 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:38.969961 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fce4c04-b162-4167-9250-13103b2bdcb3 None admin] PATH_INFO: `/v3/domains` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:38.970608 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fce4c04-b162-4167-9250-13103b2bdcb3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:38.970967 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fce4c04-b162-4167-9250-13103b2bdcb3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:38.973039 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fce4c04-b162-4167-9250-13103b2bdcb3 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:38.996899 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 524/1048] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 14 17:38:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:38:38.998609 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e52714-27df-48cb-bd6b-dda93ee9b4b2 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:39.027369 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:39.173462 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e52714-27df-48cb-bd6b-dda93ee9b4b2 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:39.236833 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0749714-2f97-4b7a-9efb-e9ebeaf6fcf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:39.238138 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0749714-2f97-4b7a-9efb-e9ebeaf6fcf1 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:39.238632 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0749714-2f97-4b7a-9efb-e9ebeaf6fcf1 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:39.239099 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0749714-2f97-4b7a-9efb-e9ebeaf6fcf1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:39.250924 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0749714-2f97-4b7a-9efb-e9ebeaf6fcf1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:39.253558 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0749714-2f97-4b7a-9efb-e9ebeaf6fcf1 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:39.277260 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-e0749714-2f97-4b7a-9efb-e9ebeaf6fcf1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:38:39.277260 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:39.277260 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:38:39.277260 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:38:39.277260 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:38:39.277260 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:38:39.277260 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:38:39.277260 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:38:39.277260 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:38:39.277260 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:38:39.277260 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:38:39.277260 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:38:39.277260 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 14 17:38:39.277260 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 14 17:38:39.277260 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 14 17:38:39.279129 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 14 17:38:39.279129 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:38:39.279129 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:38:39.279129 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:38:39.279129 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:38:39.279129 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:38:39.279129 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:38:39.279129 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:38:39.279129 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:38:39.279129 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:38:39.279129 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:38:39.279129 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:38:39.279129 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:38:39.279129 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:38:39.279129 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:38:39.279129 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:38:39.279129 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:38:39.281609 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 14 17:38:39.281609 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 14 17:38:39.281609 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 14 17:38:39.281609 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 14 17:38:39.281609 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 14 17:38:39.281609 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 14 17:38:39.281609 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:38:39.281609 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:38:39.287663 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fce4c04-b162-4167-9250-13103b2bdcb3 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:39.288323 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 525/1049] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 14 17:38:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:38:39.479502 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fce4c04-b162-4167-9250-13103b2bdcb3 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:39.550590 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77705c82-2a5b-4946-a1f3-791efc0a6c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:39.551717 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77705c82-2a5b-4946-a1f3-791efc0a6c93 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:39.552281 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77705c82-2a5b-4946-a1f3-791efc0a6c93 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:39.552795 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77705c82-2a5b-4946-a1f3-791efc0a6c93 None admin] PATH_INFO: `/v3/projects` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:39.554363 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77705c82-2a5b-4946-a1f3-791efc0a6c93 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:39.554930 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77705c82-2a5b-4946-a1f3-791efc0a6c93 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:39.557790 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77705c82-2a5b-4946-a1f3-791efc0a6c93 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:39.589102 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 525/1050] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jun 14 17:38:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:39.591464 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0749714-2f97-4b7a-9efb-e9ebeaf6fcf1 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:39.716855 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:39.741839 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0749714-2f97-4b7a-9efb-e9ebeaf6fcf1 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:39.785085 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b94894-0c2e-4948-839d-282bd9fb32ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:39.785942 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b94894-0c2e-4948-839d-282bd9fb32ce None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:39.786359 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b94894-0c2e-4948-839d-282bd9fb32ce None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:39.786786 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b94894-0c2e-4948-839d-282bd9fb32ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:39.787856 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b94894-0c2e-4948-839d-282bd9fb32ce None admin] RBAC: Adding query filter params (role.id=dca59aef7b5d4641b6c146c9be77d2fe, scope.project.id=f3e1d023a52c42b98d018617987ef83c, user.id=e4696d396adb495ab300a9a5a5727595) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:39.788181 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b94894-0c2e-4948-839d-282bd9fb32ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:39.789638 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b94894-0c2e-4948-839d-282bd9fb32ce None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:39.803691 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 526/1051] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 14 17:38:39 2022] GET /identity/v3/role_assignments?user.id=e4696d396adb495ab300a9a5a5727595&scope.project.id=f3e1d023a52c42b98d018617987ef83c&role.id=dca59aef7b5d4641b6c146c9be77d2fe => generated 259 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:39.968014 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ac2551-844b-43be-a848-ba9db63ff9b1 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:39.968825 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ac2551-844b-43be-a848-ba9db63ff9b1 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:39.969145 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ac2551-844b-43be-a848-ba9db63ff9b1 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:39.972497 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 526/1052] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:38:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:38:39.981456 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b936e4dc-7853-4511-a3ad-aabc681ac528 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:39.981955 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b936e4dc-7853-4511-a3ad-aabc681ac528 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:39.982455 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b936e4dc-7853-4511-a3ad-aabc681ac528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:40.013095 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-b936e4dc-7853-4511-a3ad-aabc681ac528 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:38:40.016055 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-b936e4dc-7853-4511-a3ad-aabc681ac528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:38:40.075077 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f22762-a57f-4ad0-b587-311dd402fa45 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:40.075525 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f22762-a57f-4ad0-b587-311dd402fa45 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:40.075676 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f22762-a57f-4ad0-b587-311dd402fa45 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:40.077258 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 527/1053] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:38:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 14 17:38:40.083568 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e897d08-7995-44b4-8bbc-b8641e41bf91 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:40.083868 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e897d08-7995-44b4-8bbc-b8641e41bf91 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:40.084170 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e897d08-7995-44b4-8bbc-b8641e41bf91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:40.103914 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-1e897d08-7995-44b4-8bbc-b8641e41bf91 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:38:40.105207 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-1e897d08-7995-44b4-8bbc-b8641e41bf91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:38:40.136436 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:40.152295 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 527/1054] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:38:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 17:38:40.191374 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 528/1055] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:38:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 14 17:38:40.193768 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b936e4dc-7853-4511-a3ad-aabc681ac528 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:40.212259 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e897d08-7995-44b4-8bbc-b8641e41bf91 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:40.328812 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:40.342489 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e897d08-7995-44b4-8bbc-b8641e41bf91 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:40.380042 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b936e4dc-7853-4511-a3ad-aabc681ac528 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:40.402367 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404297ff-7609-4fcc-937b-16ac984bcaca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:40.403187 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404297ff-7609-4fcc-937b-16ac984bcaca None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:40.403508 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404297ff-7609-4fcc-937b-16ac984bcaca None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:40.403797 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404297ff-7609-4fcc-937b-16ac984bcaca None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:40.417611 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404297ff-7609-4fcc-937b-16ac984bcaca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:38:40.426472 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-404297ff-7609-4fcc-937b-16ac984bcaca None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 17:38:40.426472 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:40.426472 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:38:40.426472 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:38:40.426472 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:38:40.426472 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:38:40.426472 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:38:40.426472 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:38:40.426472 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:38:40.426472 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:38:40.426472 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:38:40.426472 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:38:40.426472 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:38:40.426472 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:38:40.426472 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:38:40.426472 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:38:40.428605 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:38:40.428605 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:38:40.428605 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:38:40.428605 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:38:40.428605 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:38:40.428605 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:38:40.428605 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:38:40.428605 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:38:40.428605 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:38:40.428605 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:38:40.428605 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:38:40.428605 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:38:40.428605 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:38:40.428605 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:38:40.428605 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:38:40.428605 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:38:40.430217 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:38:40.430217 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:38:40.430217 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:38:40.430217 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:38:40.430217 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:38:40.430217 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:38:40.430217 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:38:40.430217 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:38:40.430217 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:38:40.430217 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:38:40.430217 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 17:38:40.430217 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:38:40.430217 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 529/1056] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jun 14 17:38:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 17:38:40.437932 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404297ff-7609-4fcc-937b-16ac984bcaca None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:40.443684 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a0032e-571d-477c-943a-043572a84fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:40.444357 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a0032e-571d-477c-943a-043572a84fe1 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:40.444645 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a0032e-571d-477c-943a-043572a84fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:40.444926 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a0032e-571d-477c-943a-043572a84fe1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:40.488494 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:40.556116 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a0032e-571d-477c-943a-043572a84fe1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:40.558293 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a0032e-571d-477c-943a-043572a84fe1 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:40.624959 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404297ff-7609-4fcc-937b-16ac984bcaca None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:40.677816 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:40.681067 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d21f05-f769-463a-a1aa-2543485f3a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:40.681772 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d21f05-f769-463a-a1aa-2543485f3a9c None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:40.682059 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d21f05-f769-463a-a1aa-2543485f3a9c None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:40.682343 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d21f05-f769-463a-a1aa-2543485f3a9c None admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:40.683118 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d21f05-f769-463a-a1aa-2543485f3a9c None admin] RBAC: Adding query filter params (name=admin) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:40.683473 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d21f05-f769-463a-a1aa-2543485f3a9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:40.684903 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d21f05-f769-463a-a1aa-2543485f3a9c None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:40.696048 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 530/1057] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 14 17:38:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:38:40.701712 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d21f05-f769-463a-a1aa-2543485f3a9c None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:40.740295 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 528/1058] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 14 17:38:40 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 548 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 14 17:38:40.750607 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a0032e-571d-477c-943a-043572a84fe1 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:40.842478 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:40.869554 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d21f05-f769-463a-a1aa-2543485f3a9c None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:40.926103 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a0032e-571d-477c-943a-043572a84fe1 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:40.929473 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5904c1f-848f-4bdd-a3a2-97ce247d8710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:40.930853 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5904c1f-848f-4bdd-a3a2-97ce247d8710 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:40.931263 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5904c1f-848f-4bdd-a3a2-97ce247d8710 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:40.931699 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5904c1f-848f-4bdd-a3a2-97ce247d8710 None admin] PATH_INFO: `/v3/users/ed2378e926c54d79aed7eeee87a23202` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:40.960288 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5904c1f-848f-4bdd-a3a2-97ce247d8710 None admin] RBAC: Authorizing `identity:get_user(user_id=ed2378e926c54d79aed7eeee87a23202)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:40.962026 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5904c1f-848f-4bdd-a3a2-97ce247d8710 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:40.964239 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 531/1059] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 14 17:38:40 2022] GET /identity/v3/users/ed2378e926c54d79aed7eeee87a23202 => generated 285 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:38:40.974053 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5904c1f-848f-4bdd-a3a2-97ce247d8710 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:40.988482 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b7aefd-0491-4d16-8c66-9c61d260afb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:40.989774 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b7aefd-0491-4d16-8c66-9c61d260afb9 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:40.990273 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b7aefd-0491-4d16-8c66-9c61d260afb9 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:40.990926 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b7aefd-0491-4d16-8c66-9c61d260afb9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:41.011102 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b7aefd-0491-4d16-8c66-9c61d260afb9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:41.013717 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b7aefd-0491-4d16-8c66-9c61d260afb9 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:41.049037 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-54b7aefd-0491-4d16-8c66-9c61d260afb9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:38:41.049037 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:41.049037 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:38:41.049037 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:38:41.049037 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:38:41.049037 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:38:41.049037 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:38:41.049037 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:38:41.049037 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:38:41.049037 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:38:41.049037 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:38:41.049037 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:38:41.049037 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:38:41.049037 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:38:41.049037 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:38:41.050938 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:38:41.050938 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:38:41.050938 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:38:41.050938 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:38:41.050938 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:38:41.050938 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:38:41.050938 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:38:41.050938 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:38:41.050938 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:38:41.050938 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:38:41.050938 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:38:41.050938 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:38:41.050938 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:38:41.050938 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:38:41.050938 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:38:41.050938 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:38:41.050938 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:38:41.056647 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:38:41.056647 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:38:41.056647 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:38:41.056647 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:38:41.056647 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 529/1060] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 14 17:38:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:38:41.058393 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b7aefd-0491-4d16-8c66-9c61d260afb9 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:41.100918 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:41.141361 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5904c1f-848f-4bdd-a3a2-97ce247d8710 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:41.201557 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c899c042-5dd6-4a2b-a497-ba8ea9f8a6dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:41.202637 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c899c042-5dd6-4a2b-a497-ba8ea9f8a6dc None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:41.202998 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c899c042-5dd6-4a2b-a497-ba8ea9f8a6dc None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:41.203449 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c899c042-5dd6-4a2b-a497-ba8ea9f8a6dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:41.217400 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b7aefd-0491-4d16-8c66-9c61d260afb9 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:41.225035 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:41.287978 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5569db33-91b9-4f0c-9d78-6cd4f67dc922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:41.289008 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5569db33-91b9-4f0c-9d78-6cd4f67dc922 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:41.289496 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5569db33-91b9-4f0c-9d78-6cd4f67dc922 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:41.289980 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5569db33-91b9-4f0c-9d78-6cd4f67dc922 None admin] PATH_INFO: `/v3/domains` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:41.291156 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5569db33-91b9-4f0c-9d78-6cd4f67dc922 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:41.291717 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5569db33-91b9-4f0c-9d78-6cd4f67dc922 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:41.294087 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5569db33-91b9-4f0c-9d78-6cd4f67dc922 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:41.313797 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 530/1061] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 14 17:38:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:38:41.317917 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c899c042-5dd6-4a2b-a497-ba8ea9f8a6dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:41.320838 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c899c042-5dd6-4a2b-a497-ba8ea9f8a6dc None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:41.509690 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 532/1062] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 14 17:38:40 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 536 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 14 17:38:41.519965 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5569db33-91b9-4f0c-9d78-6cd4f67dc922 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:41.668811 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:41.695058 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5569db33-91b9-4f0c-9d78-6cd4f67dc922 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:41.756559 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fbbdf9-5d61-4d66-93ad-ce227f545c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:41.758082 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fbbdf9-5d61-4d66-93ad-ce227f545c19 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:41.758604 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fbbdf9-5d61-4d66-93ad-ce227f545c19 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:41.759101 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fbbdf9-5d61-4d66-93ad-ce227f545c19 None admin] PATH_INFO: `/v3/projects/c71c7ac5cbbb452b8172ef3edbbf80dc` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:41.761315 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fbbdf9-5d61-4d66-93ad-ce227f545c19 None admin] RBAC: Authorizing `identity:get_project(project_id=c71c7ac5cbbb452b8172ef3edbbf80dc)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:41.763910 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fbbdf9-5d61-4d66-93ad-ce227f545c19 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:41.767966 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 531/1063] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 14 17:38:41 2022] GET /identity/v3/projects/c71c7ac5cbbb452b8172ef3edbbf80dc => generated 311 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:41.777783 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c899c042-5dd6-4a2b-a497-ba8ea9f8a6dc None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:41.830020 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:41.902151 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c899c042-5dd6-4a2b-a497-ba8ea9f8a6dc None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:41.947953 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ef1b17-4a27-4f8b-a7a3-75c45c508fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:41.948721 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ef1b17-4a27-4f8b-a7a3-75c45c508fbc None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:41.949072 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ef1b17-4a27-4f8b-a7a3-75c45c508fbc None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:41.949419 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ef1b17-4a27-4f8b-a7a3-75c45c508fbc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:41.950358 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ef1b17-4a27-4f8b-a7a3-75c45c508fbc None admin] RBAC: Adding query filter params (role.id=1348580877d04014bfdec4d866b98a74, scope.project.id=c71c7ac5cbbb452b8172ef3edbbf80dc, user.id=ed2378e926c54d79aed7eeee87a23202) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:41.950821 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ef1b17-4a27-4f8b-a7a3-75c45c508fbc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:41.952856 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ef1b17-4a27-4f8b-a7a3-75c45c508fbc None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:41.959857 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 533/1064] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 14 17:38:41 2022] GET /identity/v3/role_assignments?user.id=ed2378e926c54d79aed7eeee87a23202&scope.project.id=c71c7ac5cbbb452b8172ef3edbbf80dc&role.id=1348580877d04014bfdec4d866b98a74 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:42.262164 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1536dd7d-0e90-4f94-8b74-f61b5038aa40 None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:42.262927 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1536dd7d-0e90-4f94-8b74-f61b5038aa40 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:42.262927 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1536dd7d-0e90-4f94-8b74-f61b5038aa40 None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:42.264303 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 532/1065] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:38:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:38:42.270796 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bde391-a2d7-4f47-9f2c-441f904f581a None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:42.271660 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bde391-a2d7-4f47-9f2c-441f904f581a None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:42.271819 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bde391-a2d7-4f47-9f2c-441f904f581a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:42.290540 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-37bde391-a2d7-4f47-9f2c-441f904f581a None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:38:42.291980 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-37bde391-a2d7-4f47-9f2c-441f904f581a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:38:42.371701 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 534/1066] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:38:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 17:38:42.396659 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1536dd7d-0e90-4f94-8b74-f61b5038aa40 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:42.581851 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1536dd7d-0e90-4f94-8b74-f61b5038aa40 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:42.646542 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5ad650-ffc8-4ec3-b972-a74d5dce1417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:42.647993 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5ad650-ffc8-4ec3-b972-a74d5dce1417 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:42.648512 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5ad650-ffc8-4ec3-b972-a74d5dce1417 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:42.649024 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5ad650-ffc8-4ec3-b972-a74d5dce1417 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:42.668869 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5ad650-ffc8-4ec3-b972-a74d5dce1417 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:38:42.684264 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-cc5ad650-ffc8-4ec3-b972-a74d5dce1417 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 14 17:38:42.684264 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:42.684264 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:38:42.684264 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:38:42.684264 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:38:42.684264 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:38:42.684264 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:38:42.684264 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:38:42.684264 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:38:42.684264 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:38:42.684264 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:38:42.684264 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:38:42.684264 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:38:42.684264 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:38:42.684264 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:38:42.684264 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:38:42.685355 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:38:42.685355 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:38:42.685355 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:38:42.685355 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:38:42.685355 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:38:42.685355 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:38:42.685355 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:38:42.685355 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:38:42.685355 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:38:42.685355 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:38:42.685355 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:38:42.685355 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:38:42.685355 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:38:42.685355 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:38:42.685355 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:38:42.685355 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:38:42.686202 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:38:42.686202 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:38:42.686202 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:38:42.686202 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:38:42.686202 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:38:42.686202 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:38:42.686202 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:38:42.686202 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:38:42.686202 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:38:42.686202 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:38:42.686202 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 14 17:38:42.686202 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:38:42.687676 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 533/1067] 10.222.0.36 () {56 vars in 1120 bytes} [Tue Jun 14 17:38:42 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:38:42.696838 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bde391-a2d7-4f47-9f2c-441f904f581a None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:42.762925 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:42.863160 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bde391-a2d7-4f47-9f2c-441f904f581a None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:42.918642 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b513e55-f5b3-40e0-85c5-ae15f9a24306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:42.919908 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b513e55-f5b3-40e0-85c5-ae15f9a24306 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:42.920422 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b513e55-f5b3-40e0-85c5-ae15f9a24306 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:42.920911 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b513e55-f5b3-40e0-85c5-ae15f9a24306 None admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:42.923178 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b513e55-f5b3-40e0-85c5-ae15f9a24306 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:42.923745 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b513e55-f5b3-40e0-85c5-ae15f9a24306 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:42.926201 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b513e55-f5b3-40e0-85c5-ae15f9a24306 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:42.942301 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 535/1068] 10.222.0.36 () {56 vars in 1115 bytes} [Tue Jun 14 17:38:42 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:42.948146 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5ad650-ffc8-4ec3-b972-a74d5dce1417 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:42.965909 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:43.072676 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5ad650-ffc8-4ec3-b972-a74d5dce1417 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:43.115206 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aeab5c-042b-4261-9f2c-60809b3666ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:43.116104 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aeab5c-042b-4261-9f2c-60809b3666ab None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:43.116478 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aeab5c-042b-4261-9f2c-60809b3666ab None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:43.116848 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aeab5c-042b-4261-9f2c-60809b3666ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:43.130164 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aeab5c-042b-4261-9f2c-60809b3666ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:43.131814 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aeab5c-042b-4261-9f2c-60809b3666ab None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:43.153411 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-40aeab5c-042b-4261-9f2c-60809b3666ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:38:43.153411 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:43.153411 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:38:43.153411 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:38:43.153411 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:38:43.153411 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:38:43.153411 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:38:43.153411 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:38:43.153411 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:38:43.153411 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:38:43.153411 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:38:43.153411 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:38:43.153411 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:38:43.153411 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:38:43.153411 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:38:43.155235 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:38:43.155235 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:38:43.155235 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:38:43.155235 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:38:43.155235 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:38:43.155235 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:38:43.155235 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:38:43.155235 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:38:43.155235 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:38:43.155235 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:38:43.155235 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:38:43.155235 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:38:43.155235 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:38:43.155235 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:38:43.155235 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:38:43.155235 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:38:43.155235 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:38:43.156923 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:38:43.156923 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:38:43.156923 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:38:43.156923 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:38:43.156923 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 534/1069] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 14 17:38:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:38:43.164413 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b513e55-f5b3-40e0-85c5-ae15f9a24306 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:43.295641 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:43.301713 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b513e55-f5b3-40e0-85c5-ae15f9a24306 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:43.348536 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a879f1-0cbf-4767-a3c2-76457d2f9c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:43.349387 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a879f1-0cbf-4767-a3c2-76457d2f9c25 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:43.349737 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a879f1-0cbf-4767-a3c2-76457d2f9c25 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:43.350081 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a879f1-0cbf-4767-a3c2-76457d2f9c25 None admin] PATH_INFO: `/v3/domains` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:43.350956 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a879f1-0cbf-4767-a3c2-76457d2f9c25 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:43.351368 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a879f1-0cbf-4767-a3c2-76457d2f9c25 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:43.352869 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a879f1-0cbf-4767-a3c2-76457d2f9c25 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:43.368319 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 536/1070] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 14 17:38:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:43.374447 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aeab5c-042b-4261-9f2c-60809b3666ab None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:43.449824 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:43.493010 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aeab5c-042b-4261-9f2c-60809b3666ab None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:43.531954 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaf1e1b-f928-4078-8072-711a7e915ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:43.532759 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaf1e1b-f928-4078-8072-711a7e915ba8 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:43.533045 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaf1e1b-f928-4078-8072-711a7e915ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:43.533328 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaf1e1b-f928-4078-8072-711a7e915ba8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:43.542136 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaf1e1b-f928-4078-8072-711a7e915ba8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:43.543635 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaf1e1b-f928-4078-8072-711a7e915ba8 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:43.559916 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-dbaf1e1b-f928-4078-8072-711a7e915ba8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 14 17:38:43.559916 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:43.559916 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:38:43.559916 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:38:43.559916 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:38:43.559916 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:38:43.559916 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:38:43.559916 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:38:43.559916 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:38:43.559916 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:38:43.559916 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:38:43.559916 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:38:43.559916 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 14 17:38:43.559916 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 14 17:38:43.559916 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 14 17:38:43.559916 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 14 17:38:43.562556 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:38:43.562556 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:38:43.562556 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 14 17:38:43.562556 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:38:43.562556 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 14 17:38:43.562556 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:38:43.562556 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:38:43.562556 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:38:43.562556 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:38:43.562556 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:38:43.562556 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:38:43.562556 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:38:43.562556 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:38:43.562556 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:38:43.562556 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:38:43.562556 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:38:43.562556 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:38:43.562556 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:38:43.564693 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:38:43.564693 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:38:43.564693 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 14 17:38:43.564693 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 14 17:38:43.564693 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 14 17:38:43.564693 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 14 17:38:43.564693 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 14 17:38:43.564693 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 14 17:38:43.564693 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 14 17:38:43.564693 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:38:43.564693 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 535/1071] 10.222.0.36 () {56 vars in 1093 bytes} [Tue Jun 14 17:38:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:38:43.571041 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a879f1-0cbf-4767-a3c2-76457d2f9c25 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:43.688945 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a879f1-0cbf-4767-a3c2-76457d2f9c25 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:43.728896 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100923f0-5e1d-42fb-8220-93b9219207e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:43.729590 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100923f0-5e1d-42fb-8220-93b9219207e4 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:43.729872 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100923f0-5e1d-42fb-8220-93b9219207e4 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:43.730155 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100923f0-5e1d-42fb-8220-93b9219207e4 None admin] PATH_INFO: `/v3/users` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:43.731029 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100923f0-5e1d-42fb-8220-93b9219207e4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:43.731373 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100923f0-5e1d-42fb-8220-93b9219207e4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:43.733015 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100923f0-5e1d-42fb-8220-93b9219207e4 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:43.754362 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 537/1072] 10.222.0.36 () {56 vars in 1133 bytes} [Tue Jun 14 17:38:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:43.763238 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaf1e1b-f928-4078-8072-711a7e915ba8 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:43.881871 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaf1e1b-f928-4078-8072-711a7e915ba8 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:43.915252 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:43.929320 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bfa701-4e7a-48dc-a415-63f3e87771e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:43.930309 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bfa701-4e7a-48dc-a415-63f3e87771e7 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:43.930735 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bfa701-4e7a-48dc-a415-63f3e87771e7 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:43.931138 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bfa701-4e7a-48dc-a415-63f3e87771e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:43.947607 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bfa701-4e7a-48dc-a415-63f3e87771e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:43.949350 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bfa701-4e7a-48dc-a415-63f3e87771e7 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:43.971763 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-d6bfa701-4e7a-48dc-a415-63f3e87771e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:38:43.971763 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:43.971763 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:38:43.971763 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:38:43.971763 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:38:43.971763 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:38:43.971763 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:38:43.971763 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:38:43.971763 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:38:43.971763 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:38:43.971763 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:38:43.971763 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:38:43.971763 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:38:43.971763 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:38:43.971763 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:38:43.973522 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:38:43.973522 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:38:43.973522 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:38:43.973522 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:38:43.973522 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:38:43.973522 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:38:43.973522 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:38:43.973522 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:38:43.973522 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:38:43.973522 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:38:43.973522 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:38:43.973522 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:38:43.973522 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:38:43.973522 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:38:43.973522 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:38:43.973522 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:38:43.973522 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:38:43.975848 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:38:43.975848 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:38:43.975848 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:38:43.975848 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:38:43.975848 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 536/1073] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 14 17:38:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 17:38:43.981443 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100923f0-5e1d-42fb-8220-93b9219207e4 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:44.015542 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:44.151853 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100923f0-5e1d-42fb-8220-93b9219207e4 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:44.198865 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672d2f65-961d-434b-bc55-ec97c926e9ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:44.199508 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672d2f65-961d-434b-bc55-ec97c926e9ec None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:44.199798 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672d2f65-961d-434b-bc55-ec97c926e9ec None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:44.200086 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672d2f65-961d-434b-bc55-ec97c926e9ec None admin] PATH_INFO: `/v3/domains` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:44.200887 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672d2f65-961d-434b-bc55-ec97c926e9ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:44.201195 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672d2f65-961d-434b-bc55-ec97c926e9ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:44.203231 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672d2f65-961d-434b-bc55-ec97c926e9ec None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:44.218687 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 538/1074] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 14 17:38:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:44.225246 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bfa701-4e7a-48dc-a415-63f3e87771e7 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:44.256432 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a576f4ff-1c90-4c54-9101-d4328bdd5be9 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:44.256704 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a576f4ff-1c90-4c54-9101-d4328bdd5be9 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:44.257001 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a576f4ff-1c90-4c54-9101-d4328bdd5be9 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:44.258391 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 539/1075] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:38:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 14 17:38:44.264395 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6cdbb4-cee7-4038-a597-887fed8449eb None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:44.265657 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6cdbb4-cee7-4038-a597-887fed8449eb None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:44.266122 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6cdbb4-cee7-4038-a597-887fed8449eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:44.295326 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-5e6cdbb4-cee7-4038-a597-887fed8449eb None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:38:44.297767 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-5e6cdbb4-cee7-4038-a597-887fed8449eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:38:44.375624 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bfa701-4e7a-48dc-a415-63f3e87771e7 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:44.395908 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 540/1076] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:38:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 14 17:38:44.416871 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac1b09b-a947-4a00-8a35-811eedb32fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:44.417819 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac1b09b-a947-4a00-8a35-811eedb32fb9 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:44.418195 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac1b09b-a947-4a00-8a35-811eedb32fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:44.418581 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac1b09b-a947-4a00-8a35-811eedb32fb9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:44.422768 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6cdbb4-cee7-4038-a597-887fed8449eb None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:44.428354 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac1b09b-a947-4a00-8a35-811eedb32fb9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:44.429984 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac1b09b-a947-4a00-8a35-811eedb32fb9 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:44.432599 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:44.455156 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-cac1b09b-a947-4a00-8a35-811eedb32fb9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:38:44.455156 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:44.455156 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:38:44.455156 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:38:44.455156 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:38:44.455156 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:38:44.455156 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:38:44.455156 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:38:44.455156 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:38:44.455156 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:38:44.455156 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:38:44.455156 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:38:44.455156 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 14 17:38:44.455156 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 14 17:38:44.455156 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 14 17:38:44.457123 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 14 17:38:44.457123 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:38:44.457123 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:38:44.457123 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:38:44.457123 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:38:44.457123 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:38:44.457123 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:38:44.457123 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:38:44.457123 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:38:44.457123 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:38:44.457123 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:38:44.457123 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:38:44.457123 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:38:44.457123 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:38:44.457123 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:38:44.457123 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:38:44.457123 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:38:44.458878 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 14 17:38:44.458878 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 14 17:38:44.458878 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 14 17:38:44.458878 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 14 17:38:44.458878 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 14 17:38:44.458878 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 14 17:38:44.458878 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:38:44.458878 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:38:44.458878 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 537/1077] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 14 17:38:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:38:44.464176 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac1b09b-a947-4a00-8a35-811eedb32fb9 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:44.517721 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:44.578270 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6cdbb4-cee7-4038-a597-887fed8449eb None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:44.623222 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac1b09b-a947-4a00-8a35-811eedb32fb9 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:44.625902 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7c45df-ab93-4055-ab4e-f974a7cf8e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:44.626866 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7c45df-ab93-4055-ab4e-f974a7cf8e55 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:44.627261 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7c45df-ab93-4055-ab4e-f974a7cf8e55 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:44.627697 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7c45df-ab93-4055-ab4e-f974a7cf8e55 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:44.647868 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7c45df-ab93-4055-ab4e-f974a7cf8e55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:38:44.667864 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-8a7c45df-ab93-4055-ab4e-f974a7cf8e55 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 17:38:44.667864 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:44.667864 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:38:44.667864 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:38:44.667864 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:38:44.667864 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:38:44.667864 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:38:44.667864 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:38:44.667864 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:38:44.667864 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:38:44.667864 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:38:44.667864 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:38:44.667864 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:38:44.667864 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:38:44.667864 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:38:44.667864 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:38:44.669420 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:38:44.669420 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:38:44.669420 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:38:44.669420 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:38:44.669420 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:38:44.669420 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:38:44.669420 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:38:44.669420 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:38:44.669420 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:38:44.669420 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:38:44.669420 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:38:44.669420 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:38:44.669420 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:38:44.669420 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:38:44.669420 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:38:44.669420 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:38:44.670591 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:38:44.670591 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:38:44.670591 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:38:44.670591 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:38:44.670591 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:38:44.670591 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:38:44.670591 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:38:44.670591 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:38:44.670591 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:38:44.670591 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:38:44.670591 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 17:38:44.670591 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:38:44.670591 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 541/1078] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jun 14 17:38:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 17:38:44.678841 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7c45df-ab93-4055-ab4e-f974a7cf8e55 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:44.683427 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa72f1e-ad72-4978-a63a-5ce75dfe9df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:44.684270 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa72f1e-ad72-4978-a63a-5ce75dfe9df1 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:44.684675 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa72f1e-ad72-4978-a63a-5ce75dfe9df1 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:44.685044 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa72f1e-ad72-4978-a63a-5ce75dfe9df1 None admin] PATH_INFO: `/v3/projects` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:44.685946 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa72f1e-ad72-4978-a63a-5ce75dfe9df1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:44.686349 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa72f1e-ad72-4978-a63a-5ce75dfe9df1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:44.688537 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa72f1e-ad72-4978-a63a-5ce75dfe9df1 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:44.703281 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 538/1079] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jun 14 17:38:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:38:44.709508 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa72f1e-ad72-4978-a63a-5ce75dfe9df1 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:44.772344 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:44.818647 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7c45df-ab93-4055-ab4e-f974a7cf8e55 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:44.854650 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:44.862053 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa72f1e-ad72-4978-a63a-5ce75dfe9df1 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:44.871727 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69a5eff-c9f4-46d3-98bd-ad7b1399d193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:44.872555 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69a5eff-c9f4-46d3-98bd-ad7b1399d193 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:44.873020 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69a5eff-c9f4-46d3-98bd-ad7b1399d193 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:44.873446 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69a5eff-c9f4-46d3-98bd-ad7b1399d193 None admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:44.874934 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69a5eff-c9f4-46d3-98bd-ad7b1399d193 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:44.875413 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69a5eff-c9f4-46d3-98bd-ad7b1399d193 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:44.877437 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69a5eff-c9f4-46d3-98bd-ad7b1399d193 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:44.890081 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 542/1080] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 14 17:38:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:44.895019 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69a5eff-c9f4-46d3-98bd-ad7b1399d193 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:44.913589 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4327597b-3cef-44e0-945b-aae9ff3fdc05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:44.915210 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4327597b-3cef-44e0-945b-aae9ff3fdc05 None admin] REQUEST_METHOD: `PUT` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:44.915767 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4327597b-3cef-44e0-945b-aae9ff3fdc05 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:44.916260 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4327597b-3cef-44e0-945b-aae9ff3fdc05 None admin] PATH_INFO: `/v3/projects/f3e1d023a52c42b98d018617987ef83c/users/e4696d396adb495ab300a9a5a5727595/roles/dca59aef7b5d4641b6c146c9be77d2fe` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:44.919997 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4327597b-3cef-44e0-945b-aae9ff3fdc05 None admin] RBAC: Authorizing `identity:create_grant(project_id=f3e1d023a52c42b98d018617987ef83c, user_id=e4696d396adb495ab300a9a5a5727595, role_id=dca59aef7b5d4641b6c146c9be77d2fe)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:44.923754 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4327597b-3cef-44e0-945b-aae9ff3fdc05 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:44.986424 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 539/1081] 10.222.0.36 () {58 vars in 1439 bytes} [Tue Jun 14 17:38:44 2022] PUT /identity/v3/projects/f3e1d023a52c42b98d018617987ef83c/users/e4696d396adb495ab300a9a5a5727595/roles/dca59aef7b5d4641b6c146c9be77d2fe => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 17:38:45.040307 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69a5eff-c9f4-46d3-98bd-ad7b1399d193 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:45.077277 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:45.089078 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e6721f-e748-4e2c-88af-24a14fd0b2a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:45.090022 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e6721f-e748-4e2c-88af-24a14fd0b2a3 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:45.090420 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e6721f-e748-4e2c-88af-24a14fd0b2a3 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:45.090879 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e6721f-e748-4e2c-88af-24a14fd0b2a3 None admin] PATH_INFO: `/v3/users/ed2378e926c54d79aed7eeee87a23202` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:45.093840 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e6721f-e748-4e2c-88af-24a14fd0b2a3 None admin] RBAC: Authorizing `identity:get_user(user_id=ed2378e926c54d79aed7eeee87a23202)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:45.096403 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e6721f-e748-4e2c-88af-24a14fd0b2a3 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:45.099607 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 543/1082] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 14 17:38:44 2022] GET /identity/v3/users/ed2378e926c54d79aed7eeee87a23202 => generated 285 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:38:45.105650 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4327597b-3cef-44e0-945b-aae9ff3fdc05 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:45.256402 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4327597b-3cef-44e0-945b-aae9ff3fdc05 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:45.316291 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91576b9c-7b90-4db1-848a-de486afb6fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:45.317675 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91576b9c-7b90-4db1-848a-de486afb6fbe None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:45.318149 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91576b9c-7b90-4db1-848a-de486afb6fbe None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:45.318628 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91576b9c-7b90-4db1-848a-de486afb6fbe None admin] PATH_INFO: `/v3/projects/c71c7ac5cbbb452b8172ef3edbbf80dc` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:45.320736 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91576b9c-7b90-4db1-848a-de486afb6fbe None admin] RBAC: Authorizing `identity:get_project(project_id=c71c7ac5cbbb452b8172ef3edbbf80dc)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:45.323278 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91576b9c-7b90-4db1-848a-de486afb6fbe None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:45.332156 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 540/1083] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 14 17:38:45 2022] GET /identity/v3/projects/c71c7ac5cbbb452b8172ef3edbbf80dc => generated 311 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:38:45.334039 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e6721f-e748-4e2c-88af-24a14fd0b2a3 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:45.515663 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e6721f-e748-4e2c-88af-24a14fd0b2a3 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:45.573725 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac61d4e7-68ca-4628-a0df-b7e13abb38ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:45.575170 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac61d4e7-68ca-4628-a0df-b7e13abb38ec None admin] REQUEST_METHOD: `PUT` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:45.575545 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac61d4e7-68ca-4628-a0df-b7e13abb38ec None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:45.575855 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac61d4e7-68ca-4628-a0df-b7e13abb38ec None admin] PATH_INFO: `/v3/projects/c71c7ac5cbbb452b8172ef3edbbf80dc/users/ed2378e926c54d79aed7eeee87a23202/roles/1348580877d04014bfdec4d866b98a74` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:45.579231 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac61d4e7-68ca-4628-a0df-b7e13abb38ec None admin] RBAC: Authorizing `identity:create_grant(project_id=c71c7ac5cbbb452b8172ef3edbbf80dc, user_id=ed2378e926c54d79aed7eeee87a23202, role_id=1348580877d04014bfdec4d866b98a74)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:45.580727 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac61d4e7-68ca-4628-a0df-b7e13abb38ec None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:45.638358 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 544/1084] 10.222.0.36 () {58 vars in 1439 bytes} [Tue Jun 14 17:38:45 2022] PUT /identity/v3/projects/c71c7ac5cbbb452b8172ef3edbbf80dc/users/ed2378e926c54d79aed7eeee87a23202/roles/1348580877d04014bfdec4d866b98a74 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:38:47.392857 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf44682f-7607-43e6-a2b5-3c1dea71774f None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:47.393772 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf44682f-7607-43e6-a2b5-3c1dea71774f None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:47.393772 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf44682f-7607-43e6-a2b5-3c1dea71774f None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:47.395463 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 541/1085] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:38:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:38:47.403903 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90cc0ee-eeb5-41bd-ae13-715457d709de None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:47.404755 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90cc0ee-eeb5-41bd-ae13-715457d709de None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:47.404755 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90cc0ee-eeb5-41bd-ae13-715457d709de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:47.426157 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-a90cc0ee-eeb5-41bd-ae13-715457d709de None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:38:47.427561 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-a90cc0ee-eeb5-41bd-ae13-715457d709de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:38:47.492386 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:47.513029 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 545/1086] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:38:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 17:38:47.557530 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf44682f-7607-43e6-a2b5-3c1dea71774f None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:47.591926 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:47.692938 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf44682f-7607-43e6-a2b5-3c1dea71774f None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:47.734315 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b5517a-fa43-44e9-952a-1d4bd7a63356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:47.735137 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b5517a-fa43-44e9-952a-1d4bd7a63356 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:47.735456 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b5517a-fa43-44e9-952a-1d4bd7a63356 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:47.735735 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b5517a-fa43-44e9-952a-1d4bd7a63356 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:47.747769 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b5517a-fa43-44e9-952a-1d4bd7a63356 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:38:47.756686 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-63b5517a-fa43-44e9-952a-1d4bd7a63356 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 14 17:38:47.756686 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:47.756686 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:38:47.756686 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:38:47.756686 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:38:47.756686 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:38:47.756686 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:38:47.756686 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:38:47.756686 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:38:47.756686 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:38:47.756686 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:38:47.756686 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:38:47.756686 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:38:47.756686 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:38:47.756686 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:38:47.756686 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:38:47.758769 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:38:47.758769 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:38:47.758769 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:38:47.758769 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:38:47.758769 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:38:47.758769 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:38:47.758769 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:38:47.758769 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:38:47.758769 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:38:47.758769 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:38:47.758769 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:38:47.758769 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:38:47.758769 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:38:47.758769 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:38:47.758769 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:38:47.758769 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:38:47.760511 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:38:47.760511 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:38:47.760511 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:38:47.760511 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:38:47.760511 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:38:47.760511 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:38:47.760511 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:38:47.760511 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:38:47.760511 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:38:47.760511 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:38:47.760511 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 14 17:38:47.760511 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:38:47.760511 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 542/1087] 10.222.0.36 () {56 vars in 1120 bytes} [Tue Jun 14 17:38:47 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:38:47.768237 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90cc0ee-eeb5-41bd-ae13-715457d709de None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:47.911955 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90cc0ee-eeb5-41bd-ae13-715457d709de None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:47.923822 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696699b2-a8b0-4228-b017-f3a3c429df1b None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:47.924210 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696699b2-a8b0-4228-b017-f3a3c429df1b None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:47.924702 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696699b2-a8b0-4228-b017-f3a3c429df1b None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:47.927435 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 543/1088] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:38:47 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 14 17:38:47.939858 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7601e68c-1f6d-495f-9026-f8bde22c753a None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:47.940520 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7601e68c-1f6d-495f-9026-f8bde22c753a None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:47.941003 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7601e68c-1f6d-495f-9026-f8bde22c753a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:47.954982 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4651178f-a98f-4594-b818-96c6a991fdab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:47.955620 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4651178f-a98f-4594-b818-96c6a991fdab None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:47.955906 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4651178f-a98f-4594-b818-96c6a991fdab None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:47.956189 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4651178f-a98f-4594-b818-96c6a991fdab None admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:47.956959 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4651178f-a98f-4594-b818-96c6a991fdab None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:47.957272 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4651178f-a98f-4594-b818-96c6a991fdab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:47.958697 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4651178f-a98f-4594-b818-96c6a991fdab None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:47.969223 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 546/1089] 10.222.0.36 () {56 vars in 1115 bytes} [Tue Jun 14 17:38:47 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:38:47.970630 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-7601e68c-1f6d-495f-9026-f8bde22c753a None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:38:47.972769 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-7601e68c-1f6d-495f-9026-f8bde22c753a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:38:47.975392 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4651178f-a98f-4594-b818-96c6a991fdab None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:48.045252 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:48.076708 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 544/1090] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:38:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 14 17:38:48.104601 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4651178f-a98f-4594-b818-96c6a991fdab None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:48.120640 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7601e68c-1f6d-495f-9026-f8bde22c753a None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:48.143830 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbf4004-9acc-4406-ae4d-0c6d2e667258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:48.144635 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbf4004-9acc-4406-ae4d-0c6d2e667258 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:48.144926 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbf4004-9acc-4406-ae4d-0c6d2e667258 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:48.145225 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbf4004-9acc-4406-ae4d-0c6d2e667258 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:48.145439 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:48.162091 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbf4004-9acc-4406-ae4d-0c6d2e667258 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:48.163684 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbf4004-9acc-4406-ae4d-0c6d2e667258 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:48.193063 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-0dbf4004-9acc-4406-ae4d-0c6d2e667258 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:38:48.193063 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:48.193063 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:38:48.193063 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:38:48.193063 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:38:48.193063 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:38:48.193063 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:38:48.193063 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:38:48.193063 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:38:48.193063 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:38:48.193063 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:38:48.193063 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:38:48.193063 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:38:48.193063 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:38:48.193063 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:38:48.194842 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:38:48.194842 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:38:48.194842 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:38:48.194842 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:38:48.194842 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:38:48.194842 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:38:48.194842 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:38:48.194842 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:38:48.194842 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:38:48.194842 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:38:48.194842 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:38:48.194842 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:38:48.194842 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:38:48.194842 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:38:48.194842 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:38:48.194842 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:38:48.194842 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:38:48.196839 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:38:48.196839 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:38:48.196839 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:38:48.196839 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:38:48.196839 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 547/1091] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 14 17:38:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 17:38:48.203873 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbf4004-9acc-4406-ae4d-0c6d2e667258 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:48.271773 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7601e68c-1f6d-495f-9026-f8bde22c753a None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:48.323814 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:48.326856 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbf4004-9acc-4406-ae4d-0c6d2e667258 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:48.327645 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29764744-a1dc-407f-aa58-66a218400cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:48.328751 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29764744-a1dc-407f-aa58-66a218400cfc None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:48.329088 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29764744-a1dc-407f-aa58-66a218400cfc None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:48.329468 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29764744-a1dc-407f-aa58-66a218400cfc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:48.345299 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29764744-a1dc-407f-aa58-66a218400cfc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:38:48.359083 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-29764744-a1dc-407f-aa58-66a218400cfc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 17:38:48.359083 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:48.359083 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:38:48.359083 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:38:48.359083 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:38:48.359083 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:38:48.359083 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:38:48.359083 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:38:48.359083 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:38:48.359083 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:38:48.359083 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:38:48.359083 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:38:48.359083 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:38:48.359083 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:38:48.359083 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:38:48.359083 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:38:48.361254 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:38:48.361254 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:38:48.361254 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:38:48.361254 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:38:48.361254 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:38:48.361254 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:38:48.361254 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:38:48.361254 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:38:48.361254 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:38:48.361254 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:38:48.361254 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:38:48.361254 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:38:48.361254 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:38:48.361254 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:38:48.361254 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:38:48.361254 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:38:48.362134 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:38:48.362134 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:38:48.362134 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:38:48.362134 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:38:48.362134 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:38:48.362134 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:38:48.362134 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:38:48.362134 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:38:48.362134 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:38:48.362134 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:38:48.362134 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 17:38:48.362134 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:38:48.362134 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 545/1092] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jun 14 17:38:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:38:48.368134 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29764744-a1dc-407f-aa58-66a218400cfc None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:48.378142 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f69529-0e74-447d-a049-9d778ad37f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:48.379163 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f69529-0e74-447d-a049-9d778ad37f67 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:48.379620 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f69529-0e74-447d-a049-9d778ad37f67 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:48.379965 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f69529-0e74-447d-a049-9d778ad37f67 None admin] PATH_INFO: `/v3/domains` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:48.380771 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f69529-0e74-447d-a049-9d778ad37f67 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:48.381185 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f69529-0e74-447d-a049-9d778ad37f67 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:48.382744 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f69529-0e74-447d-a049-9d778ad37f67 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:48.404935 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 548/1093] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 14 17:38:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:48.408328 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f69529-0e74-447d-a049-9d778ad37f67 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:48.465873 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:48.502264 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29764744-a1dc-407f-aa58-66a218400cfc None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:48.549751 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f69529-0e74-447d-a049-9d778ad37f67 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:48.555839 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b39e494-de2c-44c1-875e-c8b5b59cab21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:48.556683 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b39e494-de2c-44c1-875e-c8b5b59cab21 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:48.557064 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b39e494-de2c-44c1-875e-c8b5b59cab21 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:48.557440 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b39e494-de2c-44c1-875e-c8b5b59cab21 None admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:48.558305 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b39e494-de2c-44c1-875e-c8b5b59cab21 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:48.558898 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b39e494-de2c-44c1-875e-c8b5b59cab21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:48.560528 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b39e494-de2c-44c1-875e-c8b5b59cab21 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:48.571564 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 546/1094] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 14 17:38:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:38:48.578373 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b39e494-de2c-44c1-875e-c8b5b59cab21 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:48.593608 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d8f0ef-6ede-4080-9595-8aa53c850ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:48.594520 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d8f0ef-6ede-4080-9595-8aa53c850ce0 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:48.594863 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d8f0ef-6ede-4080-9595-8aa53c850ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:48.595255 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d8f0ef-6ede-4080-9595-8aa53c850ce0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:48.604967 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d8f0ef-6ede-4080-9595-8aa53c850ce0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:48.606828 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d8f0ef-6ede-4080-9595-8aa53c850ce0 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:48.626895 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-74d8f0ef-6ede-4080-9595-8aa53c850ce0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 14 17:38:48.626895 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:48.626895 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:38:48.626895 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:38:48.626895 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:38:48.626895 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:38:48.626895 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:38:48.626895 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:38:48.626895 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:38:48.626895 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:38:48.626895 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:38:48.626895 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:38:48.626895 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 14 17:38:48.626895 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 14 17:38:48.626895 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 14 17:38:48.626895 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 14 17:38:48.629056 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:38:48.629056 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:38:48.629056 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 14 17:38:48.629056 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:38:48.629056 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 14 17:38:48.629056 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:38:48.629056 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:38:48.629056 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:38:48.629056 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:38:48.629056 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:38:48.629056 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:38:48.629056 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:38:48.629056 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:38:48.629056 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:38:48.629056 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:38:48.629056 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:38:48.629056 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:38:48.629056 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:38:48.630590 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:38:48.630590 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:38:48.630590 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 14 17:38:48.630590 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 14 17:38:48.630590 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 14 17:38:48.630590 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 14 17:38:48.630590 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 14 17:38:48.630590 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 14 17:38:48.630590 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 14 17:38:48.630590 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:38:48.630590 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 549/1095] 10.222.0.36 () {56 vars in 1093 bytes} [Tue Jun 14 17:38:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 17:38:48.635682 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d8f0ef-6ede-4080-9595-8aa53c850ce0 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:48.667187 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:48.719110 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b39e494-de2c-44c1-875e-c8b5b59cab21 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:48.768612 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b094bd-9004-42fd-b381-807a30631335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:48.769818 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b094bd-9004-42fd-b381-807a30631335 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:48.770297 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b094bd-9004-42fd-b381-807a30631335 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:48.770713 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b094bd-9004-42fd-b381-807a30631335 None admin] PATH_INFO: `/v3/users/ed2378e926c54d79aed7eeee87a23202` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:48.772130 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b094bd-9004-42fd-b381-807a30631335 None admin] RBAC: Authorizing `identity:get_user(user_id=ed2378e926c54d79aed7eeee87a23202)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:48.774103 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b094bd-9004-42fd-b381-807a30631335 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:48.776439 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 547/1096] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 14 17:38:48 2022] GET /identity/v3/users/ed2378e926c54d79aed7eeee87a23202 => generated 285 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:38:48.784136 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b094bd-9004-42fd-b381-807a30631335 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:48.788386 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:48.790581 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d8f0ef-6ede-4080-9595-8aa53c850ce0 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:48.837017 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ba6268-b040-49ff-9b4a-d06272f05d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:48.837812 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba6268-b040-49ff-9b4a-d06272f05d97 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:48.838168 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba6268-b040-49ff-9b4a-d06272f05d97 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:48.838515 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba6268-b040-49ff-9b4a-d06272f05d97 None admin] PATH_INFO: `/v3/users` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:48.839587 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ba6268-b040-49ff-9b4a-d06272f05d97 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:48.840108 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ba6268-b040-49ff-9b4a-d06272f05d97 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:48.842988 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ba6268-b040-49ff-9b4a-d06272f05d97 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:48.867914 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 550/1097] 10.222.0.36 () {56 vars in 1133 bytes} [Tue Jun 14 17:38:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:48.875117 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ba6268-b040-49ff-9b4a-d06272f05d97 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:48.931017 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b094bd-9004-42fd-b381-807a30631335 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:48.975939 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:48.986576 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cc6f32-4cde-4ba0-96ef-e35dfc2e2425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:48.987257 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cc6f32-4cde-4ba0-96ef-e35dfc2e2425 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:48.993626 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cc6f32-4cde-4ba0-96ef-e35dfc2e2425 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:48.993626 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cc6f32-4cde-4ba0-96ef-e35dfc2e2425 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:49.008536 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ba6268-b040-49ff-9b4a-d06272f05d97 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:49.066765 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988e8dfe-49aa-43b1-b82e-36b9fe1e92a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:49.067851 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988e8dfe-49aa-43b1-b82e-36b9fe1e92a7 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:49.068318 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988e8dfe-49aa-43b1-b82e-36b9fe1e92a7 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:49.068780 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988e8dfe-49aa-43b1-b82e-36b9fe1e92a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:49.080371 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cc6f32-4cde-4ba0-96ef-e35dfc2e2425 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:49.084909 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cc6f32-4cde-4ba0-96ef-e35dfc2e2425 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:49.087792 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:49.172710 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988e8dfe-49aa-43b1-b82e-36b9fe1e92a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:49.175265 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988e8dfe-49aa-43b1-b82e-36b9fe1e92a7 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:49.208805 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 548/1098] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 14 17:38:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 14 17:38:49.215523 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cc6f32-4cde-4ba0-96ef-e35dfc2e2425 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:49.297647 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:49.328664 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 551/1099] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 14 17:38:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 14 17:38:49.334231 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988e8dfe-49aa-43b1-b82e-36b9fe1e92a7 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:49.367239 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cc6f32-4cde-4ba0-96ef-e35dfc2e2425 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:49.370941 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:49.412592 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3f4f45-c12b-42e5-aa91-b81799ef53d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:49.413988 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3f4f45-c12b-42e5-aa91-b81799ef53d5 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:49.414361 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3f4f45-c12b-42e5-aa91-b81799ef53d5 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:49.414768 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3f4f45-c12b-42e5-aa91-b81799ef53d5 None admin] PATH_INFO: `/v3/projects/c71c7ac5cbbb452b8172ef3edbbf80dc` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:49.416506 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3f4f45-c12b-42e5-aa91-b81799ef53d5 None admin] RBAC: Authorizing `identity:get_project(project_id=c71c7ac5cbbb452b8172ef3edbbf80dc)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:49.418125 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3f4f45-c12b-42e5-aa91-b81799ef53d5 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:49.420202 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 549/1100] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 14 17:38:49 2022] GET /identity/v3/projects/c71c7ac5cbbb452b8172ef3edbbf80dc => generated 311 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:38:49.427954 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3f4f45-c12b-42e5-aa91-b81799ef53d5 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:49.460125 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988e8dfe-49aa-43b1-b82e-36b9fe1e92a7 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:49.500596 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83080ff8-beb2-448b-b9db-6c95f3ae1010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:49.501422 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83080ff8-beb2-448b-b9db-6c95f3ae1010 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:49.501710 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83080ff8-beb2-448b-b9db-6c95f3ae1010 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:49.501993 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83080ff8-beb2-448b-b9db-6c95f3ae1010 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:49.514335 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83080ff8-beb2-448b-b9db-6c95f3ae1010 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:49.516567 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83080ff8-beb2-448b-b9db-6c95f3ae1010 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:49.535882 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-83080ff8-beb2-448b-b9db-6c95f3ae1010 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:38:49.535882 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:49.535882 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:38:49.535882 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:38:49.535882 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:38:49.535882 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:38:49.535882 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:38:49.535882 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:38:49.535882 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:38:49.535882 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:38:49.535882 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:38:49.535882 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:38:49.535882 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:38:49.535882 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:38:49.535882 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:38:49.537661 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:38:49.537661 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:38:49.537661 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:38:49.537661 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:38:49.537661 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:38:49.537661 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:38:49.537661 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:38:49.537661 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:38:49.537661 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:38:49.537661 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:38:49.537661 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:38:49.537661 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:38:49.537661 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:38:49.537661 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:38:49.537661 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:38:49.537661 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:38:49.537661 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:38:49.539747 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:38:49.539747 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:38:49.539747 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:38:49.539747 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:38:49.539747 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 552/1101] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 14 17:38:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 17:38:49.544937 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83080ff8-beb2-448b-b9db-6c95f3ae1010 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:49.581193 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:49.581865 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3f4f45-c12b-42e5-aa91-b81799ef53d5 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:49.628400 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210ca9bc-ed55-4ef5-a07c-b3e59baac3a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:49.629284 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210ca9bc-ed55-4ef5-a07c-b3e59baac3a4 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:49.629619 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210ca9bc-ed55-4ef5-a07c-b3e59baac3a4 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:49.630013 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210ca9bc-ed55-4ef5-a07c-b3e59baac3a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:49.630940 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210ca9bc-ed55-4ef5-a07c-b3e59baac3a4 None admin] RBAC: Adding query filter params (role.id=1348580877d04014bfdec4d866b98a74, scope.project.id=c71c7ac5cbbb452b8172ef3edbbf80dc, user.id=ed2378e926c54d79aed7eeee87a23202) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:49.631385 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210ca9bc-ed55-4ef5-a07c-b3e59baac3a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:49.632939 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210ca9bc-ed55-4ef5-a07c-b3e59baac3a4 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:49.641464 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 550/1102] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 14 17:38:49 2022] GET /identity/v3/role_assignments?user.id=ed2378e926c54d79aed7eeee87a23202&scope.project.id=c71c7ac5cbbb452b8172ef3edbbf80dc&role.id=1348580877d04014bfdec4d866b98a74 => generated 608 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:38:49.669183 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83080ff8-beb2-448b-b9db-6c95f3ae1010 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:49.713505 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeed1db-cc8e-44b0-b2d2-ebb43c20848c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:49.714186 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeed1db-cc8e-44b0-b2d2-ebb43c20848c None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:49.714476 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeed1db-cc8e-44b0-b2d2-ebb43c20848c None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:49.714781 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeed1db-cc8e-44b0-b2d2-ebb43c20848c None admin] PATH_INFO: `/v3/domains` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:49.715530 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeed1db-cc8e-44b0-b2d2-ebb43c20848c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:49.715842 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeed1db-cc8e-44b0-b2d2-ebb43c20848c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:49.717260 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeed1db-cc8e-44b0-b2d2-ebb43c20848c None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:49.731930 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 553/1103] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 14 17:38:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:38:49.739538 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210ca9bc-ed55-4ef5-a07c-b3e59baac3a4 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:49.791073 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:49.892501 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210ca9bc-ed55-4ef5-a07c-b3e59baac3a4 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:49.955669 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161af8da-518a-468f-92d2-d18e70373cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:49.957038 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161af8da-518a-468f-92d2-d18e70373cea None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:49.957546 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161af8da-518a-468f-92d2-d18e70373cea None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:49.958047 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161af8da-518a-468f-92d2-d18e70373cea None admin] PATH_INFO: `/v3/projects/service` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:49.971284 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161af8da-518a-468f-92d2-d18e70373cea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:49.974104 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161af8da-518a-468f-92d2-d18e70373cea None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:50.001199 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-161af8da-518a-468f-92d2-d18e70373cea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:38:50.001199 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:50.001199 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:38:50.001199 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:38:50.001199 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:38:50.001199 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:38:50.001199 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:38:50.001199 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:38:50.001199 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:38:50.001199 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:38:50.001199 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:38:50.001199 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:38:50.001199 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 14 17:38:50.001199 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 14 17:38:50.001199 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 14 17:38:50.002193 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 14 17:38:50.002193 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:38:50.002193 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:38:50.002193 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:38:50.002193 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:38:50.002193 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:38:50.002193 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:38:50.002193 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:38:50.002193 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:38:50.002193 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:38:50.002193 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:38:50.002193 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:38:50.002193 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:38:50.002193 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:38:50.002193 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:38:50.002193 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:38:50.002193 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:38:50.003111 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 14 17:38:50.003111 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 14 17:38:50.003111 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 14 17:38:50.003111 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 14 17:38:50.003111 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 14 17:38:50.003111 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 14 17:38:50.003111 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:38:50.003111 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:38:50.004004 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 551/1104] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 14 17:38:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:38:50.013295 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeed1db-cc8e-44b0-b2d2-ebb43c20848c None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:50.183325 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:50.198499 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeed1db-cc8e-44b0-b2d2-ebb43c20848c None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:50.242756 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f76d148-b84a-4946-9a4c-b7fceb8e9f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:50.243460 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f76d148-b84a-4946-9a4c-b7fceb8e9f8c None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:50.243741 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f76d148-b84a-4946-9a4c-b7fceb8e9f8c None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:50.244018 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f76d148-b84a-4946-9a4c-b7fceb8e9f8c None admin] PATH_INFO: `/v3/projects` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:50.244812 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f76d148-b84a-4946-9a4c-b7fceb8e9f8c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:50.245123 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f76d148-b84a-4946-9a4c-b7fceb8e9f8c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:50.246592 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f76d148-b84a-4946-9a4c-b7fceb8e9f8c None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:50.260908 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 554/1105] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jun 14 17:38:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:50.268113 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161af8da-518a-468f-92d2-d18e70373cea None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:50.381548 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:50.388214 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161af8da-518a-468f-92d2-d18e70373cea None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:50.435084 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ad8da2-8286-48d5-8857-57082ac7e87f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:50.436065 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ad8da2-8286-48d5-8857-57082ac7e87f None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:50.436504 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ad8da2-8286-48d5-8857-57082ac7e87f None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:50.437017 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ad8da2-8286-48d5-8857-57082ac7e87f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:50.438873 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ad8da2-8286-48d5-8857-57082ac7e87f None admin] RBAC: Adding query filter params (role.id=dca59aef7b5d4641b6c146c9be77d2fe, scope.project.id=f3e1d023a52c42b98d018617987ef83c, user.id=e4696d396adb495ab300a9a5a5727595) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:50.439386 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ad8da2-8286-48d5-8857-57082ac7e87f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:50.441997 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ad8da2-8286-48d5-8857-57082ac7e87f None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:50.450677 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 552/1106] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 14 17:38:50 2022] GET /identity/v3/role_assignments?user.id=e4696d396adb495ab300a9a5a5727595&scope.project.id=f3e1d023a52c42b98d018617987ef83c&role.id=dca59aef7b5d4641b6c146c9be77d2fe => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:52.027087 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbc140a-5855-49db-ab36-03d819ccf136 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:52.027678 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbc140a-5855-49db-ab36-03d819ccf136 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:52.027678 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbc140a-5855-49db-ab36-03d819ccf136 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:52.029107 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 555/1107] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:38:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:38:52.036873 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0173b3e8-a5b5-445e-81ed-c4c2c2cbf2f2 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:52.037478 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0173b3e8-a5b5-445e-81ed-c4c2c2cbf2f2 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:52.037772 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0173b3e8-a5b5-445e-81ed-c4c2c2cbf2f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:52.064246 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-0173b3e8-a5b5-445e-81ed-c4c2c2cbf2f2 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:38:52.066445 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-0173b3e8-a5b5-445e-81ed-c4c2c2cbf2f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:38:52.191524 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 553/1108] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:38:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 17:38:52.217824 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbc140a-5855-49db-ab36-03d819ccf136 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:52.328091 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbc140a-5855-49db-ab36-03d819ccf136 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:52.366362 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f580e2-0fdf-4aa9-a117-819e69e42a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:52.367171 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f580e2-0fdf-4aa9-a117-819e69e42a61 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:52.367627 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f580e2-0fdf-4aa9-a117-819e69e42a61 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:52.367908 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f580e2-0fdf-4aa9-a117-819e69e42a61 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:52.369128 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f580e2-0fdf-4aa9-a117-819e69e42a61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:52.370574 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f580e2-0fdf-4aa9-a117-819e69e42a61 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:52.372250 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 556/1109] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 14 17:38:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:52.382370 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0173b3e8-a5b5-445e-81ed-c4c2c2cbf2f2 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:52.532760 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:52.542810 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0173b3e8-a5b5-445e-81ed-c4c2c2cbf2f2 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:52.580068 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ad626f-778e-43d3-8552-c42bea158f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:52.580754 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ad626f-778e-43d3-8552-c42bea158f4d None admin] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:52.581060 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ad626f-778e-43d3-8552-c42bea158f4d None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:52.581324 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ad626f-778e-43d3-8552-c42bea158f4d None admin] PATH_INFO: `/v3/users` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:52.582056 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ad626f-778e-43d3-8552-c42bea158f4d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:52.583528 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ad626f-778e-43d3-8552-c42bea158f4d None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:52.672327 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 554/1110] 10.222.0.36 () {60 vars in 1132 bytes} [Tue Jun 14 17:38:52 2022] POST /identity/v3/users => generated 286 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:38:54.958846 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7136274c-1746-4315-96c2-1255d8c5fae6 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:54.959457 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7136274c-1746-4315-96c2-1255d8c5fae6 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:54.959577 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7136274c-1746-4315-96c2-1255d8c5fae6 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:54.965930 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 557/1111] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:38:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:38:54.967288 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e152e55-85fa-4eb3-82bf-60cdd787dcde None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:54.968033 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e152e55-85fa-4eb3-82bf-60cdd787dcde None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:54.968033 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e152e55-85fa-4eb3-82bf-60cdd787dcde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:54.987062 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-2e152e55-85fa-4eb3-82bf-60cdd787dcde None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:38:54.988348 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-2e152e55-85fa-4eb3-82bf-60cdd787dcde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:38:55.073781 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 555/1112] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:38:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 17:38:55.098640 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7136274c-1746-4315-96c2-1255d8c5fae6 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:55.121289 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:55.211767 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7136274c-1746-4315-96c2-1255d8c5fae6 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:55.251526 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8ef5a4-8d8b-4260-b5ba-9900d2b32a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:55.252396 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8ef5a4-8d8b-4260-b5ba-9900d2b32a85 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:55.252682 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8ef5a4-8d8b-4260-b5ba-9900d2b32a85 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:55.252964 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8ef5a4-8d8b-4260-b5ba-9900d2b32a85 None admin] PATH_INFO: `/v3/roles/e41c4e25dfdf4810aab2231cf98c98a9` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:55.254739 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8ef5a4-8d8b-4260-b5ba-9900d2b32a85 None admin] RBAC: Authorizing `identity:get_role(role_id=e41c4e25dfdf4810aab2231cf98c98a9)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:55.256152 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8ef5a4-8d8b-4260-b5ba-9900d2b32a85 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:55.257547 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 558/1113] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 14 17:38:55 2022] GET /identity/v3/roles/e41c4e25dfdf4810aab2231cf98c98a9 => generated 223 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:38:55.263493 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e152e55-85fa-4eb3-82bf-60cdd787dcde None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:55.346346 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:55.374175 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e152e55-85fa-4eb3-82bf-60cdd787dcde None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:55.413496 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8fe2bc-4153-43e1-8a0b-e2885d121695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:55.414498 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8fe2bc-4153-43e1-8a0b-e2885d121695 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:55.415126 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8fe2bc-4153-43e1-8a0b-e2885d121695 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:55.415578 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8fe2bc-4153-43e1-8a0b-e2885d121695 None admin] PATH_INFO: `/v3/users/2f0b5d0e34ba47639c2bdf0b4e3bef58` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:55.432310 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8fe2bc-4153-43e1-8a0b-e2885d121695 None admin] RBAC: Authorizing `identity:get_user(user_id=2f0b5d0e34ba47639c2bdf0b4e3bef58)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:55.433794 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8fe2bc-4153-43e1-8a0b-e2885d121695 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:55.435676 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 556/1114] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 14 17:38:55 2022] GET /identity/v3/users/2f0b5d0e34ba47639c2bdf0b4e3bef58 => generated 286 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:55.443550 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8ef5a4-8d8b-4260-b5ba-9900d2b32a85 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:55.547716 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:55.565844 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8ef5a4-8d8b-4260-b5ba-9900d2b32a85 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:55.608326 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb52e22-87db-418d-9ca4-dd52d3acb4d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:55.608999 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb52e22-87db-418d-9ca4-dd52d3acb4d0 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:55.609291 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb52e22-87db-418d-9ca4-dd52d3acb4d0 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:55.609581 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb52e22-87db-418d-9ca4-dd52d3acb4d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:55.682940 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb52e22-87db-418d-9ca4-dd52d3acb4d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:55.684464 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb52e22-87db-418d-9ca4-dd52d3acb4d0 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:55.776717 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:55.793739 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 559/1115] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 14 17:38:55 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 14 17:38:55.800755 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8fe2bc-4153-43e1-8a0b-e2885d121695 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:55.941484 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8fe2bc-4153-43e1-8a0b-e2885d121695 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:55.977311 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2174ea-8fe6-4449-b34e-a37da200ebaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:55.978185 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2174ea-8fe6-4449-b34e-a37da200ebaf None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:55.978473 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2174ea-8fe6-4449-b34e-a37da200ebaf None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:55.978750 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2174ea-8fe6-4449-b34e-a37da200ebaf None admin] PATH_INFO: `/v3/projects/c71c7ac5cbbb452b8172ef3edbbf80dc` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:55.980020 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2174ea-8fe6-4449-b34e-a37da200ebaf None admin] RBAC: Authorizing `identity:get_project(project_id=c71c7ac5cbbb452b8172ef3edbbf80dc)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:55.981471 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2174ea-8fe6-4449-b34e-a37da200ebaf None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:55.984074 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 557/1116] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 14 17:38:55 2022] GET /identity/v3/projects/c71c7ac5cbbb452b8172ef3edbbf80dc => generated 311 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:55.992663 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb52e22-87db-418d-9ca4-dd52d3acb4d0 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:56.097558 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb52e22-87db-418d-9ca4-dd52d3acb4d0 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:56.138615 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd84f45-5e5a-4f84-9ddf-1d07605250cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:56.139446 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd84f45-5e5a-4f84-9ddf-1d07605250cc None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:56.139756 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd84f45-5e5a-4f84-9ddf-1d07605250cc None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:56.140590 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd84f45-5e5a-4f84-9ddf-1d07605250cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:56.141454 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd84f45-5e5a-4f84-9ddf-1d07605250cc None admin] RBAC: Adding query filter params (role.id=e41c4e25dfdf4810aab2231cf98c98a9, scope.project.id=c71c7ac5cbbb452b8172ef3edbbf80dc, user.id=2f0b5d0e34ba47639c2bdf0b4e3bef58) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:56.141771 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd84f45-5e5a-4f84-9ddf-1d07605250cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:56.143255 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd84f45-5e5a-4f84-9ddf-1d07605250cc None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:56.149418 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 560/1117] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 14 17:38:55 2022] GET /identity/v3/role_assignments?user.id=2f0b5d0e34ba47639c2bdf0b4e3bef58&scope.project.id=c71c7ac5cbbb452b8172ef3edbbf80dc&role.id=e41c4e25dfdf4810aab2231cf98c98a9 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:58.350182 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1117b32-519a-4af4-8202-d905d633915e None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:58.350804 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1117b32-519a-4af4-8202-d905d633915e None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:58.350804 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1117b32-519a-4af4-8202-d905d633915e None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:58.352622 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 558/1118] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:38:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 14 17:38:58.359474 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c44fbf-8179-4278-812e-4b39624eb027 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:58.360271 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c44fbf-8179-4278-812e-4b39624eb027 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:58.360271 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c44fbf-8179-4278-812e-4b39624eb027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:58.376925 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-87c44fbf-8179-4278-812e-4b39624eb027 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:38:58.378150 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-87c44fbf-8179-4278-812e-4b39624eb027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:38:58.430462 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:58.452226 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 561/1119] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:38:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 14 17:38:58.476484 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1117b32-519a-4af4-8202-d905d633915e None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:58.481015 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:58.658365 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1117b32-519a-4af4-8202-d905d633915e None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:58.720385 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d3b394-0745-4dc3-8db5-12ab890fdb1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:58.721904 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d3b394-0745-4dc3-8db5-12ab890fdb1b None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:58.722422 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d3b394-0745-4dc3-8db5-12ab890fdb1b None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:58.722936 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d3b394-0745-4dc3-8db5-12ab890fdb1b None admin] PATH_INFO: `/v3/roles/e41c4e25dfdf4810aab2231cf98c98a9` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:58.725616 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d3b394-0745-4dc3-8db5-12ab890fdb1b None admin] RBAC: Authorizing `identity:get_role(role_id=e41c4e25dfdf4810aab2231cf98c98a9)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:58.728381 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d3b394-0745-4dc3-8db5-12ab890fdb1b None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:58.731056 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 559/1120] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 14 17:38:58 2022] GET /identity/v3/roles/e41c4e25dfdf4810aab2231cf98c98a9 => generated 223 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:58.738131 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c44fbf-8179-4278-812e-4b39624eb027 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:58.846599 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c44fbf-8179-4278-812e-4b39624eb027 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:58.881619 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b435061-004e-4da2-91fb-d14d6a62789a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:58.882499 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b435061-004e-4da2-91fb-d14d6a62789a None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:58.882780 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b435061-004e-4da2-91fb-d14d6a62789a None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:58.883053 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b435061-004e-4da2-91fb-d14d6a62789a None admin] PATH_INFO: `/v3/users/2f0b5d0e34ba47639c2bdf0b4e3bef58` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:58.884362 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b435061-004e-4da2-91fb-d14d6a62789a None admin] RBAC: Authorizing `identity:get_user(user_id=2f0b5d0e34ba47639c2bdf0b4e3bef58)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:58.885778 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b435061-004e-4da2-91fb-d14d6a62789a None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:58.887475 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 562/1121] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 14 17:38:58 2022] GET /identity/v3/users/2f0b5d0e34ba47639c2bdf0b4e3bef58 => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:58.897353 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d3b394-0745-4dc3-8db5-12ab890fdb1b None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:58.971903 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:59.022905 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d3b394-0745-4dc3-8db5-12ab890fdb1b None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:59.060060 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5698ad-a8ed-454d-b74d-af750671774a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:59.061765 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5698ad-a8ed-454d-b74d-af750671774a None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:59.061765 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5698ad-a8ed-454d-b74d-af750671774a None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:59.062311 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5698ad-a8ed-454d-b74d-af750671774a None admin] PATH_INFO: `/v3/projects/c71c7ac5cbbb452b8172ef3edbbf80dc` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:59.063570 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5698ad-a8ed-454d-b74d-af750671774a None admin] RBAC: Authorizing `identity:get_project(project_id=c71c7ac5cbbb452b8172ef3edbbf80dc)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:59.065020 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5698ad-a8ed-454d-b74d-af750671774a None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:59.066766 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 560/1122] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 14 17:38:58 2022] GET /identity/v3/projects/c71c7ac5cbbb452b8172ef3edbbf80dc => generated 311 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:59.076286 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b435061-004e-4da2-91fb-d14d6a62789a None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:59.149335 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:59.203089 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b435061-004e-4da2-91fb-d14d6a62789a None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:59.240769 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca2a6a3-fa35-4ae8-85bb-e7814cc72bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:59.241581 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca2a6a3-fa35-4ae8-85bb-e7814cc72bb3 None admin] REQUEST_METHOD: `PUT` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:59.241866 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca2a6a3-fa35-4ae8-85bb-e7814cc72bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:59.242147 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca2a6a3-fa35-4ae8-85bb-e7814cc72bb3 None admin] PATH_INFO: `/v3/projects/c71c7ac5cbbb452b8172ef3edbbf80dc/users/2f0b5d0e34ba47639c2bdf0b4e3bef58/roles/e41c4e25dfdf4810aab2231cf98c98a9` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:59.244436 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca2a6a3-fa35-4ae8-85bb-e7814cc72bb3 None admin] RBAC: Authorizing `identity:create_grant(project_id=c71c7ac5cbbb452b8172ef3edbbf80dc, user_id=2f0b5d0e34ba47639c2bdf0b4e3bef58, role_id=e41c4e25dfdf4810aab2231cf98c98a9)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:59.245877 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca2a6a3-fa35-4ae8-85bb-e7814cc72bb3 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:59.321759 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 563/1123] 10.222.0.36 () {58 vars in 1439 bytes} [Tue Jun 14 17:38:59 2022] PUT /identity/v3/projects/c71c7ac5cbbb452b8172ef3edbbf80dc/users/2f0b5d0e34ba47639c2bdf0b4e3bef58/roles/e41c4e25dfdf4810aab2231cf98c98a9 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:39:01.620108 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5c8640-68db-4d1b-8c64-33fade35fd22 None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:01.620841 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5c8640-68db-4d1b-8c64-33fade35fd22 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:01.620841 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5c8640-68db-4d1b-8c64-33fade35fd22 None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:01.622354 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 561/1124] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:39:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 14 17:39:01.629342 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e3d612-3762-4661-9cb9-3e0718278950 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:01.629910 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e3d612-3762-4661-9cb9-3e0718278950 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:01.629910 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e3d612-3762-4661-9cb9-3e0718278950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:01.649463 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-51e3d612-3762-4661-9cb9-3e0718278950 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:39:01.650752 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-51e3d612-3762-4661-9cb9-3e0718278950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:39:01.726384 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 564/1125] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:39:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 14 17:39:01.751887 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5c8640-68db-4d1b-8c64-33fade35fd22 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:01.876888 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5c8640-68db-4d1b-8c64-33fade35fd22 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:01.922645 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4738840-3acd-4b53-9f9d-3df0cc3390eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:01.924260 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4738840-3acd-4b53-9f9d-3df0cc3390eb None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:01.924744 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4738840-3acd-4b53-9f9d-3df0cc3390eb None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:01.925222 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4738840-3acd-4b53-9f9d-3df0cc3390eb None admin] PATH_INFO: `/v3/roles/e41c4e25dfdf4810aab2231cf98c98a9` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:01.928037 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4738840-3acd-4b53-9f9d-3df0cc3390eb None admin] RBAC: Authorizing `identity:get_role(role_id=e41c4e25dfdf4810aab2231cf98c98a9)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:01.930558 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4738840-3acd-4b53-9f9d-3df0cc3390eb None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:01.933109 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 562/1126] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 14 17:39:01 2022] GET /identity/v3/roles/e41c4e25dfdf4810aab2231cf98c98a9 => generated 223 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:01.939819 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e3d612-3762-4661-9cb9-3e0718278950 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:01.985679 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:02.051435 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e3d612-3762-4661-9cb9-3e0718278950 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:02.090271 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f8d612-eb7e-483c-a1aa-75b658887a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:02.091154 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f8d612-eb7e-483c-a1aa-75b658887a2b None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:02.091477 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f8d612-eb7e-483c-a1aa-75b658887a2b None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:02.091759 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f8d612-eb7e-483c-a1aa-75b658887a2b None admin] PATH_INFO: `/v3/users/2f0b5d0e34ba47639c2bdf0b4e3bef58` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:02.093723 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f8d612-eb7e-483c-a1aa-75b658887a2b None admin] RBAC: Authorizing `identity:get_user(user_id=2f0b5d0e34ba47639c2bdf0b4e3bef58)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:02.095187 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f8d612-eb7e-483c-a1aa-75b658887a2b None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:02.096958 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 565/1127] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 14 17:39:01 2022] GET /identity/v3/users/2f0b5d0e34ba47639c2bdf0b4e3bef58 => generated 286 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:39:02.103283 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4738840-3acd-4b53-9f9d-3df0cc3390eb None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:02.114861 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:02.246036 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4738840-3acd-4b53-9f9d-3df0cc3390eb None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:02.305768 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdce2cf-32ad-4eb6-8792-a5f97c6e3f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:02.306894 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdce2cf-32ad-4eb6-8792-a5f97c6e3f92 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:02.307438 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdce2cf-32ad-4eb6-8792-a5f97c6e3f92 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:02.307900 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdce2cf-32ad-4eb6-8792-a5f97c6e3f92 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:02.435140 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdce2cf-32ad-4eb6-8792-a5f97c6e3f92 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:02.438397 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdce2cf-32ad-4eb6-8792-a5f97c6e3f92 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:02.454355 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:02.621052 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 563/1128] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 14 17:39:02 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 14 17:39:02.627915 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f8d612-eb7e-483c-a1aa-75b658887a2b None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:02.733438 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f8d612-eb7e-483c-a1aa-75b658887a2b None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:02.742412 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:02.771244 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca56a02a-d4bc-4c34-a5d6-0447e44fb285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:02.772152 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca56a02a-d4bc-4c34-a5d6-0447e44fb285 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:02.772444 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca56a02a-d4bc-4c34-a5d6-0447e44fb285 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:02.772753 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca56a02a-d4bc-4c34-a5d6-0447e44fb285 None admin] PATH_INFO: `/v3/projects/c71c7ac5cbbb452b8172ef3edbbf80dc` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:02.774004 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca56a02a-d4bc-4c34-a5d6-0447e44fb285 None admin] RBAC: Authorizing `identity:get_project(project_id=c71c7ac5cbbb452b8172ef3edbbf80dc)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:02.775456 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca56a02a-d4bc-4c34-a5d6-0447e44fb285 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:02.777290 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 566/1129] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 14 17:39:02 2022] GET /identity/v3/projects/c71c7ac5cbbb452b8172ef3edbbf80dc => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:02.788357 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdce2cf-32ad-4eb6-8792-a5f97c6e3f92 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:02.898612 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdce2cf-32ad-4eb6-8792-a5f97c6e3f92 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:02.907654 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:02.937043 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f078b1-2139-42e6-9e80-554007e45e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:02.938464 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f078b1-2139-42e6-9e80-554007e45e37 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:02.939005 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f078b1-2139-42e6-9e80-554007e45e37 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:02.939717 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f078b1-2139-42e6-9e80-554007e45e37 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:02.941335 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f078b1-2139-42e6-9e80-554007e45e37 None admin] RBAC: Adding query filter params (role.id=e41c4e25dfdf4810aab2231cf98c98a9, scope.project.id=c71c7ac5cbbb452b8172ef3edbbf80dc, user.id=2f0b5d0e34ba47639c2bdf0b4e3bef58) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:02.941945 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f078b1-2139-42e6-9e80-554007e45e37 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:02.944788 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f078b1-2139-42e6-9e80-554007e45e37 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:02.957548 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 564/1130] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 14 17:39:02 2022] GET /identity/v3/role_assignments?user.id=2f0b5d0e34ba47639c2bdf0b4e3bef58&scope.project.id=c71c7ac5cbbb452b8172ef3edbbf80dc&role.id=e41c4e25dfdf4810aab2231cf98c98a9 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:05.189482 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e0538e-ab88-4028-b91a-f10ae59bd8d8 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:05.190069 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e0538e-ab88-4028-b91a-f10ae59bd8d8 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:05.190069 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e0538e-ab88-4028-b91a-f10ae59bd8d8 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:05.191536 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 567/1131] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:39:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:39:05.197757 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb9efa6-72b9-45fb-8547-f6b8195c26e1 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:05.200526 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb9efa6-72b9-45fb-8547-f6b8195c26e1 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:05.200526 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb9efa6-72b9-45fb-8547-f6b8195c26e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:05.217912 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-9fb9efa6-72b9-45fb-8547-f6b8195c26e1 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:39:05.219184 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-9fb9efa6-72b9-45fb-8547-f6b8195c26e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:39:05.297136 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 565/1132] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:39:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 17:39:05.321210 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e0538e-ab88-4028-b91a-f10ae59bd8d8 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:05.429207 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e0538e-ab88-4028-b91a-f10ae59bd8d8 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:05.466064 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39284dbc-8be7-4706-9fd1-dc571d41257a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:05.466744 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39284dbc-8be7-4706-9fd1-dc571d41257a None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:05.467511 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39284dbc-8be7-4706-9fd1-dc571d41257a None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:05.467895 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39284dbc-8be7-4706-9fd1-dc571d41257a None admin] PATH_INFO: `/v3/domains/default` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:05.469200 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39284dbc-8be7-4706-9fd1-dc571d41257a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:05.470630 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39284dbc-8be7-4706-9fd1-dc571d41257a None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:05.472285 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 568/1133] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 14 17:39:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:05.478175 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb9efa6-72b9-45fb-8547-f6b8195c26e1 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:05.631323 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:05.634168 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb9efa6-72b9-45fb-8547-f6b8195c26e1 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:05.671587 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42259722-09de-48e2-82db-e3bbb552e942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:05.672252 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42259722-09de-48e2-82db-e3bbb552e942 None admin] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:05.672540 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42259722-09de-48e2-82db-e3bbb552e942 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:05.672821 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42259722-09de-48e2-82db-e3bbb552e942 None admin] PATH_INFO: `/v3/projects` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:05.673533 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42259722-09de-48e2-82db-e3bbb552e942 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:05.674963 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42259722-09de-48e2-82db-e3bbb552e942 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:05.774537 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 566/1134] 10.222.0.36 () {60 vars in 1141 bytes} [Tue Jun 14 17:39:05 2022] POST /identity/v3/projects => generated 311 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:39:08.050878 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e029793f-6668-4432-88c1-1f8e52f00519 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:08.051619 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e029793f-6668-4432-88c1-1f8e52f00519 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:08.051619 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e029793f-6668-4432-88c1-1f8e52f00519 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:08.052820 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 569/1135] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:39:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:39:08.059274 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa355c-7c02-4850-97a8-f249283453ce None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:08.059865 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa355c-7c02-4850-97a8-f249283453ce None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:08.060257 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa355c-7c02-4850-97a8-f249283453ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:08.084607 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-91aa355c-7c02-4850-97a8-f249283453ce None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:39:08.086334 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-91aa355c-7c02-4850-97a8-f249283453ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:39:08.176261 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 567/1136] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:39:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 14 17:39:08.203973 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e029793f-6668-4432-88c1-1f8e52f00519 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:08.260685 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:08.332472 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e029793f-6668-4432-88c1-1f8e52f00519 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:08.377913 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff61eda-5ea6-498e-a3c8-90d32cf1a8d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:08.379009 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff61eda-5ea6-498e-a3c8-90d32cf1a8d8 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:08.379330 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff61eda-5ea6-498e-a3c8-90d32cf1a8d8 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:08.379614 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff61eda-5ea6-498e-a3c8-90d32cf1a8d8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:08.380911 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff61eda-5ea6-498e-a3c8-90d32cf1a8d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:08.382394 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff61eda-5ea6-498e-a3c8-90d32cf1a8d8 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:08.384169 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 570/1137] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 14 17:39:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:08.393139 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aa355c-7c02-4850-97a8-f249283453ce None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:08.524777 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:08.553116 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aa355c-7c02-4850-97a8-f249283453ce None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:08.603632 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee897ab4-6394-4cfb-be5a-37dc5ce72a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:08.604321 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee897ab4-6394-4cfb-be5a-37dc5ce72a55 None admin] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:08.604609 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee897ab4-6394-4cfb-be5a-37dc5ce72a55 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:08.604933 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee897ab4-6394-4cfb-be5a-37dc5ce72a55 None admin] PATH_INFO: `/v3/users` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:08.605755 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee897ab4-6394-4cfb-be5a-37dc5ce72a55 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:08.607531 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee897ab4-6394-4cfb-be5a-37dc5ce72a55 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:08.708674 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 568/1138] 10.222.0.36 () {60 vars in 1132 bytes} [Tue Jun 14 17:39:08 2022] POST /identity/v3/users => generated 286 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 17:39:11.038219 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edb3172-b606-4609-9c9b-d1000b7fd771 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:11.038799 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edb3172-b606-4609-9c9b-d1000b7fd771 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:11.038799 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edb3172-b606-4609-9c9b-d1000b7fd771 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:11.040339 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 571/1139] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:39:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:39:11.046477 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db191fc1-78d0-47a9-98c3-9df70feaaff9 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:11.047044 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db191fc1-78d0-47a9-98c3-9df70feaaff9 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:11.047182 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db191fc1-78d0-47a9-98c3-9df70feaaff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:11.065591 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-db191fc1-78d0-47a9-98c3-9df70feaaff9 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:39:11.066815 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-db191fc1-78d0-47a9-98c3-9df70feaaff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:39:11.191755 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 569/1140] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:39:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 17:39:11.216397 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edb3172-b606-4609-9c9b-d1000b7fd771 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:11.327273 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edb3172-b606-4609-9c9b-d1000b7fd771 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:11.339551 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:11.365602 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e759e5e-6956-4516-8784-a6ec6db633b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:11.366618 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e759e5e-6956-4516-8784-a6ec6db633b3 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:11.367191 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e759e5e-6956-4516-8784-a6ec6db633b3 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:11.367879 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e759e5e-6956-4516-8784-a6ec6db633b3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:11.380202 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e759e5e-6956-4516-8784-a6ec6db633b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:39:11.388458 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-1e759e5e-6956-4516-8784-a6ec6db633b3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 17:39:11.388458 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:11.388458 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:11.388458 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:11.388458 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:11.388458 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:11.388458 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:11.388458 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:11.388458 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:11.388458 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:11.388458 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:11.388458 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:11.388458 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:39:11.388458 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:39:11.388458 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:39:11.388458 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:39:11.390459 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:39:11.390459 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:39:11.390459 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:39:11.390459 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:39:11.390459 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:11.390459 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:11.390459 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:11.390459 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:11.390459 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:11.390459 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:11.390459 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:11.390459 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:11.390459 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:11.390459 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:11.390459 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:11.390459 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:11.392276 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:11.392276 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:11.392276 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:11.392276 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:11.392276 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:39:11.392276 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:39:11.392276 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:39:11.392276 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:39:11.392276 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:39:11.392276 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:39:11.392276 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 17:39:11.392276 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:39:11.392276 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 572/1141] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jun 14 17:39:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:11.397276 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db191fc1-78d0-47a9-98c3-9df70feaaff9 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:11.468432 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:11.502380 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db191fc1-78d0-47a9-98c3-9df70feaaff9 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:11.540180 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23269393-a159-4708-ae6e-7f62713b88b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:11.540860 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23269393-a159-4708-ae6e-7f62713b88b4 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:11.541162 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23269393-a159-4708-ae6e-7f62713b88b4 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:11.541440 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23269393-a159-4708-ae6e-7f62713b88b4 None admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:11.542228 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23269393-a159-4708-ae6e-7f62713b88b4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:11.542540 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23269393-a159-4708-ae6e-7f62713b88b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:11.543956 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23269393-a159-4708-ae6e-7f62713b88b4 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:11.554264 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 570/1142] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 14 17:39:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:11.560626 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e759e5e-6956-4516-8784-a6ec6db633b3 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:11.670764 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e759e5e-6956-4516-8784-a6ec6db633b3 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:11.708205 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c832510-5cea-4dbf-bf81-7c9f5237d93d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:11.709211 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c832510-5cea-4dbf-bf81-7c9f5237d93d None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:11.709712 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c832510-5cea-4dbf-bf81-7c9f5237d93d None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:11.710001 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c832510-5cea-4dbf-bf81-7c9f5237d93d None admin] PATH_INFO: `/v3/users/69275d0a8d91461daaa82ad686a801b0` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:11.728064 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c832510-5cea-4dbf-bf81-7c9f5237d93d None admin] RBAC: Authorizing `identity:get_user(user_id=69275d0a8d91461daaa82ad686a801b0)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:11.729426 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c832510-5cea-4dbf-bf81-7c9f5237d93d None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:11.731206 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 573/1143] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 14 17:39:11 2022] GET /identity/v3/users/69275d0a8d91461daaa82ad686a801b0 => generated 286 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:39:11.738188 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23269393-a159-4708-ae6e-7f62713b88b4 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:11.915453 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23269393-a159-4708-ae6e-7f62713b88b4 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:11.964033 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:11.973287 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c94b2a-8aa8-4c8e-964d-271b20a3259a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:11.974402 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c94b2a-8aa8-4c8e-964d-271b20a3259a None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:11.974909 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c94b2a-8aa8-4c8e-964d-271b20a3259a None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:11.981418 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c94b2a-8aa8-4c8e-964d-271b20a3259a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:12.093326 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c94b2a-8aa8-4c8e-964d-271b20a3259a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:12.094793 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c94b2a-8aa8-4c8e-964d-271b20a3259a None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:12.221248 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 571/1144] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 14 17:39:11 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 14 17:39:12.228708 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c832510-5cea-4dbf-bf81-7c9f5237d93d None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:12.278776 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:12.387590 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c832510-5cea-4dbf-bf81-7c9f5237d93d None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:12.437585 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4467950-47e7-4e73-81a0-53bd447a18a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:12.438989 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4467950-47e7-4e73-81a0-53bd447a18a6 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:12.439465 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4467950-47e7-4e73-81a0-53bd447a18a6 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:12.439913 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4467950-47e7-4e73-81a0-53bd447a18a6 None admin] PATH_INFO: `/v3/projects/d08b77190800491e9022b9707c17ca42` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:12.441910 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4467950-47e7-4e73-81a0-53bd447a18a6 None admin] RBAC: Authorizing `identity:get_project(project_id=d08b77190800491e9022b9707c17ca42)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:12.444436 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4467950-47e7-4e73-81a0-53bd447a18a6 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:12.453868 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 574/1145] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 14 17:39:12 2022] GET /identity/v3/projects/d08b77190800491e9022b9707c17ca42 => generated 311 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:39:12.456046 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c94b2a-8aa8-4c8e-964d-271b20a3259a None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:12.493845 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:12.571887 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c94b2a-8aa8-4c8e-964d-271b20a3259a None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:12.609366 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53f0bf7-d764-4404-b38b-ca66a993276b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:12.610030 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53f0bf7-d764-4404-b38b-ca66a993276b None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:12.610320 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53f0bf7-d764-4404-b38b-ca66a993276b None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:12.610600 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53f0bf7-d764-4404-b38b-ca66a993276b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:12.611478 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53f0bf7-d764-4404-b38b-ca66a993276b None admin] RBAC: Adding query filter params (role.id=1348580877d04014bfdec4d866b98a74, scope.project.id=d08b77190800491e9022b9707c17ca42, user.id=69275d0a8d91461daaa82ad686a801b0) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:12.611796 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53f0bf7-d764-4404-b38b-ca66a993276b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:12.613244 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53f0bf7-d764-4404-b38b-ca66a993276b None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:12.619457 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 572/1146] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 14 17:39:12 2022] GET /identity/v3/role_assignments?user.id=69275d0a8d91461daaa82ad686a801b0&scope.project.id=d08b77190800491e9022b9707c17ca42&role.id=1348580877d04014bfdec4d866b98a74 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:39:14.832757 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd9ec7c-c758-4ad5-a89d-ee085676344d None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:14.833356 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd9ec7c-c758-4ad5-a89d-ee085676344d None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:14.833356 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd9ec7c-c758-4ad5-a89d-ee085676344d None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:14.834655 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 575/1147] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:39:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:39:14.840504 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8865c777-b02e-4da5-a71f-c841fcaa2e8e None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:14.841044 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8865c777-b02e-4da5-a71f-c841fcaa2e8e None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:14.841197 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8865c777-b02e-4da5-a71f-c841fcaa2e8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:14.859070 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-8865c777-b02e-4da5-a71f-c841fcaa2e8e None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:39:14.860374 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-8865c777-b02e-4da5-a71f-c841fcaa2e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:39:14.936308 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 573/1148] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:39:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 17:39:14.959597 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd9ec7c-c758-4ad5-a89d-ee085676344d None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:15.079148 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:15.086627 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd9ec7c-c758-4ad5-a89d-ee085676344d None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:15.123633 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4838e3d0-c459-48bd-9226-5e561f5b1fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:15.124440 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4838e3d0-c459-48bd-9226-5e561f5b1fed None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:15.124725 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4838e3d0-c459-48bd-9226-5e561f5b1fed None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:15.125003 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4838e3d0-c459-48bd-9226-5e561f5b1fed None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:15.136382 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4838e3d0-c459-48bd-9226-5e561f5b1fed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:39:15.144704 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-4838e3d0-c459-48bd-9226-5e561f5b1fed None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 17:39:15.144704 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:15.144704 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:15.144704 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:15.144704 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:15.144704 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:15.144704 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:15.144704 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:15.144704 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:15.144704 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:15.144704 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:15.144704 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:15.144704 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:39:15.144704 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:39:15.144704 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:39:15.144704 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:39:15.146401 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:39:15.146401 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:39:15.146401 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:39:15.146401 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:39:15.146401 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:15.146401 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:15.146401 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:15.146401 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:15.146401 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:15.146401 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:15.146401 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:15.146401 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:15.146401 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:15.146401 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:15.146401 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:15.146401 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:15.147337 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:15.147337 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:15.147337 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:15.147337 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:15.147337 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:39:15.147337 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:39:15.147337 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:39:15.147337 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:39:15.147337 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:39:15.147337 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:39:15.147337 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 17:39:15.147337 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:39:15.147337 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 576/1149] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jun 14 17:39:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:15.152415 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8865c777-b02e-4da5-a71f-c841fcaa2e8e None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:15.180092 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:15.263052 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8865c777-b02e-4da5-a71f-c841fcaa2e8e None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:15.300634 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a37bdc5-6ae1-419a-a510-0d91dcd0d7b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:15.301316 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a37bdc5-6ae1-419a-a510-0d91dcd0d7b0 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:15.301606 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a37bdc5-6ae1-419a-a510-0d91dcd0d7b0 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:15.301894 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a37bdc5-6ae1-419a-a510-0d91dcd0d7b0 None admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:15.302650 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a37bdc5-6ae1-419a-a510-0d91dcd0d7b0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:15.302962 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a37bdc5-6ae1-419a-a510-0d91dcd0d7b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:15.304379 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a37bdc5-6ae1-419a-a510-0d91dcd0d7b0 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:15.313823 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 574/1150] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 14 17:39:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:15.320537 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4838e3d0-c459-48bd-9226-5e561f5b1fed None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:15.496132 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4838e3d0-c459-48bd-9226-5e561f5b1fed None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:15.553640 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac14d16-e15c-442a-a029-6d528a072e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:15.554535 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac14d16-e15c-442a-a029-6d528a072e17 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:15.554826 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac14d16-e15c-442a-a029-6d528a072e17 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:15.555110 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac14d16-e15c-442a-a029-6d528a072e17 None admin] PATH_INFO: `/v3/users/69275d0a8d91461daaa82ad686a801b0` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:15.556392 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac14d16-e15c-442a-a029-6d528a072e17 None admin] RBAC: Authorizing `identity:get_user(user_id=69275d0a8d91461daaa82ad686a801b0)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:15.557841 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac14d16-e15c-442a-a029-6d528a072e17 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:15.559536 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 577/1151] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 14 17:39:15 2022] GET /identity/v3/users/69275d0a8d91461daaa82ad686a801b0 => generated 286 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:15.566370 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a37bdc5-6ae1-419a-a510-0d91dcd0d7b0 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:15.661283 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:15.676608 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a37bdc5-6ae1-419a-a510-0d91dcd0d7b0 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:15.713223 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09915be6-6ab9-4d99-99cb-5240ec35f78f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:15.714104 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09915be6-6ab9-4d99-99cb-5240ec35f78f None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:15.714393 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09915be6-6ab9-4d99-99cb-5240ec35f78f None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:15.714678 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09915be6-6ab9-4d99-99cb-5240ec35f78f None admin] PATH_INFO: `/v3/projects/d08b77190800491e9022b9707c17ca42` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:15.715909 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09915be6-6ab9-4d99-99cb-5240ec35f78f None admin] RBAC: Authorizing `identity:get_project(project_id=d08b77190800491e9022b9707c17ca42)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:15.717445 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09915be6-6ab9-4d99-99cb-5240ec35f78f None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:15.719254 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 575/1152] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 14 17:39:15 2022] GET /identity/v3/projects/d08b77190800491e9022b9707c17ca42 => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:39:15.726484 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac14d16-e15c-442a-a029-6d528a072e17 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:15.768820 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:15.853539 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac14d16-e15c-442a-a029-6d528a072e17 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:15.889991 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c90e4f-3dfc-47d7-8f98-af90398e9f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:15.890904 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c90e4f-3dfc-47d7-8f98-af90398e9f98 None admin] REQUEST_METHOD: `PUT` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:15.891187 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c90e4f-3dfc-47d7-8f98-af90398e9f98 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:15.891492 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c90e4f-3dfc-47d7-8f98-af90398e9f98 None admin] PATH_INFO: `/v3/projects/d08b77190800491e9022b9707c17ca42/users/69275d0a8d91461daaa82ad686a801b0/roles/1348580877d04014bfdec4d866b98a74` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:15.893582 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c90e4f-3dfc-47d7-8f98-af90398e9f98 None admin] RBAC: Authorizing `identity:create_grant(project_id=d08b77190800491e9022b9707c17ca42, user_id=69275d0a8d91461daaa82ad686a801b0, role_id=1348580877d04014bfdec4d866b98a74)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:15.895025 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c90e4f-3dfc-47d7-8f98-af90398e9f98 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:15.991665 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 578/1153] 10.222.0.36 () {58 vars in 1439 bytes} [Tue Jun 14 17:39:15 2022] PUT /identity/v3/projects/d08b77190800491e9022b9707c17ca42/users/69275d0a8d91461daaa82ad686a801b0/roles/1348580877d04014bfdec4d866b98a74 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:39:18.244763 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef8afd3-a546-4fd1-81bf-7f45454bea98 None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:18.245363 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef8afd3-a546-4fd1-81bf-7f45454bea98 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:18.245363 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef8afd3-a546-4fd1-81bf-7f45454bea98 None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:18.246926 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 576/1154] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:39:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:39:18.254146 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228d0318-44e3-4a51-8aca-84b23702fef8 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:18.254721 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228d0318-44e3-4a51-8aca-84b23702fef8 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:18.254721 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228d0318-44e3-4a51-8aca-84b23702fef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:18.272324 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-228d0318-44e3-4a51-8aca-84b23702fef8 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:39:18.273549 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-228d0318-44e3-4a51-8aca-84b23702fef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:39:18.348243 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 579/1155] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:39:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 17:39:18.372770 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef8afd3-a546-4fd1-81bf-7f45454bea98 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:18.484359 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef8afd3-a546-4fd1-81bf-7f45454bea98 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:18.520934 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faac2c78-589d-4430-a33b-a7cc419c37cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:18.521659 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faac2c78-589d-4430-a33b-a7cc419c37cd None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:18.521950 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faac2c78-589d-4430-a33b-a7cc419c37cd None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:18.522235 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faac2c78-589d-4430-a33b-a7cc419c37cd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:18.534748 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faac2c78-589d-4430-a33b-a7cc419c37cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:39:18.542600 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-faac2c78-589d-4430-a33b-a7cc419c37cd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 17:39:18.542600 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:18.542600 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:18.542600 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:18.542600 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:18.542600 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:18.542600 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:18.542600 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:18.542600 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:18.542600 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:18.542600 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:18.542600 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:18.542600 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:39:18.542600 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:39:18.542600 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:39:18.542600 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:39:18.544481 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:39:18.544481 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:39:18.544481 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:39:18.544481 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:39:18.544481 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:18.544481 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:18.544481 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:18.544481 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:18.544481 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:18.544481 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:18.544481 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:18.544481 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:18.544481 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:18.544481 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:18.544481 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:18.544481 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:18.546738 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:18.546738 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:18.546738 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:18.546738 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:18.546738 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:39:18.546738 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:39:18.546738 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:39:18.546738 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:39:18.546738 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:39:18.546738 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:39:18.546738 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 17:39:18.546738 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:39:18.546738 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 577/1156] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jun 14 17:39:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 17:39:18.550944 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228d0318-44e3-4a51-8aca-84b23702fef8 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:18.567154 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:18.661213 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228d0318-44e3-4a51-8aca-84b23702fef8 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:18.697771 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8213a84c-9143-457a-a8ce-75b61d903f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:18.698463 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8213a84c-9143-457a-a8ce-75b61d903f06 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:18.698750 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8213a84c-9143-457a-a8ce-75b61d903f06 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:18.699033 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8213a84c-9143-457a-a8ce-75b61d903f06 None admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:18.699828 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8213a84c-9143-457a-a8ce-75b61d903f06 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:18.700142 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8213a84c-9143-457a-a8ce-75b61d903f06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:18.702106 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8213a84c-9143-457a-a8ce-75b61d903f06 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:18.711326 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 580/1157] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 14 17:39:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:39:18.720779 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faac2c78-589d-4430-a33b-a7cc419c37cd None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:18.737346 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:18.861364 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faac2c78-589d-4430-a33b-a7cc419c37cd None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:18.925464 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f1ca76-d6ca-4f00-b41a-867f71caf2b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:18.927089 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f1ca76-d6ca-4f00-b41a-867f71caf2b7 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:18.927652 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f1ca76-d6ca-4f00-b41a-867f71caf2b7 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:18.928156 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f1ca76-d6ca-4f00-b41a-867f71caf2b7 None admin] PATH_INFO: `/v3/users/69275d0a8d91461daaa82ad686a801b0` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:18.930611 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f1ca76-d6ca-4f00-b41a-867f71caf2b7 None admin] RBAC: Authorizing `identity:get_user(user_id=69275d0a8d91461daaa82ad686a801b0)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:18.933627 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f1ca76-d6ca-4f00-b41a-867f71caf2b7 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:18.937134 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 578/1158] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 14 17:39:18 2022] GET /identity/v3/users/69275d0a8d91461daaa82ad686a801b0 => generated 286 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:18.943576 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8213a84c-9143-457a-a8ce-75b61d903f06 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:19.027170 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:19.052035 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8213a84c-9143-457a-a8ce-75b61d903f06 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:19.088070 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5361824-18fa-496f-bcc8-ef03052f132e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:19.088948 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5361824-18fa-496f-bcc8-ef03052f132e None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:19.089283 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5361824-18fa-496f-bcc8-ef03052f132e None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:19.089615 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5361824-18fa-496f-bcc8-ef03052f132e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:19.165127 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5361824-18fa-496f-bcc8-ef03052f132e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:19.166587 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5361824-18fa-496f-bcc8-ef03052f132e None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:19.250198 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:19.276116 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 581/1159] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 14 17:39:18 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 14 17:39:19.283399 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f1ca76-d6ca-4f00-b41a-867f71caf2b7 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:19.383050 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:19.402997 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f1ca76-d6ca-4f00-b41a-867f71caf2b7 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:19.441420 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47756d4-10e1-4d21-a7f3-c597cd9c574f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:19.442204 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47756d4-10e1-4d21-a7f3-c597cd9c574f None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:19.442490 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47756d4-10e1-4d21-a7f3-c597cd9c574f None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:19.442770 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47756d4-10e1-4d21-a7f3-c597cd9c574f None admin] PATH_INFO: `/v3/projects/d08b77190800491e9022b9707c17ca42` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:19.443986 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47756d4-10e1-4d21-a7f3-c597cd9c574f None admin] RBAC: Authorizing `identity:get_project(project_id=d08b77190800491e9022b9707c17ca42)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:19.445464 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47756d4-10e1-4d21-a7f3-c597cd9c574f None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:19.447203 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 579/1160] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 14 17:39:19 2022] GET /identity/v3/projects/d08b77190800491e9022b9707c17ca42 => generated 311 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:19.454409 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5361824-18fa-496f-bcc8-ef03052f132e None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:19.572856 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5361824-18fa-496f-bcc8-ef03052f132e None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:19.611523 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293fdf8d-0e34-43fa-acbe-01d248ae971e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:19.612204 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293fdf8d-0e34-43fa-acbe-01d248ae971e None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:19.612492 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293fdf8d-0e34-43fa-acbe-01d248ae971e None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:19.612773 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293fdf8d-0e34-43fa-acbe-01d248ae971e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:19.613614 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293fdf8d-0e34-43fa-acbe-01d248ae971e None admin] RBAC: Adding query filter params (role.id=1348580877d04014bfdec4d866b98a74, scope.project.id=d08b77190800491e9022b9707c17ca42, user.id=69275d0a8d91461daaa82ad686a801b0) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:19.613933 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293fdf8d-0e34-43fa-acbe-01d248ae971e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:19.615410 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293fdf8d-0e34-43fa-acbe-01d248ae971e None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:19.621793 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 582/1161] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 14 17:39:19 2022] GET /identity/v3/role_assignments?user.id=69275d0a8d91461daaa82ad686a801b0&scope.project.id=d08b77190800491e9022b9707c17ca42&role.id=1348580877d04014bfdec4d866b98a74 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:21.864067 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbdb96e-0732-45db-aaab-b2f2c13e8267 None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:21.864616 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbdb96e-0732-45db-aaab-b2f2c13e8267 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:21.864774 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbdb96e-0732-45db-aaab-b2f2c13e8267 None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:21.866140 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 580/1162] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:39:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:39:21.871803 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cef60b-d2d4-46e7-9081-3d74461f0032 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:21.872263 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cef60b-d2d4-46e7-9081-3d74461f0032 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:21.872933 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cef60b-d2d4-46e7-9081-3d74461f0032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:21.890746 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-79cef60b-d2d4-46e7-9081-3d74461f0032 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:39:21.891988 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-79cef60b-d2d4-46e7-9081-3d74461f0032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:39:21.930257 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:21.964262 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 583/1163] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:39:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 17:39:21.989834 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbdb96e-0732-45db-aaab-b2f2c13e8267 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:22.103457 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbdb96e-0732-45db-aaab-b2f2c13e8267 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:22.141589 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79466e5-b1c6-4d5d-9c43-d2985c36a363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:22.142156 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79466e5-b1c6-4d5d-9c43-d2985c36a363 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:22.142442 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79466e5-b1c6-4d5d-9c43-d2985c36a363 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:22.142722 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79466e5-b1c6-4d5d-9c43-d2985c36a363 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:22.163417 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:22.214987 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79466e5-b1c6-4d5d-9c43-d2985c36a363 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:22.217329 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79466e5-b1c6-4d5d-9c43-d2985c36a363 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:22.329436 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 581/1164] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 14 17:39:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 14 17:39:22.339381 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cef60b-d2d4-46e7-9081-3d74461f0032 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:22.519239 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cef60b-d2d4-46e7-9081-3d74461f0032 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:22.566258 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f4986d-78c7-4edb-a98f-78b5a08ab554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:22.567077 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f4986d-78c7-4edb-a98f-78b5a08ab554 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:22.567392 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f4986d-78c7-4edb-a98f-78b5a08ab554 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:22.567674 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f4986d-78c7-4edb-a98f-78b5a08ab554 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:22.574949 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f4986d-78c7-4edb-a98f-78b5a08ab554 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:22.576556 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f4986d-78c7-4edb-a98f-78b5a08ab554 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:22.592486 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-b9f4986d-78c7-4edb-a98f-78b5a08ab554 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 14 17:39:22.592486 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:22.592486 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 14 17:39:22.592486 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 14 17:39:22.592486 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 14 17:39:22.592486 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 14 17:39:22.592486 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 14 17:39:22.592486 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 14 17:39:22.592486 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 14 17:39:22.592486 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:39:22.592486 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 14 17:39:22.592486 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:39:22.592486 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:22.592486 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:22.592486 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:22.592486 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:22.592486 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:22.594806 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:22.594806 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:22.594806 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:22.594806 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:22.594806 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:22.594806 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:22.594806 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:39:22.594806 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:39:22.594806 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:39:22.594806 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:39:22.594806 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:22.594806 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:22.594806 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:22.594806 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:22.594806 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:22.594806 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:22.596785 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:22.596785 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:22.596785 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:22.596785 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:22.596785 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:22.596785 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:22.596785 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:22.596785 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:22.596785 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:22.596785 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:22.596785 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 14 17:39:22.596785 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:39:22.596785 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 14 17:39:22.596785 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:39:22.596785 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 584/1165] 10.222.0.36 () {56 vars in 1117 bytes} [Tue Jun 14 17:39:22 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:22.600668 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79466e5-b1c6-4d5d-9c43-d2985c36a363 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:22.657943 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:22.711700 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79466e5-b1c6-4d5d-9c43-d2985c36a363 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:22.749996 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d519f1b-5590-47f2-97ea-2a970209c19e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:22.750674 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d519f1b-5590-47f2-97ea-2a970209c19e None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:22.750964 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d519f1b-5590-47f2-97ea-2a970209c19e None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:22.751249 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d519f1b-5590-47f2-97ea-2a970209c19e None admin] PATH_INFO: `/v3/domains` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:22.752011 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d519f1b-5590-47f2-97ea-2a970209c19e None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:22.752322 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d519f1b-5590-47f2-97ea-2a970209c19e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:22.753994 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d519f1b-5590-47f2-97ea-2a970209c19e None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:22.762113 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 582/1166] 10.222.0.36 () {56 vars in 1115 bytes} [Tue Jun 14 17:39:22 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:24.970692 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b88a256-1fba-4af6-b4fe-f28f3aec6993 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:24.971255 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b88a256-1fba-4af6-b4fe-f28f3aec6993 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:24.971765 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b88a256-1fba-4af6-b4fe-f28f3aec6993 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:24.974409 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 585/1167] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:39:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:39:24.980352 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a10468-91b1-469d-bdec-f097e88eaa6b None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:24.980894 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a10468-91b1-469d-bdec-f097e88eaa6b None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:24.981015 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a10468-91b1-469d-bdec-f097e88eaa6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:24.998524 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-35a10468-91b1-469d-bdec-f097e88eaa6b None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:39:24.999789 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-35a10468-91b1-469d-bdec-f097e88eaa6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:39:25.077506 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 583/1168] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:39:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 17:39:25.101505 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b88a256-1fba-4af6-b4fe-f28f3aec6993 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:25.139171 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:25.215631 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b88a256-1fba-4af6-b4fe-f28f3aec6993 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:25.252592 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3ac423-fba2-4672-9a99-a5db43b19efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:25.253521 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3ac423-fba2-4672-9a99-a5db43b19efa None admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:25.253810 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3ac423-fba2-4672-9a99-a5db43b19efa None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:25.254095 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3ac423-fba2-4672-9a99-a5db43b19efa None admin] PATH_INFO: `/v3/domains` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:25.254864 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3ac423-fba2-4672-9a99-a5db43b19efa None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:25.256278 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3ac423-fba2-4672-9a99-a5db43b19efa None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:25.332990 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 586/1169] 10.222.0.36 () {60 vars in 1138 bytes} [Tue Jun 14 17:39:25 2022] POST /identity/v3/domains => generated 267 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 17:39:27.578996 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c78cc59-1645-4ea3-acfc-a4c9bc92ecbb None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:27.579694 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c78cc59-1645-4ea3-acfc-a4c9bc92ecbb None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:27.579694 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c78cc59-1645-4ea3-acfc-a4c9bc92ecbb None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:27.581134 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 584/1170] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:39:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:39:27.586944 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c37de7-add9-4ff9-b9ef-e99c45c903e4 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:27.587569 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c37de7-add9-4ff9-b9ef-e99c45c903e4 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:27.587569 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c37de7-add9-4ff9-b9ef-e99c45c903e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:27.606153 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-20c37de7-add9-4ff9-b9ef-e99c45c903e4 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:39:27.607671 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-20c37de7-add9-4ff9-b9ef-e99c45c903e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:39:27.682815 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 587/1171] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:39:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 17:39:27.708189 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c78cc59-1645-4ea3-acfc-a4c9bc92ecbb None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:27.761588 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:27.856046 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c78cc59-1645-4ea3-acfc-a4c9bc92ecbb None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:27.905922 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018dd08e-ed4e-409a-be2c-57ec594a40a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:27.906337 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018dd08e-ed4e-409a-be2c-57ec594a40a1 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:27.906628 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018dd08e-ed4e-409a-be2c-57ec594a40a1 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:27.906911 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018dd08e-ed4e-409a-be2c-57ec594a40a1 None admin] PATH_INFO: `/v3/domains/8368a02103384d6494a595af50e76d83` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:27.918674 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018dd08e-ed4e-409a-be2c-57ec594a40a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=8368a02103384d6494a595af50e76d83)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:27.920741 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018dd08e-ed4e-409a-be2c-57ec594a40a1 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:27.922519 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 585/1172] 10.222.0.36 () {56 vars in 1183 bytes} [Tue Jun 14 17:39:27 2022] GET /identity/v3/domains/8368a02103384d6494a595af50e76d83 => generated 267 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:27.932314 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c37de7-add9-4ff9-b9ef-e99c45c903e4 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:27.962673 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:28.051545 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c37de7-add9-4ff9-b9ef-e99c45c903e4 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:28.088927 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7afd62-ab52-4fd2-b39d-0c50eb764b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:28.093427 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7afd62-ab52-4fd2-b39d-0c50eb764b80 None admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:28.093427 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7afd62-ab52-4fd2-b39d-0c50eb764b80 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:28.093427 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7afd62-ab52-4fd2-b39d-0c50eb764b80 None admin] PATH_INFO: `/v3/projects` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:28.093427 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7afd62-ab52-4fd2-b39d-0c50eb764b80 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:28.093427 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7afd62-ab52-4fd2-b39d-0c50eb764b80 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:28.225987 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 588/1173] 10.222.0.36 () {60 vars in 1141 bytes} [Tue Jun 14 17:39:27 2022] POST /identity/v3/projects => generated 361 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:39:30.486440 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9c8241-da68-4136-9258-21f4543ea2b7 None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:30.487344 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9c8241-da68-4136-9258-21f4543ea2b7 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:30.487598 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9c8241-da68-4136-9258-21f4543ea2b7 None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:30.489092 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 586/1174] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:39:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 14 17:39:30.494946 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23558c9-1008-4914-869c-938779bd6892 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:30.495532 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23558c9-1008-4914-869c-938779bd6892 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:30.495532 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23558c9-1008-4914-869c-938779bd6892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:30.513944 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-a23558c9-1008-4914-869c-938779bd6892 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:39:30.515167 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-a23558c9-1008-4914-869c-938779bd6892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:39:30.586483 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 589/1175] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:39:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 14 17:39:30.613399 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9c8241-da68-4136-9258-21f4543ea2b7 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:30.771075 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9c8241-da68-4136-9258-21f4543ea2b7 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:30.775369 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:30.808886 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c438e9-1c81-45da-81e4-cdb31220f243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:30.810253 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c438e9-1c81-45da-81e4-cdb31220f243 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:30.810572 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c438e9-1c81-45da-81e4-cdb31220f243 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:30.810825 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c438e9-1c81-45da-81e4-cdb31220f243 None admin] PATH_INFO: `/v3/domains/8368a02103384d6494a595af50e76d83` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:30.812301 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c438e9-1c81-45da-81e4-cdb31220f243 None admin] RBAC: Authorizing `identity:get_domain(domain_id=8368a02103384d6494a595af50e76d83)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:30.813747 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c438e9-1c81-45da-81e4-cdb31220f243 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:30.815463 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 587/1176] 10.222.0.36 () {56 vars in 1183 bytes} [Tue Jun 14 17:39:30 2022] GET /identity/v3/domains/8368a02103384d6494a595af50e76d83 => generated 267 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:39:30.821443 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23558c9-1008-4914-869c-938779bd6892 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:30.823680 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:30.939836 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23558c9-1008-4914-869c-938779bd6892 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:30.983054 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc7c527-8a25-4e92-b2ac-2e1ee41b244c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:30.983798 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc7c527-8a25-4e92-b2ac-2e1ee41b244c None admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:30.984087 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc7c527-8a25-4e92-b2ac-2e1ee41b244c None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:30.984368 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc7c527-8a25-4e92-b2ac-2e1ee41b244c None admin] PATH_INFO: `/v3/users` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:30.985130 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc7c527-8a25-4e92-b2ac-2e1ee41b244c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:30.986677 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc7c527-8a25-4e92-b2ac-2e1ee41b244c None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:31.090384 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 590/1177] 10.222.0.36 () {60 vars in 1132 bytes} [Tue Jun 14 17:39:30 2022] POST /identity/v3/users => generated 311 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:39:33.436944 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3add4ecc-fd9c-4136-b93f-c39460622b91 None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:33.437551 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3add4ecc-fd9c-4136-b93f-c39460622b91 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:33.437551 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3add4ecc-fd9c-4136-b93f-c39460622b91 None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:33.438895 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 588/1178] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:39:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:39:33.444820 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be35620-b6e6-45a3-b050-e3e5f4a6226d None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:33.445370 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be35620-b6e6-45a3-b050-e3e5f4a6226d None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:33.445370 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be35620-b6e6-45a3-b050-e3e5f4a6226d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:33.463580 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-9be35620-b6e6-45a3-b050-e3e5f4a6226d None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:39:33.464821 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-9be35620-b6e6-45a3-b050-e3e5f4a6226d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:39:33.525939 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:33.540839 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 591/1179] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:39:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 14 17:39:33.565790 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3add4ecc-fd9c-4136-b93f-c39460622b91 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:33.692159 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3add4ecc-fd9c-4136-b93f-c39460622b91 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:33.750880 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e912983-9244-4aff-b6d3-bcaf265b9e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:33.751729 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e912983-9244-4aff-b6d3-bcaf265b9e7c None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:33.752020 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e912983-9244-4aff-b6d3-bcaf265b9e7c None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:33.752302 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e912983-9244-4aff-b6d3-bcaf265b9e7c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:33.770706 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e912983-9244-4aff-b6d3-bcaf265b9e7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:39:33.779160 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-9e912983-9244-4aff-b6d3-bcaf265b9e7c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 17:39:33.779160 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:33.779160 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:33.779160 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:33.779160 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:33.779160 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:33.779160 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:33.779160 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:33.779160 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:33.779160 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:33.779160 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:33.779160 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:33.779160 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:39:33.779160 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:39:33.779160 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:39:33.779160 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:39:33.781273 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:39:33.781273 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:39:33.781273 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:39:33.781273 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:39:33.781273 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:33.781273 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:33.781273 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:33.781273 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:33.781273 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:33.781273 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:33.781273 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:33.781273 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:33.781273 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:33.781273 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:33.781273 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:33.781273 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:33.783388 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:33.783388 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:33.783388 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:33.783388 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:33.783388 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:39:33.783388 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:39:33.783388 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:39:33.783388 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:39:33.783388 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:39:33.783388 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:39:33.783388 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 17:39:33.783388 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:39:33.783388 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 589/1180] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jun 14 17:39:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:33.788428 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be35620-b6e6-45a3-b050-e3e5f4a6226d None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:33.907652 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be35620-b6e6-45a3-b050-e3e5f4a6226d None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:33.968248 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400db1a8-9fe6-4522-b337-fc2771297f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:33.969227 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400db1a8-9fe6-4522-b337-fc2771297f27 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:33.969704 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400db1a8-9fe6-4522-b337-fc2771297f27 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:33.970182 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400db1a8-9fe6-4522-b337-fc2771297f27 None admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:33.971540 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400db1a8-9fe6-4522-b337-fc2771297f27 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:33.972061 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400db1a8-9fe6-4522-b337-fc2771297f27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:33.974496 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400db1a8-9fe6-4522-b337-fc2771297f27 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:33.989523 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 592/1181] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 14 17:39:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:33.997297 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e912983-9244-4aff-b6d3-bcaf265b9e7c None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:34.033843 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:34.113645 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e912983-9244-4aff-b6d3-bcaf265b9e7c None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:34.151753 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31faa81-bca5-488c-bd34-f26500677e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:34.152644 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31faa81-bca5-488c-bd34-f26500677e91 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:34.152937 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31faa81-bca5-488c-bd34-f26500677e91 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:34.153310 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31faa81-bca5-488c-bd34-f26500677e91 None admin] PATH_INFO: `/v3/users/df55364991f44b1eb3a02958b7ab62c6` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:34.167917 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31faa81-bca5-488c-bd34-f26500677e91 None admin] RBAC: Authorizing `identity:get_user(user_id=df55364991f44b1eb3a02958b7ab62c6)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:34.169881 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31faa81-bca5-488c-bd34-f26500677e91 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:34.171706 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 590/1182] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 14 17:39:33 2022] GET /identity/v3/users/df55364991f44b1eb3a02958b7ab62c6 => generated 311 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:39:34.177898 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400db1a8-9fe6-4522-b337-fc2771297f27 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:34.234587 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:34.296979 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400db1a8-9fe6-4522-b337-fc2771297f27 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:34.338124 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181a942e-7931-4ecf-928e-e786a7db3716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:34.338810 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181a942e-7931-4ecf-928e-e786a7db3716 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:34.339096 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181a942e-7931-4ecf-928e-e786a7db3716 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:34.339417 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181a942e-7931-4ecf-928e-e786a7db3716 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:34.426407 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181a942e-7931-4ecf-928e-e786a7db3716 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:34.428033 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181a942e-7931-4ecf-928e-e786a7db3716 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:34.487654 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:34.549210 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 593/1183] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 14 17:39:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 14 17:39:34.555576 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31faa81-bca5-488c-bd34-f26500677e91 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:34.663086 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:34.674441 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31faa81-bca5-488c-bd34-f26500677e91 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:34.711513 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6688a79-1259-4f80-b00b-2b70f5107b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:34.712394 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6688a79-1259-4f80-b00b-2b70f5107b7a None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:34.712678 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6688a79-1259-4f80-b00b-2b70f5107b7a None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:34.712955 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6688a79-1259-4f80-b00b-2b70f5107b7a None admin] PATH_INFO: `/v3/projects/757a334ad88543efb9750cf92db1d34b` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:34.714184 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6688a79-1259-4f80-b00b-2b70f5107b7a None admin] RBAC: Authorizing `identity:get_project(project_id=757a334ad88543efb9750cf92db1d34b)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:34.716023 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6688a79-1259-4f80-b00b-2b70f5107b7a None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:34.718086 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 591/1184] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 14 17:39:34 2022] GET /identity/v3/projects/757a334ad88543efb9750cf92db1d34b => generated 361 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:34.724495 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181a942e-7931-4ecf-928e-e786a7db3716 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:34.834672 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181a942e-7931-4ecf-928e-e786a7db3716 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:34.874829 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3625f066-2b0a-47d2-a5e3-ae09c6569fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:34.875538 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3625f066-2b0a-47d2-a5e3-ae09c6569fe2 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:34.875828 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3625f066-2b0a-47d2-a5e3-ae09c6569fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:34.876116 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3625f066-2b0a-47d2-a5e3-ae09c6569fe2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:34.876962 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3625f066-2b0a-47d2-a5e3-ae09c6569fe2 None admin] RBAC: Adding query filter params (role.id=1348580877d04014bfdec4d866b98a74, scope.project.id=757a334ad88543efb9750cf92db1d34b, user.id=df55364991f44b1eb3a02958b7ab62c6) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:34.877280 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3625f066-2b0a-47d2-a5e3-ae09c6569fe2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:34.878989 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3625f066-2b0a-47d2-a5e3-ae09c6569fe2 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:34.885545 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 594/1185] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 14 17:39:34 2022] GET /identity/v3/role_assignments?user.id=df55364991f44b1eb3a02958b7ab62c6&scope.project.id=757a334ad88543efb9750cf92db1d34b&role.id=1348580877d04014bfdec4d866b98a74 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:39:37.140415 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3ad084-5174-4e33-8816-a8b7f62de655 None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:37.140984 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3ad084-5174-4e33-8816-a8b7f62de655 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:37.140984 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3ad084-5174-4e33-8816-a8b7f62de655 None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:37.142433 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 592/1186] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:39:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:39:37.148529 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725196e4-9f06-48e6-9dbc-d349e6c71130 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:37.149304 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725196e4-9f06-48e6-9dbc-d349e6c71130 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:37.149486 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725196e4-9f06-48e6-9dbc-d349e6c71130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:37.167975 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-725196e4-9f06-48e6-9dbc-d349e6c71130 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:39:37.171397 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-725196e4-9f06-48e6-9dbc-d349e6c71130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:39:37.183085 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:37.252650 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 595/1187] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:39:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 14 17:39:37.277998 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3ad084-5174-4e33-8816-a8b7f62de655 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:37.387220 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3ad084-5174-4e33-8816-a8b7f62de655 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:37.424978 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e528b5d-0087-4802-a3fc-ba96aa1fb2ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:37.425701 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e528b5d-0087-4802-a3fc-ba96aa1fb2ed None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:37.425989 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e528b5d-0087-4802-a3fc-ba96aa1fb2ed None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:37.426270 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e528b5d-0087-4802-a3fc-ba96aa1fb2ed None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:37.438534 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e528b5d-0087-4802-a3fc-ba96aa1fb2ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:39:37.446297 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-5e528b5d-0087-4802-a3fc-ba96aa1fb2ed None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 17:39:37.446297 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:37.446297 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:37.446297 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:37.446297 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:37.446297 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:37.446297 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:37.446297 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:37.446297 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:37.446297 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:37.446297 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:37.446297 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:37.446297 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:39:37.446297 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:39:37.446297 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:39:37.446297 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:39:37.448034 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:39:37.448034 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:39:37.448034 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:39:37.448034 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:39:37.448034 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:37.448034 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:37.448034 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:37.448034 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:37.448034 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:37.448034 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:37.448034 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:37.448034 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:37.448034 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:37.448034 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:37.448034 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:37.448034 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:37.448979 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:37.448979 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:37.448979 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:37.448979 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:37.448979 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:39:37.448979 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:39:37.448979 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:39:37.448979 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:39:37.448979 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:39:37.448979 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:39:37.448979 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 17:39:37.448979 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:39:37.448979 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 593/1188] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jun 14 17:39:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:37.459110 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725196e4-9f06-48e6-9dbc-d349e6c71130 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:37.633009 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725196e4-9f06-48e6-9dbc-d349e6c71130 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:37.674424 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c619772f-6fad-4903-bb28-24ef225e7720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:37.675242 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c619772f-6fad-4903-bb28-24ef225e7720 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:37.675575 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c619772f-6fad-4903-bb28-24ef225e7720 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:37.675905 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c619772f-6fad-4903-bb28-24ef225e7720 None admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:37.676775 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c619772f-6fad-4903-bb28-24ef225e7720 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:37.677137 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c619772f-6fad-4903-bb28-24ef225e7720 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:37.678645 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c619772f-6fad-4903-bb28-24ef225e7720 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:37.688900 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 596/1189] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 14 17:39:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:37.697913 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e528b5d-0087-4802-a3fc-ba96aa1fb2ed None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:37.720740 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:37.810744 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e528b5d-0087-4802-a3fc-ba96aa1fb2ed None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:37.846978 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d238fc7-64d1-47fb-b693-412942681068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:37.847897 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d238fc7-64d1-47fb-b693-412942681068 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:37.848190 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d238fc7-64d1-47fb-b693-412942681068 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:37.848476 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d238fc7-64d1-47fb-b693-412942681068 None admin] PATH_INFO: `/v3/users/df55364991f44b1eb3a02958b7ab62c6` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:37.849785 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d238fc7-64d1-47fb-b693-412942681068 None admin] RBAC: Authorizing `identity:get_user(user_id=df55364991f44b1eb3a02958b7ab62c6)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:37.851231 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d238fc7-64d1-47fb-b693-412942681068 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:37.852952 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 594/1190] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 14 17:39:37 2022] GET /identity/v3/users/df55364991f44b1eb3a02958b7ab62c6 => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:37.862162 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c619772f-6fad-4903-bb28-24ef225e7720 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:37.872159 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:37.977464 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c619772f-6fad-4903-bb28-24ef225e7720 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:38.014346 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d5f3e2-5de7-439e-b2cb-f373ec312948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:38.015238 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d5f3e2-5de7-439e-b2cb-f373ec312948 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:38.015559 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d5f3e2-5de7-439e-b2cb-f373ec312948 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:38.015847 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d5f3e2-5de7-439e-b2cb-f373ec312948 None admin] PATH_INFO: `/v3/projects/757a334ad88543efb9750cf92db1d34b` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:38.017129 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d5f3e2-5de7-439e-b2cb-f373ec312948 None admin] RBAC: Authorizing `identity:get_project(project_id=757a334ad88543efb9750cf92db1d34b)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:38.018589 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d5f3e2-5de7-439e-b2cb-f373ec312948 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:38.020444 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 597/1191] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 14 17:39:37 2022] GET /identity/v3/projects/757a334ad88543efb9750cf92db1d34b => generated 361 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:38.026680 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d238fc7-64d1-47fb-b693-412942681068 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:38.123524 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:38.141248 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d238fc7-64d1-47fb-b693-412942681068 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:38.179549 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a702638-af0a-41a8-86d3-b2b9b16e7044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:38.180453 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a702638-af0a-41a8-86d3-b2b9b16e7044 None admin] REQUEST_METHOD: `PUT` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:38.180739 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a702638-af0a-41a8-86d3-b2b9b16e7044 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:38.181023 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a702638-af0a-41a8-86d3-b2b9b16e7044 None admin] PATH_INFO: `/v3/projects/757a334ad88543efb9750cf92db1d34b/users/df55364991f44b1eb3a02958b7ab62c6/roles/1348580877d04014bfdec4d866b98a74` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:38.183047 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a702638-af0a-41a8-86d3-b2b9b16e7044 None admin] RBAC: Authorizing `identity:create_grant(project_id=757a334ad88543efb9750cf92db1d34b, user_id=df55364991f44b1eb3a02958b7ab62c6, role_id=1348580877d04014bfdec4d866b98a74)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:38.184962 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a702638-af0a-41a8-86d3-b2b9b16e7044 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:38.255790 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 595/1192] 10.222.0.36 () {58 vars in 1439 bytes} [Tue Jun 14 17:39:38 2022] PUT /identity/v3/projects/757a334ad88543efb9750cf92db1d34b/users/df55364991f44b1eb3a02958b7ab62c6/roles/1348580877d04014bfdec4d866b98a74 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 17:39:40.452792 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e0df74-0d47-4de7-b74c-2183bc103b53 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:40.453516 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e0df74-0d47-4de7-b74c-2183bc103b53 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:40.453516 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e0df74-0d47-4de7-b74c-2183bc103b53 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:40.454794 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 598/1193] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:39:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:39:40.461307 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3395ee6-9d52-4cd0-9c01-225464df57d0 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:40.461902 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3395ee6-9d52-4cd0-9c01-225464df57d0 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:40.461902 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3395ee6-9d52-4cd0-9c01-225464df57d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:40.486018 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-e3395ee6-9d52-4cd0-9c01-225464df57d0 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:39:40.487844 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-e3395ee6-9d52-4cd0-9c01-225464df57d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:39:40.571715 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 596/1194] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:39:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 17:39:40.596905 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e0df74-0d47-4de7-b74c-2183bc103b53 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:40.685813 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:40.711581 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e0df74-0d47-4de7-b74c-2183bc103b53 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:40.746569 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327922c2-d2a4-49f7-9371-113d0c5d8ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:40.748005 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327922c2-d2a4-49f7-9371-113d0c5d8ee7 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:40.748296 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327922c2-d2a4-49f7-9371-113d0c5d8ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:40.748580 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327922c2-d2a4-49f7-9371-113d0c5d8ee7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:40.759830 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327922c2-d2a4-49f7-9371-113d0c5d8ee7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:39:40.767736 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-327922c2-d2a4-49f7-9371-113d0c5d8ee7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 17:39:40.767736 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:40.767736 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:40.767736 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:40.767736 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:40.767736 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:40.767736 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:40.767736 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:40.767736 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:40.767736 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:40.767736 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:40.767736 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:40.767736 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:39:40.767736 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:39:40.767736 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:39:40.767736 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:39:40.768882 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:39:40.768882 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:39:40.768882 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:39:40.768882 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:39:40.768882 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:40.768882 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:40.768882 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:40.768882 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:40.768882 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:40.768882 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:40.768882 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:40.768882 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:40.768882 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:40.768882 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:40.768882 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:40.768882 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:40.769754 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:40.769754 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:40.769754 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:40.769754 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:40.769754 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:39:40.769754 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:39:40.769754 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:39:40.769754 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:39:40.769754 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:39:40.769754 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:39:40.769754 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 17:39:40.769754 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:39:40.769754 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 599/1195] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jun 14 17:39:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:40.775416 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3395ee6-9d52-4cd0-9c01-225464df57d0 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:40.852690 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:40.876839 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3395ee6-9d52-4cd0-9c01-225464df57d0 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:40.915907 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4166e4b6-a785-4bcc-835e-bd5b1dc9f563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:40.916623 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4166e4b6-a785-4bcc-835e-bd5b1dc9f563 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:40.916915 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4166e4b6-a785-4bcc-835e-bd5b1dc9f563 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:40.917236 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4166e4b6-a785-4bcc-835e-bd5b1dc9f563 None admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:40.918051 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4166e4b6-a785-4bcc-835e-bd5b1dc9f563 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:40.918938 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4166e4b6-a785-4bcc-835e-bd5b1dc9f563 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:40.920617 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4166e4b6-a785-4bcc-835e-bd5b1dc9f563 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:40.930998 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 597/1196] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 14 17:39:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:40.939536 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327922c2-d2a4-49f7-9371-113d0c5d8ee7 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:41.062543 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327922c2-d2a4-49f7-9371-113d0c5d8ee7 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:41.100528 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9250ef43-25b4-40ac-a015-c8f2583945a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:41.101421 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9250ef43-25b4-40ac-a015-c8f2583945a7 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:41.101709 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9250ef43-25b4-40ac-a015-c8f2583945a7 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:41.101995 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9250ef43-25b4-40ac-a015-c8f2583945a7 None admin] PATH_INFO: `/v3/users/df55364991f44b1eb3a02958b7ab62c6` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:41.103284 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9250ef43-25b4-40ac-a015-c8f2583945a7 None admin] RBAC: Authorizing `identity:get_user(user_id=df55364991f44b1eb3a02958b7ab62c6)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:41.104771 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9250ef43-25b4-40ac-a015-c8f2583945a7 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:41.107173 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 600/1197] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 14 17:39:40 2022] GET /identity/v3/users/df55364991f44b1eb3a02958b7ab62c6 => generated 311 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:41.115570 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4166e4b6-a785-4bcc-835e-bd5b1dc9f563 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:41.229566 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4166e4b6-a785-4bcc-835e-bd5b1dc9f563 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:41.272984 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbdcf40-f439-4505-8976-ad8e0cfc7981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:41.273659 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbdcf40-f439-4505-8976-ad8e0cfc7981 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:41.273948 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbdcf40-f439-4505-8976-ad8e0cfc7981 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:41.274231 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbdcf40-f439-4505-8976-ad8e0cfc7981 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:41.285445 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:41.354255 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbdcf40-f439-4505-8976-ad8e0cfc7981 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:41.356028 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbdcf40-f439-4505-8976-ad8e0cfc7981 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:41.465080 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 598/1198] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 14 17:39:41 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 14 17:39:41.472311 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9250ef43-25b4-40ac-a015-c8f2583945a7 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:41.475684 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:41.596805 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9250ef43-25b4-40ac-a015-c8f2583945a7 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:41.635972 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ad7cb6-801c-45ac-8719-213e8fd06981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:41.636787 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ad7cb6-801c-45ac-8719-213e8fd06981 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:41.637075 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ad7cb6-801c-45ac-8719-213e8fd06981 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:41.637942 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ad7cb6-801c-45ac-8719-213e8fd06981 None admin] PATH_INFO: `/v3/projects/757a334ad88543efb9750cf92db1d34b` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:41.639662 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ad7cb6-801c-45ac-8719-213e8fd06981 None admin] RBAC: Authorizing `identity:get_project(project_id=757a334ad88543efb9750cf92db1d34b)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:41.641176 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ad7cb6-801c-45ac-8719-213e8fd06981 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:41.643040 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 601/1199] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 14 17:39:41 2022] GET /identity/v3/projects/757a334ad88543efb9750cf92db1d34b => generated 361 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:41.649568 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbdcf40-f439-4505-8976-ad8e0cfc7981 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:41.694814 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:41.760298 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbdcf40-f439-4505-8976-ad8e0cfc7981 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:41.797160 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4865c8-0f40-467c-944f-48aa9c5cbd18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:41.797889 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4865c8-0f40-467c-944f-48aa9c5cbd18 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:41.798217 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4865c8-0f40-467c-944f-48aa9c5cbd18 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:41.798539 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4865c8-0f40-467c-944f-48aa9c5cbd18 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:41.799536 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4865c8-0f40-467c-944f-48aa9c5cbd18 None admin] RBAC: Adding query filter params (role.id=1348580877d04014bfdec4d866b98a74, scope.project.id=757a334ad88543efb9750cf92db1d34b, user.id=df55364991f44b1eb3a02958b7ab62c6) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:41.799894 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4865c8-0f40-467c-944f-48aa9c5cbd18 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:41.801374 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4865c8-0f40-467c-944f-48aa9c5cbd18 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:41.807782 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 599/1200] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 14 17:39:41 2022] GET /identity/v3/role_assignments?user.id=df55364991f44b1eb3a02958b7ab62c6&scope.project.id=757a334ad88543efb9750cf92db1d34b&role.id=1348580877d04014bfdec4d866b98a74 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:39:51.631312 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=65 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:51.804922 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=49 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:41:00.803862 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39cbbdc-e28d-4aed-a4ad-5a85f98e24a7 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:00.804455 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39cbbdc-e28d-4aed-a4ad-5a85f98e24a7 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:00.804455 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39cbbdc-e28d-4aed-a4ad-5a85f98e24a7 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:00.805792 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 602/1201] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:41:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:41:00.812078 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d306953a-e980-4be1-9ca5-596daf82a393 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:00.812566 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d306953a-e980-4be1-9ca5-596daf82a393 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:00.812694 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d306953a-e980-4be1-9ca5-596daf82a393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:00.829896 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-d306953a-e980-4be1-9ca5-596daf82a393 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:41:00.831089 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-d306953a-e980-4be1-9ca5-596daf82a393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:41:00.901515 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 600/1202] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:41:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 17:41:00.925781 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39cbbdc-e28d-4aed-a4ad-5a85f98e24a7 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:41:01.035503 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39cbbdc-e28d-4aed-a4ad-5a85f98e24a7 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:41:01.073947 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c555cd89-90c5-446c-bf6a-0e8bdcc64591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:41:01.074668 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c555cd89-90c5-446c-bf6a-0e8bdcc64591 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:01.074961 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c555cd89-90c5-446c-bf6a-0e8bdcc64591 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:01.075827 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c555cd89-90c5-446c-bf6a-0e8bdcc64591 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:01.086588 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c555cd89-90c5-446c-bf6a-0e8bdcc64591 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:41:01.088076 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c555cd89-90c5-446c-bf6a-0e8bdcc64591 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:41:01.105595 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-c555cd89-90c5-446c-bf6a-0e8bdcc64591 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:41:01.105595 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:41:01.105595 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:41:01.105595 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:41:01.105595 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:41:01.105595 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:41:01.105595 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:41:01.105595 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:41:01.105595 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:41:01.105595 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:41:01.105595 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:41:01.105595 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:41:01.105595 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:41:01.105595 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:41:01.105595 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:41:01.112051 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:41:01.112051 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:41:01.112051 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:41:01.112051 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:41:01.112051 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:41:01.112051 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:41:01.112051 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:41:01.112051 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:41:01.112051 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:41:01.112051 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:41:01.112051 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:41:01.112051 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:41:01.112051 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:41:01.112051 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:41:01.112051 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:41:01.112051 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:41:01.112051 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:41:01.113246 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:41:01.113246 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:41:01.113246 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:41:01.113246 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:41:01.113246 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 603/1203] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 14 17:41:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:41:01.114405 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d306953a-e980-4be1-9ca5-596daf82a393 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:41:01.219198 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d306953a-e980-4be1-9ca5-596daf82a393 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:41:01.250234 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:41:01.256451 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098e53a9-7b1c-48fa-ad89-712ba348accd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:41:01.257114 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e53a9-7b1c-48fa-ad89-712ba348accd None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:01.257393 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e53a9-7b1c-48fa-ad89-712ba348accd None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:01.257666 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e53a9-7b1c-48fa-ad89-712ba348accd None admin] PATH_INFO: `/v3/domains` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:01.258387 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098e53a9-7b1c-48fa-ad89-712ba348accd None admin] RBAC: Adding query filter params (name=Default) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:41:01.258689 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098e53a9-7b1c-48fa-ad89-712ba348accd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:41:01.260093 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098e53a9-7b1c-48fa-ad89-712ba348accd None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:41:01.272851 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 601/1204] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 14 17:41:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:41:01.280038 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c555cd89-90c5-446c-bf6a-0e8bdcc64591 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:41:01.334991 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:41:01.385570 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c555cd89-90c5-446c-bf6a-0e8bdcc64591 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:41:01.423570 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8c4706-5adc-4561-b004-440bd39f5d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:41:01.424250 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8c4706-5adc-4561-b004-440bd39f5d55 None admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:01.424542 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8c4706-5adc-4561-b004-440bd39f5d55 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:01.424825 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8c4706-5adc-4561-b004-440bd39f5d55 None admin] PATH_INFO: `/v3/users` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:01.425542 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8c4706-5adc-4561-b004-440bd39f5d55 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:41:01.426975 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8c4706-5adc-4561-b004-440bd39f5d55 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:41:01.569881 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 604/1205] 10.222.0.36 () {60 vars in 1132 bytes} [Tue Jun 14 17:41:01 2022] POST /identity/v3/users => generated 251 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:41:03.812282 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da63e9ef-db31-4591-bbff-7f0375735b50 None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:03.812887 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da63e9ef-db31-4591-bbff-7f0375735b50 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:03.812887 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da63e9ef-db31-4591-bbff-7f0375735b50 None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:03.814236 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 602/1206] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:41:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:41:03.819578 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64de7ad-7ddd-46e3-a95f-cbcf18d32e11 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:03.820046 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64de7ad-7ddd-46e3-a95f-cbcf18d32e11 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:03.820145 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64de7ad-7ddd-46e3-a95f-cbcf18d32e11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:03.837400 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-e64de7ad-7ddd-46e3-a95f-cbcf18d32e11 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:41:03.838602 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-e64de7ad-7ddd-46e3-a95f-cbcf18d32e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:41:03.910195 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 605/1207] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:41:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 14 17:41:03.935148 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da63e9ef-db31-4591-bbff-7f0375735b50 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:41:04.044926 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da63e9ef-db31-4591-bbff-7f0375735b50 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:41:04.081658 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6913dfe-06e7-4b86-ac20-68ca2210a8a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:41:04.081658 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6913dfe-06e7-4b86-ac20-68ca2210a8a5 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:04.081658 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6913dfe-06e7-4b86-ac20-68ca2210a8a5 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:04.081658 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6913dfe-06e7-4b86-ac20-68ca2210a8a5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:04.092403 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6913dfe-06e7-4b86-ac20-68ca2210a8a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:41:04.100038 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-f6913dfe-06e7-4b86-ac20-68ca2210a8a5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 14 17:41:04.100038 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:41:04.100038 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:41:04.100038 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:41:04.100038 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:41:04.100038 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:41:04.100038 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:41:04.100038 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:41:04.100038 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:41:04.100038 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:41:04.100038 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:41:04.100038 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:41:04.100038 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:41:04.100038 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:41:04.100038 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:41:04.100038 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:41:04.101148 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:41:04.101148 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:41:04.101148 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:41:04.101148 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:41:04.101148 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:41:04.101148 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:41:04.101148 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:41:04.101148 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:41:04.101148 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:41:04.101148 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:41:04.101148 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:41:04.101148 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:41:04.101148 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:41:04.101148 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:41:04.101148 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:41:04.101148 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:41:04.102189 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:41:04.102189 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:41:04.102189 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:41:04.102189 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:41:04.102189 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:41:04.102189 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:41:04.102189 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:41:04.102189 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:41:04.102189 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:41:04.102189 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:41:04.102189 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 14 17:41:04.102189 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:41:04.102189 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 603/1208] 10.222.0.36 () {56 vars in 1102 bytes} [Tue Jun 14 17:41:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:41:04.108349 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64de7ad-7ddd-46e3-a95f-cbcf18d32e11 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:41:04.148800 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:41:04.208747 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64de7ad-7ddd-46e3-a95f-cbcf18d32e11 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:41:04.248703 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9324bb93-0419-4f42-80d8-ad47173c1f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:41:04.249387 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9324bb93-0419-4f42-80d8-ad47173c1f72 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:04.249679 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9324bb93-0419-4f42-80d8-ad47173c1f72 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:04.249963 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9324bb93-0419-4f42-80d8-ad47173c1f72 None admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:04.250750 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9324bb93-0419-4f42-80d8-ad47173c1f72 None admin] RBAC: Adding query filter params (name=service) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:41:04.251063 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9324bb93-0419-4f42-80d8-ad47173c1f72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:41:04.252495 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9324bb93-0419-4f42-80d8-ad47173c1f72 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:41:04.261346 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 606/1209] 10.222.0.36 () {56 vars in 1103 bytes} [Tue Jun 14 17:41:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:41:04.268325 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6913dfe-06e7-4b86-ac20-68ca2210a8a5 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:41:04.319431 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:41:04.370193 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6913dfe-06e7-4b86-ac20-68ca2210a8a5 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:41:04.406070 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0059199b-c08e-4259-a43c-f71e640e188b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:41:04.406877 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0059199b-c08e-4259-a43c-f71e640e188b None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:04.407163 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0059199b-c08e-4259-a43c-f71e640e188b None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:04.407556 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0059199b-c08e-4259-a43c-f71e640e188b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:04.417588 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0059199b-c08e-4259-a43c-f71e640e188b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:41:04.419597 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0059199b-c08e-4259-a43c-f71e640e188b None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:41:04.438443 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-0059199b-c08e-4259-a43c-f71e640e188b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:41:04.438443 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:41:04.438443 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:41:04.438443 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:41:04.438443 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:41:04.438443 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:41:04.438443 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:41:04.438443 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:41:04.438443 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:41:04.438443 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:41:04.438443 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:41:04.438443 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:41:04.438443 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:41:04.438443 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:41:04.438443 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:41:04.443155 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:41:04.443155 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:41:04.443155 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:41:04.443155 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:41:04.443155 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:41:04.443155 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:41:04.443155 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:41:04.443155 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:41:04.443155 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:41:04.443155 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:41:04.443155 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:41:04.443155 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:41:04.443155 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:41:04.443155 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:41:04.443155 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:41:04.443155 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:41:04.443155 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:41:04.444112 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:41:04.444112 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:41:04.444112 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:41:04.444112 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:41:04.444112 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 604/1210] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 14 17:41:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:41:04.445632 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9324bb93-0419-4f42-80d8-ad47173c1f72 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:41:04.548836 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:41:04.551970 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9324bb93-0419-4f42-80d8-ad47173c1f72 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:41:04.586050 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875a98bb-06dd-4efa-bf2e-8a000ee43451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:41:04.586720 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875a98bb-06dd-4efa-bf2e-8a000ee43451 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:04.587010 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875a98bb-06dd-4efa-bf2e-8a000ee43451 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:04.587323 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875a98bb-06dd-4efa-bf2e-8a000ee43451 None admin] PATH_INFO: `/v3/domains` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:04.588043 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875a98bb-06dd-4efa-bf2e-8a000ee43451 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:41:04.588357 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875a98bb-06dd-4efa-bf2e-8a000ee43451 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:41:04.589729 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875a98bb-06dd-4efa-bf2e-8a000ee43451 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:41:04.601583 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 607/1211] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 14 17:41:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:41:04.607822 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0059199b-c08e-4259-a43c-f71e640e188b None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:41:04.709812 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0059199b-c08e-4259-a43c-f71e640e188b None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:41:04.712350 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:41:04.745640 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594d8029-c747-41ba-9baf-49868ebb0d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:41:04.746450 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d8029-c747-41ba-9baf-49868ebb0d72 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:04.746825 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d8029-c747-41ba-9baf-49868ebb0d72 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:04.751214 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d8029-c747-41ba-9baf-49868ebb0d72 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:04.755043 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594d8029-c747-41ba-9baf-49868ebb0d72 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:41:04.756788 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594d8029-c747-41ba-9baf-49868ebb0d72 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:41:04.771998 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-594d8029-c747-41ba-9baf-49868ebb0d72 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 14 17:41:04.771998 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:41:04.771998 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:41:04.771998 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:41:04.771998 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:41:04.771998 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:41:04.771998 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:41:04.771998 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:41:04.771998 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:41:04.771998 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:41:04.771998 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:41:04.771998 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:41:04.771998 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 14 17:41:04.771998 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 14 17:41:04.771998 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 14 17:41:04.771998 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 14 17:41:04.773212 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:41:04.773212 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:41:04.773212 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 14 17:41:04.773212 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:41:04.773212 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 14 17:41:04.773212 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:41:04.773212 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:41:04.773212 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:41:04.773212 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:41:04.773212 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:41:04.773212 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:41:04.773212 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:41:04.773212 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:41:04.773212 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:41:04.773212 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:41:04.773212 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:41:04.773212 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:41:04.773212 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:41:04.774426 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:41:04.774426 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:41:04.774426 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 14 17:41:04.774426 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 14 17:41:04.774426 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 14 17:41:04.774426 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 14 17:41:04.774426 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 14 17:41:04.774426 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 14 17:41:04.774426 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 14 17:41:04.774426 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:41:04.774426 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 605/1212] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 14 17:41:04 2022] GET /identity/v3/users/placement => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:41:04.780375 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875a98bb-06dd-4efa-bf2e-8a000ee43451 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:41:04.886583 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875a98bb-06dd-4efa-bf2e-8a000ee43451 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:41:04.923708 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d9bc6c-5e5a-469c-ac00-4a70518c444d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:41:04.924386 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d9bc6c-5e5a-469c-ac00-4a70518c444d None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:04.924692 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d9bc6c-5e5a-469c-ac00-4a70518c444d None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:04.924970 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d9bc6c-5e5a-469c-ac00-4a70518c444d None admin] PATH_INFO: `/v3/users` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:04.925800 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d9bc6c-5e5a-469c-ac00-4a70518c444d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:41:04.926113 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d9bc6c-5e5a-469c-ac00-4a70518c444d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:41:04.927582 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d9bc6c-5e5a-469c-ac00-4a70518c444d None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:41:04.946048 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 608/1213] 10.222.0.36 () {56 vars in 1143 bytes} [Tue Jun 14 17:41:04 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:41:04.952098 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594d8029-c747-41ba-9baf-49868ebb0d72 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:41:05.057317 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594d8029-c747-41ba-9baf-49868ebb0d72 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:41:05.096871 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9315abbf-74ae-45f1-863d-62c9b80c2f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:41:05.097552 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9315abbf-74ae-45f1-863d-62c9b80c2f32 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:05.097840 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9315abbf-74ae-45f1-863d-62c9b80c2f32 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:05.098125 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9315abbf-74ae-45f1-863d-62c9b80c2f32 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:05.131985 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:41:05.172626 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9315abbf-74ae-45f1-863d-62c9b80c2f32 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:41:05.174113 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9315abbf-74ae-45f1-863d-62c9b80c2f32 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:41:05.277148 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 606/1214] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 14 17:41:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 14 17:41:05.283146 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d9bc6c-5e5a-469c-ac00-4a70518c444d None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:41:05.303178 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:41:05.391452 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d9bc6c-5e5a-469c-ac00-4a70518c444d None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:41:05.426345 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d812fa44-317e-4318-966a-a9efaaf999a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:41:05.427147 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d812fa44-317e-4318-966a-a9efaaf999a6 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:05.427477 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d812fa44-317e-4318-966a-a9efaaf999a6 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:05.427763 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d812fa44-317e-4318-966a-a9efaaf999a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:05.438446 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d812fa44-317e-4318-966a-a9efaaf999a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:41:05.439942 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d812fa44-317e-4318-966a-a9efaaf999a6 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:41:05.457926 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-d812fa44-317e-4318-966a-a9efaaf999a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:41:05.457926 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:41:05.457926 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:41:05.457926 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:41:05.457926 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:41:05.457926 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:41:05.457926 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:41:05.457926 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:41:05.457926 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:41:05.457926 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:41:05.457926 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:41:05.457926 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:41:05.457926 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:41:05.457926 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:41:05.457926 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:41:05.459031 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:41:05.459031 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:41:05.459031 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:41:05.459031 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:41:05.459031 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:41:05.459031 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:41:05.459031 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:41:05.459031 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:41:05.459031 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:41:05.459031 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:41:05.459031 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:41:05.459031 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:41:05.459031 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:41:05.459031 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:41:05.459031 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:41:05.459031 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:41:05.459031 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:41:05.465934 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:41:05.465934 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:41:05.465934 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:41:05.465934 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:41:05.465934 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 609/1215] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 14 17:41:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:41:05.466290 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9315abbf-74ae-45f1-863d-62c9b80c2f32 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:41:05.526771 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:41:05.566060 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9315abbf-74ae-45f1-863d-62c9b80c2f32 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:41:05.600938 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24619a9c-2b76-4535-9fe3-99d9b0a4922e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:41:05.601600 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24619a9c-2b76-4535-9fe3-99d9b0a4922e None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:05.601883 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24619a9c-2b76-4535-9fe3-99d9b0a4922e None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:05.602162 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24619a9c-2b76-4535-9fe3-99d9b0a4922e None admin] PATH_INFO: `/v3/domains` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:05.602871 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24619a9c-2b76-4535-9fe3-99d9b0a4922e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:41:05.603181 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24619a9c-2b76-4535-9fe3-99d9b0a4922e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:41:05.604577 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24619a9c-2b76-4535-9fe3-99d9b0a4922e None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:41:05.617346 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 607/1216] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 14 17:41:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:41:05.623378 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d812fa44-317e-4318-966a-a9efaaf999a6 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:41:05.695248 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:41:05.726510 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d812fa44-317e-4318-966a-a9efaaf999a6 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:41:05.761138 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7f1dbd-1102-4d10-b032-c2f7b82e3730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:41:05.761941 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7f1dbd-1102-4d10-b032-c2f7b82e3730 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:05.762253 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7f1dbd-1102-4d10-b032-c2f7b82e3730 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:05.762731 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7f1dbd-1102-4d10-b032-c2f7b82e3730 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:05.769670 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7f1dbd-1102-4d10-b032-c2f7b82e3730 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:41:05.773810 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7f1dbd-1102-4d10-b032-c2f7b82e3730 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:41:05.785979 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-8a7f1dbd-1102-4d10-b032-c2f7b82e3730 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:41:05.785979 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:41:05.785979 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:41:05.785979 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:41:05.785979 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:41:05.785979 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:41:05.785979 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:41:05.785979 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:41:05.785979 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:41:05.785979 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:41:05.785979 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:41:05.785979 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:41:05.785979 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 14 17:41:05.785979 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 14 17:41:05.785979 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 14 17:41:05.787048 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 14 17:41:05.787048 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:41:05.787048 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:41:05.787048 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:41:05.787048 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:41:05.787048 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:41:05.787048 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:41:05.787048 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:41:05.787048 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:41:05.787048 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:41:05.787048 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:41:05.787048 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:41:05.787048 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:41:05.787048 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:41:05.787048 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:41:05.787048 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:41:05.787048 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:41:05.788261 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 14 17:41:05.788261 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 14 17:41:05.788261 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 14 17:41:05.788261 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 14 17:41:05.788261 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 14 17:41:05.788261 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 14 17:41:05.788261 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:41:05.788261 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:41:05.788261 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 610/1217] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 14 17:41:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:41:05.793106 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24619a9c-2b76-4535-9fe3-99d9b0a4922e None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:41:05.896068 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24619a9c-2b76-4535-9fe3-99d9b0a4922e None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:41:05.918857 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:41:05.931578 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95090118-fd08-4cca-b1a9-3e73f2f69034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:41:05.932324 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95090118-fd08-4cca-b1a9-3e73f2f69034 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:05.932614 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95090118-fd08-4cca-b1a9-3e73f2f69034 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:05.932895 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95090118-fd08-4cca-b1a9-3e73f2f69034 None admin] PATH_INFO: `/v3/projects` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:05.933702 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95090118-fd08-4cca-b1a9-3e73f2f69034 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:41:05.934012 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95090118-fd08-4cca-b1a9-3e73f2f69034 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:41:05.936094 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95090118-fd08-4cca-b1a9-3e73f2f69034 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:41:05.951906 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 608/1218] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jun 14 17:41:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:41:05.955269 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7f1dbd-1102-4d10-b032-c2f7b82e3730 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:41:06.055320 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7f1dbd-1102-4d10-b032-c2f7b82e3730 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:41:06.083405 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:41:06.090206 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a123bba8-8012-4390-adc7-e9a0843b75a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:41:06.091533 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a123bba8-8012-4390-adc7-e9a0843b75a8 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:06.091811 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a123bba8-8012-4390-adc7-e9a0843b75a8 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:06.092083 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a123bba8-8012-4390-adc7-e9a0843b75a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:06.092919 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a123bba8-8012-4390-adc7-e9a0843b75a8 None admin] RBAC: Adding query filter params (role.id=ed6a4c87428044ddbc5199cfb05de27e, scope.project.id=f3e1d023a52c42b98d018617987ef83c, user.id=6a8049f9c66b4b5185c26084fd8239ab) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:41:06.093233 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a123bba8-8012-4390-adc7-e9a0843b75a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:41:06.094659 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a123bba8-8012-4390-adc7-e9a0843b75a8 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:41:06.100279 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 611/1219] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 14 17:41:05 2022] GET /identity/v3/role_assignments?user.id=6a8049f9c66b4b5185c26084fd8239ab&scope.project.id=f3e1d023a52c42b98d018617987ef83c&role.id=ed6a4c87428044ddbc5199cfb05de27e => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:41:08.223987 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8624d0c-26fe-4389-8899-ecb9c22c357b None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:08.224564 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8624d0c-26fe-4389-8899-ecb9c22c357b None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:08.224564 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8624d0c-26fe-4389-8899-ecb9c22c357b None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:08.225935 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 609/1220] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:41:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:41:08.232643 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c1217-1a73-4f4f-ac1a-b5f927dbe855 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:08.233233 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c1217-1a73-4f4f-ac1a-b5f927dbe855 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:08.233233 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c1217-1a73-4f4f-ac1a-b5f927dbe855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:08.252204 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-053c1217-1a73-4f4f-ac1a-b5f927dbe855 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:41:08.253454 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-053c1217-1a73-4f4f-ac1a-b5f927dbe855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:41:08.331007 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 612/1221] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:41:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 17:41:08.354545 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8624d0c-26fe-4389-8899-ecb9c22c357b None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:41:08.462895 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8624d0c-26fe-4389-8899-ecb9c22c357b None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:41:08.498181 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513b2d6d-d0a4-4bda-8889-c082a7c0b2d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:41:08.498904 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513b2d6d-d0a4-4bda-8889-c082a7c0b2d0 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:08.499191 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513b2d6d-d0a4-4bda-8889-c082a7c0b2d0 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:08.499503 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513b2d6d-d0a4-4bda-8889-c082a7c0b2d0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:08.509888 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513b2d6d-d0a4-4bda-8889-c082a7c0b2d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:41:08.517714 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-513b2d6d-d0a4-4bda-8889-c082a7c0b2d0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 14 17:41:08.517714 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:41:08.517714 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:41:08.517714 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:41:08.517714 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:41:08.517714 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:41:08.517714 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:41:08.517714 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:41:08.517714 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:41:08.517714 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:41:08.517714 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:41:08.517714 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:41:08.517714 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:41:08.517714 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:41:08.517714 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:41:08.517714 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:41:08.519550 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:41:08.519550 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:41:08.519550 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:41:08.519550 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:41:08.519550 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:41:08.519550 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:41:08.519550 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:41:08.519550 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:41:08.519550 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:41:08.519550 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:41:08.519550 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:41:08.519550 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:41:08.519550 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:41:08.519550 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:41:08.519550 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:41:08.519550 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:41:08.520660 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:41:08.520660 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:41:08.520660 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:41:08.520660 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:41:08.520660 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:41:08.520660 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:41:08.520660 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:41:08.520660 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:41:08.520660 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:41:08.520660 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:41:08.520660 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 14 17:41:08.520660 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:41:08.520660 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 610/1222] 10.222.0.36 () {56 vars in 1102 bytes} [Tue Jun 14 17:41:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:41:08.525150 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053c1217-1a73-4f4f-ac1a-b5f927dbe855 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:41:08.624567 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053c1217-1a73-4f4f-ac1a-b5f927dbe855 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:41:08.648573 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:41:08.660986 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613478d4-e65a-4156-80ea-583e3884cec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:41:08.661691 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613478d4-e65a-4156-80ea-583e3884cec6 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:08.662007 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613478d4-e65a-4156-80ea-583e3884cec6 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:08.662292 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613478d4-e65a-4156-80ea-583e3884cec6 None admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:08.663044 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613478d4-e65a-4156-80ea-583e3884cec6 None admin] RBAC: Adding query filter params (name=service) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:41:08.663392 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613478d4-e65a-4156-80ea-583e3884cec6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:41:08.664790 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613478d4-e65a-4156-80ea-583e3884cec6 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:41:08.673614 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 613/1223] 10.222.0.36 () {56 vars in 1103 bytes} [Tue Jun 14 17:41:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:41:08.679739 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513b2d6d-d0a4-4bda-8889-c082a7c0b2d0 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:41:08.723820 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:41:08.780677 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513b2d6d-d0a4-4bda-8889-c082a7c0b2d0 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:41:08.815715 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16b9320-359b-4875-9225-f0af7de51ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:41:08.816560 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16b9320-359b-4875-9225-f0af7de51ccd None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:08.816838 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16b9320-359b-4875-9225-f0af7de51ccd None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:08.817118 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16b9320-359b-4875-9225-f0af7de51ccd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:08.827636 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16b9320-359b-4875-9225-f0af7de51ccd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:41:08.829073 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16b9320-359b-4875-9225-f0af7de51ccd None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:41:08.847157 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-a16b9320-359b-4875-9225-f0af7de51ccd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:41:08.847157 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:41:08.847157 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:41:08.847157 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:41:08.847157 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:41:08.847157 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:41:08.847157 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:41:08.847157 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:41:08.847157 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:41:08.847157 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:41:08.847157 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:41:08.847157 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:41:08.847157 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:41:08.847157 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:41:08.847157 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:41:08.848286 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:41:08.848286 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:41:08.848286 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:41:08.848286 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:41:08.848286 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:41:08.848286 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:41:08.848286 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:41:08.848286 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:41:08.848286 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:41:08.848286 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:41:08.848286 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:41:08.848286 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:41:08.848286 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:41:08.848286 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:41:08.848286 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:41:08.848286 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:41:08.848286 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:41:08.849585 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:41:08.849585 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:41:08.849585 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:41:08.849585 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:41:08.849585 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 611/1224] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 14 17:41:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:41:08.854230 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613478d4-e65a-4156-80ea-583e3884cec6 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:41:08.957917 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613478d4-e65a-4156-80ea-583e3884cec6 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:41:08.991691 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b80228-ecb3-4ade-9a32-20bc55a73c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:41:08.992373 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b80228-ecb3-4ade-9a32-20bc55a73c2c None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:08.992656 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b80228-ecb3-4ade-9a32-20bc55a73c2c None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:08.992936 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b80228-ecb3-4ade-9a32-20bc55a73c2c None admin] PATH_INFO: `/v3/domains` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:08.993661 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b80228-ecb3-4ade-9a32-20bc55a73c2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:41:08.993981 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b80228-ecb3-4ade-9a32-20bc55a73c2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:41:08.995375 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b80228-ecb3-4ade-9a32-20bc55a73c2c None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:41:09.007822 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 614/1225] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 14 17:41:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:41:09.014296 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16b9320-359b-4875-9225-f0af7de51ccd None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:41:09.107172 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:41:09.114093 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16b9320-359b-4875-9225-f0af7de51ccd None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:41:09.149030 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf09609f-f92a-4bc8-a2b9-7a7baaefd1fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:41:09.149839 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf09609f-f92a-4bc8-a2b9-7a7baaefd1fe None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:09.150132 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf09609f-f92a-4bc8-a2b9-7a7baaefd1fe None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:09.150417 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf09609f-f92a-4bc8-a2b9-7a7baaefd1fe None admin] PATH_INFO: `/v3/users/placement` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:09.158677 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf09609f-f92a-4bc8-a2b9-7a7baaefd1fe None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:41:09.160161 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf09609f-f92a-4bc8-a2b9-7a7baaefd1fe None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:41:09.174888 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-bf09609f-f92a-4bc8-a2b9-7a7baaefd1fe None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 14 17:41:09.174888 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:41:09.174888 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:41:09.174888 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:41:09.174888 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:41:09.174888 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:41:09.174888 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:41:09.174888 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:41:09.174888 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:41:09.174888 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:41:09.174888 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:41:09.174888 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:41:09.174888 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 14 17:41:09.174888 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 14 17:41:09.174888 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 14 17:41:09.174888 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 14 17:41:09.176161 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:41:09.176161 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:41:09.176161 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 14 17:41:09.176161 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:41:09.176161 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 14 17:41:09.176161 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:41:09.176161 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:41:09.176161 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:41:09.176161 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:41:09.176161 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:41:09.176161 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:41:09.176161 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:41:09.176161 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:41:09.176161 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:41:09.176161 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:41:09.176161 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:41:09.176161 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:41:09.176161 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:41:09.177346 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:41:09.177346 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:41:09.177346 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 14 17:41:09.177346 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 14 17:41:09.177346 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 14 17:41:09.177346 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 14 17:41:09.177346 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 14 17:41:09.177346 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 14 17:41:09.177346 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 14 17:41:09.177346 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:41:09.177346 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 612/1226] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 14 17:41:09 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 17:41:09.181975 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b80228-ecb3-4ade-9a32-20bc55a73c2c None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:41:09.230069 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:41:09.283796 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b80228-ecb3-4ade-9a32-20bc55a73c2c None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:41:09.318098 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a5eca2-2a18-4899-a663-63bd37d0b417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:41:09.318775 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a5eca2-2a18-4899-a663-63bd37d0b417 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:09.319062 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a5eca2-2a18-4899-a663-63bd37d0b417 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:09.319409 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a5eca2-2a18-4899-a663-63bd37d0b417 None admin] PATH_INFO: `/v3/users` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:09.320248 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a5eca2-2a18-4899-a663-63bd37d0b417 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:41:09.320564 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a5eca2-2a18-4899-a663-63bd37d0b417 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:41:09.322011 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a5eca2-2a18-4899-a663-63bd37d0b417 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:41:09.343015 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 615/1227] 10.222.0.36 () {56 vars in 1143 bytes} [Tue Jun 14 17:41:09 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:41:09.348875 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf09609f-f92a-4bc8-a2b9-7a7baaefd1fe None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:41:09.452672 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf09609f-f92a-4bc8-a2b9-7a7baaefd1fe None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:41:09.486745 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c1c6cb-3889-43fd-8ecd-05303a173782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:41:09.487571 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c1c6cb-3889-43fd-8ecd-05303a173782 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:09.487863 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c1c6cb-3889-43fd-8ecd-05303a173782 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:09.488144 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c1c6cb-3889-43fd-8ecd-05303a173782 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:09.499079 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c1c6cb-3889-43fd-8ecd-05303a173782 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:41:09.500572 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c1c6cb-3889-43fd-8ecd-05303a173782 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:41:09.517840 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-52c1c6cb-3889-43fd-8ecd-05303a173782 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:41:09.517840 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:41:09.517840 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:41:09.517840 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:41:09.517840 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:41:09.517840 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:41:09.517840 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:41:09.517840 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:41:09.517840 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:41:09.517840 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:41:09.517840 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:41:09.517840 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:41:09.517840 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:41:09.517840 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:41:09.517840 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:41:09.518971 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:41:09.518971 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:41:09.518971 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:41:09.518971 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:41:09.518971 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:41:09.518971 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:41:09.518971 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:41:09.518971 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:41:09.518971 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:41:09.518971 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:41:09.518971 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:41:09.518971 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:41:09.518971 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:41:09.518971 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:41:09.518971 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:41:09.518971 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:41:09.518971 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:41:09.520060 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:41:09.520060 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:41:09.520060 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:41:09.520060 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:41:09.520060 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 613/1228] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 14 17:41:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:41:09.524811 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a5eca2-2a18-4899-a663-63bd37d0b417 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:41:09.627968 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a5eca2-2a18-4899-a663-63bd37d0b417 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:41:09.630305 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:41:09.662625 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b303cec-e498-4a4d-b2e9-aa2c10aa4771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:41:09.663292 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b303cec-e498-4a4d-b2e9-aa2c10aa4771 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:09.663612 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b303cec-e498-4a4d-b2e9-aa2c10aa4771 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:09.663894 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b303cec-e498-4a4d-b2e9-aa2c10aa4771 None admin] PATH_INFO: `/v3/domains` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:09.664610 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b303cec-e498-4a4d-b2e9-aa2c10aa4771 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:41:09.664921 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b303cec-e498-4a4d-b2e9-aa2c10aa4771 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:41:09.666288 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b303cec-e498-4a4d-b2e9-aa2c10aa4771 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:41:09.677602 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 616/1229] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 14 17:41:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:41:09.683318 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c1c6cb-3889-43fd-8ecd-05303a173782 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:41:09.693202 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:41:09.787377 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c1c6cb-3889-43fd-8ecd-05303a173782 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:41:09.822420 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453a7b18-def7-499a-9aa4-a90b7998eeb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:41:09.823229 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453a7b18-def7-499a-9aa4-a90b7998eeb8 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:09.823544 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453a7b18-def7-499a-9aa4-a90b7998eeb8 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:09.823826 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453a7b18-def7-499a-9aa4-a90b7998eeb8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:09.831697 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453a7b18-def7-499a-9aa4-a90b7998eeb8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:41:09.833155 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453a7b18-def7-499a-9aa4-a90b7998eeb8 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:41:09.848133 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-453a7b18-def7-499a-9aa4-a90b7998eeb8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:41:09.848133 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:41:09.848133 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:41:09.848133 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:41:09.848133 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:41:09.848133 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:41:09.848133 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:41:09.848133 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:41:09.848133 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:41:09.848133 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:41:09.848133 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:41:09.848133 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:41:09.848133 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 14 17:41:09.848133 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 14 17:41:09.848133 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 14 17:41:09.856613 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 14 17:41:09.856613 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:41:09.856613 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:41:09.856613 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:41:09.856613 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:41:09.856613 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:41:09.856613 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:41:09.856613 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:41:09.856613 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:41:09.856613 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:41:09.856613 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:41:09.856613 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:41:09.856613 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:41:09.856613 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:41:09.856613 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:41:09.856613 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:41:09.856613 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:41:09.857690 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 14 17:41:09.857690 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 14 17:41:09.857690 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 14 17:41:09.857690 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 14 17:41:09.857690 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 14 17:41:09.857690 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 14 17:41:09.857690 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:41:09.857690 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:41:09.857690 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 614/1230] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 14 17:41:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:41:09.858183 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b303cec-e498-4a4d-b2e9-aa2c10aa4771 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:41:09.959835 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b303cec-e498-4a4d-b2e9-aa2c10aa4771 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:41:09.998443 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641b4be6-18f7-404b-9999-7886641f88a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:41:09.999098 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b4be6-18f7-404b-9999-7886641f88a3 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:09.999743 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b4be6-18f7-404b-9999-7886641f88a3 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:10.000038 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b4be6-18f7-404b-9999-7886641f88a3 None admin] PATH_INFO: `/v3/projects` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:10.000844 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641b4be6-18f7-404b-9999-7886641f88a3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:41:10.001164 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641b4be6-18f7-404b-9999-7886641f88a3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:41:10.002647 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641b4be6-18f7-404b-9999-7886641f88a3 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:41:10.016424 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 617/1231] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jun 14 17:41:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:41:10.023135 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453a7b18-def7-499a-9aa4-a90b7998eeb8 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:41:10.092143 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:41:10.130748 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453a7b18-def7-499a-9aa4-a90b7998eeb8 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:41:10.165559 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db68974b-4c3a-49ef-9c58-c1a3bbe6343f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:41:10.166461 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db68974b-4c3a-49ef-9c58-c1a3bbe6343f None admin] REQUEST_METHOD: `PUT` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:10.170583 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db68974b-4c3a-49ef-9c58-c1a3bbe6343f None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:10.170583 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db68974b-4c3a-49ef-9c58-c1a3bbe6343f None admin] PATH_INFO: `/v3/projects/f3e1d023a52c42b98d018617987ef83c/users/6a8049f9c66b4b5185c26084fd8239ab/roles/ed6a4c87428044ddbc5199cfb05de27e` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:10.182791 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db68974b-4c3a-49ef-9c58-c1a3bbe6343f None admin] RBAC: Authorizing `identity:create_grant(project_id=f3e1d023a52c42b98d018617987ef83c, user_id=6a8049f9c66b4b5185c26084fd8239ab, role_id=ed6a4c87428044ddbc5199cfb05de27e)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:41:10.184916 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db68974b-4c3a-49ef-9c58-c1a3bbe6343f None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:41:10.288987 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 615/1232] 10.222.0.36 () {58 vars in 1439 bytes} [Tue Jun 14 17:41:10 2022] PUT /identity/v3/projects/f3e1d023a52c42b98d018617987ef83c/users/6a8049f9c66b4b5185c26084fd8239ab/roles/ed6a4c87428044ddbc5199cfb05de27e => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:41:12.462648 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40119197-432a-422e-88af-1489d1d22e2a None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:12.463191 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40119197-432a-422e-88af-1489d1d22e2a None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:12.463191 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40119197-432a-422e-88af-1489d1d22e2a None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:12.464602 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 618/1233] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:41:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:41:12.470710 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a150c7-9ac0-4da5-bf86-f2f5a6b7b0aa None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:12.472410 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a150c7-9ac0-4da5-bf86-f2f5a6b7b0aa None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:12.472410 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a150c7-9ac0-4da5-bf86-f2f5a6b7b0aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:12.488719 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-d8a150c7-9ac0-4da5-bf86-f2f5a6b7b0aa None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:41:12.490000 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-d8a150c7-9ac0-4da5-bf86-f2f5a6b7b0aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:41:12.559669 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 616/1234] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:41:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 17:41:12.583579 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40119197-432a-422e-88af-1489d1d22e2a None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:41:12.610317 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:41:12.691379 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40119197-432a-422e-88af-1489d1d22e2a None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:41:12.727380 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8aedc8-cef2-4bef-ae71-87430f6187dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:41:12.728111 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8aedc8-cef2-4bef-ae71-87430f6187dc None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:12.728394 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8aedc8-cef2-4bef-ae71-87430f6187dc None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:12.728671 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8aedc8-cef2-4bef-ae71-87430f6187dc None admin] PATH_INFO: `/v3/roles/service` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:12.739872 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8aedc8-cef2-4bef-ae71-87430f6187dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:41:12.747983 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-8e8aedc8-cef2-4bef-ae71-87430f6187dc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 14 17:41:12.747983 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:41:12.747983 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:41:12.747983 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:41:12.747983 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:41:12.747983 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:41:12.747983 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:41:12.747983 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:41:12.747983 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:41:12.747983 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:41:12.747983 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:41:12.747983 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:41:12.747983 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:41:12.747983 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:41:12.747983 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:41:12.747983 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:41:12.749151 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:41:12.749151 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:41:12.749151 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:41:12.749151 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:41:12.749151 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:41:12.749151 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:41:12.749151 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:41:12.749151 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:41:12.749151 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:41:12.749151 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:41:12.749151 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:41:12.749151 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:41:12.749151 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:41:12.749151 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:41:12.749151 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:41:12.749151 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:41:12.750232 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:41:12.750232 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:41:12.750232 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:41:12.750232 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:41:12.750232 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:41:12.750232 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:41:12.750232 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:41:12.750232 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:41:12.750232 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:41:12.750232 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:41:12.750232 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 14 17:41:12.750232 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:41:12.750232 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 619/1235] 10.222.0.36 () {56 vars in 1102 bytes} [Tue Jun 14 17:41:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:41:12.755443 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a150c7-9ac0-4da5-bf86-f2f5a6b7b0aa None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:41:12.809679 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:41:12.868441 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a150c7-9ac0-4da5-bf86-f2f5a6b7b0aa None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:41:12.906039 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e87ee6-2ef5-4e4c-b889-3f9821de8da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:41:12.906754 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e87ee6-2ef5-4e4c-b889-3f9821de8da6 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:12.907077 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e87ee6-2ef5-4e4c-b889-3f9821de8da6 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:12.907388 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e87ee6-2ef5-4e4c-b889-3f9821de8da6 None admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:12.908141 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e87ee6-2ef5-4e4c-b889-3f9821de8da6 None admin] RBAC: Adding query filter params (name=service) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:41:12.908458 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e87ee6-2ef5-4e4c-b889-3f9821de8da6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:41:12.909835 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e87ee6-2ef5-4e4c-b889-3f9821de8da6 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:41:12.919131 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 617/1236] 10.222.0.36 () {56 vars in 1103 bytes} [Tue Jun 14 17:41:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:41:12.925629 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8aedc8-cef2-4bef-ae71-87430f6187dc None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:41:13.020526 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:41:13.038545 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8aedc8-cef2-4bef-ae71-87430f6187dc None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:41:13.072875 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd8c1c6-8c06-41c7-a987-4124a17bac81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:41:13.073691 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd8c1c6-8c06-41c7-a987-4124a17bac81 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:13.073976 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd8c1c6-8c06-41c7-a987-4124a17bac81 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:13.074258 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd8c1c6-8c06-41c7-a987-4124a17bac81 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:13.087743 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd8c1c6-8c06-41c7-a987-4124a17bac81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:41:13.089247 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd8c1c6-8c06-41c7-a987-4124a17bac81 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:41:13.108142 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-5fd8c1c6-8c06-41c7-a987-4124a17bac81 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:41:13.108142 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:41:13.108142 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:41:13.108142 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:41:13.108142 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:41:13.108142 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:41:13.108142 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:41:13.108142 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:41:13.108142 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:41:13.108142 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:41:13.108142 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:41:13.108142 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:41:13.108142 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:41:13.108142 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:41:13.108142 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:41:13.109364 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:41:13.109364 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:41:13.109364 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:41:13.109364 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:41:13.109364 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:41:13.109364 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:41:13.109364 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:41:13.109364 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:41:13.109364 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:41:13.109364 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:41:13.109364 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:41:13.109364 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:41:13.109364 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:41:13.109364 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:41:13.109364 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:41:13.109364 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:41:13.109364 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:41:13.110313 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:41:13.110313 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:41:13.110313 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:41:13.110313 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:41:13.110313 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 620/1237] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 14 17:41:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:41:13.115630 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e87ee6-2ef5-4e4c-b889-3f9821de8da6 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:41:13.223600 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e87ee6-2ef5-4e4c-b889-3f9821de8da6 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:41:13.233823 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:41:13.259827 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe33c8d4-59c1-4c06-85f9-1a6208e342f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:41:13.260502 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe33c8d4-59c1-4c06-85f9-1a6208e342f9 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:13.260789 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe33c8d4-59c1-4c06-85f9-1a6208e342f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:13.261070 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe33c8d4-59c1-4c06-85f9-1a6208e342f9 None admin] PATH_INFO: `/v3/domains` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:13.261863 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe33c8d4-59c1-4c06-85f9-1a6208e342f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:41:13.262179 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe33c8d4-59c1-4c06-85f9-1a6208e342f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:41:13.263684 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe33c8d4-59c1-4c06-85f9-1a6208e342f9 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:41:13.275611 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 618/1238] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 14 17:41:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:41:13.282117 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd8c1c6-8c06-41c7-a987-4124a17bac81 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:41:13.394366 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd8c1c6-8c06-41c7-a987-4124a17bac81 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:41:13.429137 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1224f6bb-81d9-484c-9c90-e8ab5d0c21c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:41:13.429943 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1224f6bb-81d9-484c-9c90-e8ab5d0c21c3 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:13.430254 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1224f6bb-81d9-484c-9c90-e8ab5d0c21c3 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:13.430515 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1224f6bb-81d9-484c-9c90-e8ab5d0c21c3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:13.433370 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:41:13.439733 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1224f6bb-81d9-484c-9c90-e8ab5d0c21c3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:41:13.441177 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1224f6bb-81d9-484c-9c90-e8ab5d0c21c3 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:41:13.456667 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-1224f6bb-81d9-484c-9c90-e8ab5d0c21c3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 14 17:41:13.456667 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:41:13.456667 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:41:13.456667 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:41:13.456667 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:41:13.456667 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:41:13.456667 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:41:13.456667 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:41:13.456667 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:41:13.456667 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:41:13.456667 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:41:13.456667 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:41:13.456667 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 14 17:41:13.456667 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 14 17:41:13.456667 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 14 17:41:13.456667 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 14 17:41:13.457778 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:41:13.457778 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:41:13.457778 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 14 17:41:13.457778 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:41:13.457778 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 14 17:41:13.457778 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:41:13.457778 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:41:13.457778 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:41:13.457778 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:41:13.457778 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:41:13.457778 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:41:13.457778 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:41:13.457778 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:41:13.457778 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:41:13.457778 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:41:13.457778 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:41:13.457778 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:41:13.457778 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:41:13.459153 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:41:13.459153 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:41:13.459153 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 14 17:41:13.459153 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 14 17:41:13.459153 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 14 17:41:13.459153 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 14 17:41:13.459153 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 14 17:41:13.459153 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 14 17:41:13.459153 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 14 17:41:13.459153 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:41:13.459153 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 621/1239] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 14 17:41:13 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:41:13.463836 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe33c8d4-59c1-4c06-85f9-1a6208e342f9 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:41:13.566821 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe33c8d4-59c1-4c06-85f9-1a6208e342f9 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:41:13.602749 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a602ac30-b449-4435-9de5-cc3715432cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:41:13.603454 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a602ac30-b449-4435-9de5-cc3715432cf0 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:13.603744 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a602ac30-b449-4435-9de5-cc3715432cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:13.604027 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a602ac30-b449-4435-9de5-cc3715432cf0 None admin] PATH_INFO: `/v3/users` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:13.604870 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a602ac30-b449-4435-9de5-cc3715432cf0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:41:13.605188 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a602ac30-b449-4435-9de5-cc3715432cf0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:41:13.606636 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a602ac30-b449-4435-9de5-cc3715432cf0 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:41:13.625729 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 619/1240] 10.222.0.36 () {56 vars in 1143 bytes} [Tue Jun 14 17:41:13 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:41:13.631833 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1224f6bb-81d9-484c-9c90-e8ab5d0c21c3 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:41:13.733638 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1224f6bb-81d9-484c-9c90-e8ab5d0c21c3 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:41:13.768074 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ecaabc-914a-46f4-9771-46e0ab523437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:41:13.768728 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ecaabc-914a-46f4-9771-46e0ab523437 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:13.769011 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ecaabc-914a-46f4-9771-46e0ab523437 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:13.769294 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ecaabc-914a-46f4-9771-46e0ab523437 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:13.831245 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:41:13.837738 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ecaabc-914a-46f4-9771-46e0ab523437 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:41:13.839198 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ecaabc-914a-46f4-9771-46e0ab523437 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:41:13.947065 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 622/1241] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 14 17:41:13 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 14 17:41:13.954181 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a602ac30-b449-4435-9de5-cc3715432cf0 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:41:13.981855 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:41:14.055540 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a602ac30-b449-4435-9de5-cc3715432cf0 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:41:14.091778 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f29a08c-3fd1-45a8-b34c-beb8a7833660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:41:14.092511 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f29a08c-3fd1-45a8-b34c-beb8a7833660 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:14.092797 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f29a08c-3fd1-45a8-b34c-beb8a7833660 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:14.093075 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f29a08c-3fd1-45a8-b34c-beb8a7833660 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:14.103706 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f29a08c-3fd1-45a8-b34c-beb8a7833660 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:41:14.105159 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f29a08c-3fd1-45a8-b34c-beb8a7833660 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:41:14.123824 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-9f29a08c-3fd1-45a8-b34c-beb8a7833660 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:41:14.123824 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:41:14.123824 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:41:14.123824 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:41:14.123824 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:41:14.123824 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:41:14.123824 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:41:14.123824 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:41:14.123824 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:41:14.123824 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:41:14.123824 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:41:14.123824 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:41:14.123824 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:41:14.123824 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:41:14.123824 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:41:14.124935 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:41:14.124935 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:41:14.124935 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:41:14.124935 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:41:14.124935 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:41:14.124935 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:41:14.124935 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:41:14.124935 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:41:14.124935 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:41:14.124935 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:41:14.124935 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:41:14.124935 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:41:14.124935 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:41:14.124935 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:41:14.124935 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:41:14.124935 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:41:14.124935 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:41:14.125924 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:41:14.125924 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:41:14.125924 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:41:14.125924 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:41:14.125924 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 620/1242] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 14 17:41:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:41:14.130941 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ecaabc-914a-46f4-9771-46e0ab523437 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:41:14.229204 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:41:14.236410 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ecaabc-914a-46f4-9771-46e0ab523437 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:41:14.274577 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc78104d-579e-44ba-9be1-f436f3b5d367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:41:14.275260 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc78104d-579e-44ba-9be1-f436f3b5d367 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:14.275585 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc78104d-579e-44ba-9be1-f436f3b5d367 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:14.275871 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc78104d-579e-44ba-9be1-f436f3b5d367 None admin] PATH_INFO: `/v3/domains` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:14.276656 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc78104d-579e-44ba-9be1-f436f3b5d367 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:41:14.276984 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc78104d-579e-44ba-9be1-f436f3b5d367 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:41:14.279130 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc78104d-579e-44ba-9be1-f436f3b5d367 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:41:14.291107 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 623/1243] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 14 17:41:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:41:14.297453 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f29a08c-3fd1-45a8-b34c-beb8a7833660 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:41:14.378803 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:41:14.407161 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f29a08c-3fd1-45a8-b34c-beb8a7833660 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:41:14.441946 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70b34d6-a413-419c-9863-17ba7211cc27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:41:14.442750 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b34d6-a413-419c-9863-17ba7211cc27 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:14.443038 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b34d6-a413-419c-9863-17ba7211cc27 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:14.443344 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b34d6-a413-419c-9863-17ba7211cc27 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:14.450696 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70b34d6-a413-419c-9863-17ba7211cc27 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:41:14.452185 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70b34d6-a413-419c-9863-17ba7211cc27 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:41:14.467093 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-f70b34d6-a413-419c-9863-17ba7211cc27 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:41:14.467093 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:41:14.467093 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:41:14.467093 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:41:14.467093 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:41:14.467093 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:41:14.467093 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:41:14.467093 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:41:14.467093 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:41:14.467093 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:41:14.467093 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:41:14.467093 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:41:14.467093 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 14 17:41:14.467093 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 14 17:41:14.467093 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 14 17:41:14.468214 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 14 17:41:14.468214 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:41:14.468214 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:41:14.468214 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:41:14.468214 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:41:14.468214 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:41:14.468214 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:41:14.468214 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:41:14.468214 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:41:14.468214 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:41:14.468214 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:41:14.468214 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:41:14.468214 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:41:14.468214 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:41:14.468214 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:41:14.468214 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:41:14.468214 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:41:14.469543 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 14 17:41:14.469543 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 14 17:41:14.469543 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 14 17:41:14.469543 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 14 17:41:14.469543 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 14 17:41:14.469543 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 14 17:41:14.469543 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:41:14.469543 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:41:14.469543 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 621/1244] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 14 17:41:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:41:14.474309 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc78104d-579e-44ba-9be1-f436f3b5d367 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:41:14.579741 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc78104d-579e-44ba-9be1-f436f3b5d367 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:41:14.613179 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743b10de-34e8-404f-a3f2-3f4fa9859cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:41:14.613867 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743b10de-34e8-404f-a3f2-3f4fa9859cd6 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:14.614191 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743b10de-34e8-404f-a3f2-3f4fa9859cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:14.614470 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743b10de-34e8-404f-a3f2-3f4fa9859cd6 None admin] PATH_INFO: `/v3/projects` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:14.615288 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743b10de-34e8-404f-a3f2-3f4fa9859cd6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:41:14.615636 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743b10de-34e8-404f-a3f2-3f4fa9859cd6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:41:14.617073 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743b10de-34e8-404f-a3f2-3f4fa9859cd6 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:41:14.630178 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 624/1245] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jun 14 17:41:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:41:14.636601 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70b34d6-a413-419c-9863-17ba7211cc27 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:41:14.759815 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70b34d6-a413-419c-9863-17ba7211cc27 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:41:14.796957 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37593b34-3a76-48d1-85ce-899af5254e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:41:14.797631 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37593b34-3a76-48d1-85ce-899af5254e29 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:14.797915 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37593b34-3a76-48d1-85ce-899af5254e29 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:14.798195 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37593b34-3a76-48d1-85ce-899af5254e29 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:14.799038 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37593b34-3a76-48d1-85ce-899af5254e29 None admin] RBAC: Adding query filter params (role.id=ed6a4c87428044ddbc5199cfb05de27e, scope.project.id=f3e1d023a52c42b98d018617987ef83c, user.id=6a8049f9c66b4b5185c26084fd8239ab) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:41:14.799384 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37593b34-3a76-48d1-85ce-899af5254e29 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:41:14.800825 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37593b34-3a76-48d1-85ce-899af5254e29 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:41:14.807263 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 622/1246] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 14 17:41:14 2022] GET /identity/v3/role_assignments?user.id=6a8049f9c66b4b5185c26084fd8239ab&scope.project.id=f3e1d023a52c42b98d018617987ef83c&role.id=ed6a4c87428044ddbc5199cfb05de27e => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:41:17.031583 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4e5358-3418-49ea-84f8-52f3148ef967 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:17.032125 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4e5358-3418-49ea-84f8-52f3148ef967 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:17.032125 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4e5358-3418-49ea-84f8-52f3148ef967 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:17.033491 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 625/1247] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:41:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:41:17.038907 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe2f9fa-4064-442a-915b-c5000b1fb1e3 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:17.039336 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe2f9fa-4064-442a-915b-c5000b1fb1e3 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:17.050396 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe2f9fa-4064-442a-915b-c5000b1fb1e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:17.050396 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:41:17.057864 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-1fe2f9fa-4064-442a-915b-c5000b1fb1e3 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:41:17.059057 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-1fe2f9fa-4064-442a-915b-c5000b1fb1e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:41:17.127051 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 623/1248] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:41:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 17:41:17.152410 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4e5358-3418-49ea-84f8-52f3148ef967 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:41:17.174191 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:41:17.259872 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4e5358-3418-49ea-84f8-52f3148ef967 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:41:17.294757 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb476f47-3d8e-4652-9b7b-9f62e6fbd4ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:41:17.295703 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb476f47-3d8e-4652-9b7b-9f62e6fbd4ea None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:17.296061 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb476f47-3d8e-4652-9b7b-9f62e6fbd4ea None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:17.296431 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb476f47-3d8e-4652-9b7b-9f62e6fbd4ea None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:17.306915 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb476f47-3d8e-4652-9b7b-9f62e6fbd4ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:41:17.315349 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-eb476f47-3d8e-4652-9b7b-9f62e6fbd4ea None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 17:41:17.315349 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:41:17.315349 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:41:17.315349 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:41:17.315349 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:41:17.315349 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:41:17.315349 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:41:17.315349 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:41:17.315349 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:41:17.315349 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:41:17.315349 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:41:17.315349 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:41:17.315349 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:41:17.315349 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:41:17.315349 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:41:17.315349 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:41:17.316461 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:41:17.316461 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:41:17.316461 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:41:17.316461 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:41:17.316461 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:41:17.316461 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:41:17.316461 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:41:17.316461 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:41:17.316461 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:41:17.316461 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:41:17.316461 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:41:17.316461 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:41:17.316461 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:41:17.316461 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:41:17.316461 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:41:17.316461 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:41:17.317652 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:41:17.317652 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:41:17.317652 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:41:17.317652 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:41:17.317652 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:41:17.317652 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:41:17.317652 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:41:17.317652 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:41:17.317652 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:41:17.317652 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:41:17.317652 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 17:41:17.317652 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:41:17.317652 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 626/1249] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jun 14 17:41:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:41:17.322690 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe2f9fa-4064-442a-915b-c5000b1fb1e3 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:41:17.423226 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe2f9fa-4064-442a-915b-c5000b1fb1e3 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:41:17.453077 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:41:17.458166 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1673f0e4-2dcd-48ed-b54f-caf450579ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:41:17.458850 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1673f0e4-2dcd-48ed-b54f-caf450579ea7 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:17.459141 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1673f0e4-2dcd-48ed-b54f-caf450579ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:17.459462 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1673f0e4-2dcd-48ed-b54f-caf450579ea7 None admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:17.460216 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1673f0e4-2dcd-48ed-b54f-caf450579ea7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:41:17.460559 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1673f0e4-2dcd-48ed-b54f-caf450579ea7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:41:17.461931 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1673f0e4-2dcd-48ed-b54f-caf450579ea7 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:41:17.473964 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 624/1250] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 14 17:41:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:41:17.479847 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb476f47-3d8e-4652-9b7b-9f62e6fbd4ea None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:41:17.564262 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:41:17.588815 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb476f47-3d8e-4652-9b7b-9f62e6fbd4ea None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:41:17.623446 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6f50da-6e44-4a75-86e5-1f6c167211b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:41:17.624283 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6f50da-6e44-4a75-86e5-1f6c167211b7 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:17.624575 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6f50da-6e44-4a75-86e5-1f6c167211b7 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:17.624862 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6f50da-6e44-4a75-86e5-1f6c167211b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:17.635550 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6f50da-6e44-4a75-86e5-1f6c167211b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:41:17.637031 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6f50da-6e44-4a75-86e5-1f6c167211b7 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:41:17.655087 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-5a6f50da-6e44-4a75-86e5-1f6c167211b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:41:17.655087 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:41:17.655087 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:41:17.655087 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:41:17.655087 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:41:17.655087 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:41:17.655087 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:41:17.655087 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:41:17.655087 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:41:17.655087 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:41:17.655087 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:41:17.655087 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:41:17.655087 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:41:17.655087 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:41:17.655087 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:41:17.656261 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:41:17.656261 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:41:17.656261 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:41:17.656261 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:41:17.656261 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:41:17.656261 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:41:17.656261 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:41:17.656261 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:41:17.656261 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:41:17.656261 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:41:17.656261 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:41:17.656261 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:41:17.656261 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:41:17.656261 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:41:17.656261 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:41:17.656261 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:41:17.656261 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:41:17.657213 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:41:17.657213 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:41:17.657213 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:41:17.657213 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:41:17.659463 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 627/1251] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 14 17:41:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:41:17.662264 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1673f0e4-2dcd-48ed-b54f-caf450579ea7 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:41:17.767777 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1673f0e4-2dcd-48ed-b54f-caf450579ea7 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:41:17.802575 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b81788b-1fed-4ee6-87cb-db19016a3cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:41:17.803241 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b81788b-1fed-4ee6-87cb-db19016a3cad None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:17.803553 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b81788b-1fed-4ee6-87cb-db19016a3cad None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:17.803832 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b81788b-1fed-4ee6-87cb-db19016a3cad None admin] PATH_INFO: `/v3/domains` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:17.804546 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b81788b-1fed-4ee6-87cb-db19016a3cad None admin] RBAC: Adding query filter params (name=Default) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:41:17.804851 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b81788b-1fed-4ee6-87cb-db19016a3cad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:41:17.806211 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b81788b-1fed-4ee6-87cb-db19016a3cad None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:41:17.818342 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 625/1252] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 14 17:41:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:41:17.824409 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6f50da-6e44-4a75-86e5-1f6c167211b7 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:41:17.926979 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6f50da-6e44-4a75-86e5-1f6c167211b7 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:41:17.952863 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:41:17.961177 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab70532-4b6c-4e08-94a0-abab0d73ae24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:41:17.961995 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab70532-4b6c-4e08-94a0-abab0d73ae24 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:17.962277 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab70532-4b6c-4e08-94a0-abab0d73ae24 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:17.962552 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab70532-4b6c-4e08-94a0-abab0d73ae24 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:17.971785 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab70532-4b6c-4e08-94a0-abab0d73ae24 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:41:17.973241 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab70532-4b6c-4e08-94a0-abab0d73ae24 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:41:17.987986 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-dab70532-4b6c-4e08-94a0-abab0d73ae24 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 14 17:41:17.987986 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:41:17.987986 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:41:17.987986 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:41:17.987986 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:41:17.987986 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:41:17.987986 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:41:17.987986 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:41:17.987986 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:41:17.987986 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:41:17.987986 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:41:17.987986 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:41:17.987986 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 14 17:41:17.987986 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 14 17:41:17.987986 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 14 17:41:17.987986 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 14 17:41:17.992501 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:41:17.992501 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:41:17.992501 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 14 17:41:17.992501 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:41:17.992501 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 14 17:41:17.992501 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:41:17.992501 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:41:17.992501 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:41:17.992501 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:41:17.992501 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:41:17.992501 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:41:17.992501 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:41:17.992501 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:41:17.992501 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:41:17.992501 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:41:17.992501 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:41:17.992501 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:41:17.992501 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:41:17.993667 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:41:17.993667 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:41:17.993667 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 14 17:41:17.993667 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 14 17:41:17.993667 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 14 17:41:17.993667 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 14 17:41:17.993667 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 14 17:41:17.993667 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 14 17:41:17.993667 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 14 17:41:17.993667 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:41:17.993667 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 628/1253] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 14 17:41:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:41:17.995478 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b81788b-1fed-4ee6-87cb-db19016a3cad None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:41:18.053340 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:41:18.097644 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b81788b-1fed-4ee6-87cb-db19016a3cad None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:41:18.131138 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a492fc70-9b14-4626-9cb4-331160ed2518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:41:18.132096 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a492fc70-9b14-4626-9cb4-331160ed2518 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:18.132385 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a492fc70-9b14-4626-9cb4-331160ed2518 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:18.132669 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a492fc70-9b14-4626-9cb4-331160ed2518 None admin] PATH_INFO: `/v3/users` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:18.133507 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a492fc70-9b14-4626-9cb4-331160ed2518 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:41:18.133826 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a492fc70-9b14-4626-9cb4-331160ed2518 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:41:18.135264 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a492fc70-9b14-4626-9cb4-331160ed2518 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:41:18.159629 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 626/1254] 10.222.0.36 () {56 vars in 1143 bytes} [Tue Jun 14 17:41:17 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:41:18.162911 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab70532-4b6c-4e08-94a0-abab0d73ae24 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:41:18.269929 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab70532-4b6c-4e08-94a0-abab0d73ae24 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:41:18.304976 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839400a2-cd42-4adc-96f4-42582de16101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:41:18.305565 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839400a2-cd42-4adc-96f4-42582de16101 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:18.305849 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839400a2-cd42-4adc-96f4-42582de16101 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:18.306132 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839400a2-cd42-4adc-96f4-42582de16101 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:18.362178 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:41:18.375094 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839400a2-cd42-4adc-96f4-42582de16101 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:41:18.376593 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839400a2-cd42-4adc-96f4-42582de16101 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:41:18.484311 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 629/1255] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 14 17:41:18 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 14 17:41:18.491203 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a492fc70-9b14-4626-9cb4-331160ed2518 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:41:18.595856 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a492fc70-9b14-4626-9cb4-331160ed2518 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:41:18.610938 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:41:18.632631 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8819f4ad-9114-49a7-a41e-12036ef5da10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:41:18.633437 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8819f4ad-9114-49a7-a41e-12036ef5da10 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:18.633726 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8819f4ad-9114-49a7-a41e-12036ef5da10 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:18.634012 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8819f4ad-9114-49a7-a41e-12036ef5da10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:18.644875 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8819f4ad-9114-49a7-a41e-12036ef5da10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:41:18.646342 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8819f4ad-9114-49a7-a41e-12036ef5da10 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:41:18.666129 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-8819f4ad-9114-49a7-a41e-12036ef5da10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:41:18.666129 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:41:18.666129 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:41:18.666129 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:41:18.666129 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:41:18.666129 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:41:18.666129 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:41:18.666129 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:41:18.666129 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:41:18.666129 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:41:18.666129 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:41:18.666129 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:41:18.666129 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:41:18.666129 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:41:18.666129 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:41:18.667251 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:41:18.667251 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:41:18.667251 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:41:18.667251 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:41:18.667251 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:41:18.667251 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:41:18.667251 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:41:18.667251 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:41:18.667251 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:41:18.667251 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:41:18.667251 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:41:18.667251 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:41:18.667251 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:41:18.667251 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:41:18.667251 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:41:18.667251 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:41:18.667251 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:41:18.668418 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:41:18.668418 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:41:18.668418 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:41:18.668418 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:41:18.668418 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 627/1256] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 14 17:41:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:41:18.673856 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839400a2-cd42-4adc-96f4-42582de16101 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:41:18.766004 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:41:18.777579 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839400a2-cd42-4adc-96f4-42582de16101 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:41:18.812321 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5337f5be-14ad-4710-9ea9-1c4ee8cf2901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:41:18.813003 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5337f5be-14ad-4710-9ea9-1c4ee8cf2901 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:18.813288 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5337f5be-14ad-4710-9ea9-1c4ee8cf2901 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:18.813567 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5337f5be-14ad-4710-9ea9-1c4ee8cf2901 None admin] PATH_INFO: `/v3/domains` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:18.814291 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5337f5be-14ad-4710-9ea9-1c4ee8cf2901 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:41:18.814601 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5337f5be-14ad-4710-9ea9-1c4ee8cf2901 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:41:18.816010 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5337f5be-14ad-4710-9ea9-1c4ee8cf2901 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:41:18.828815 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 630/1257] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 14 17:41:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:41:18.834832 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8819f4ad-9114-49a7-a41e-12036ef5da10 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:41:18.940487 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8819f4ad-9114-49a7-a41e-12036ef5da10 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:41:18.976083 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb95416-0755-4627-bf7f-e596a413310c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:41:18.976968 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb95416-0755-4627-bf7f-e596a413310c None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:18.977253 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb95416-0755-4627-bf7f-e596a413310c None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:18.977541 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb95416-0755-4627-bf7f-e596a413310c None admin] PATH_INFO: `/v3/projects/service` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:18.985782 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb95416-0755-4627-bf7f-e596a413310c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:41:18.987280 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb95416-0755-4627-bf7f-e596a413310c None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:41:19.002067 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-dcb95416-0755-4627-bf7f-e596a413310c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:41:19.002067 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:41:19.002067 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:41:19.002067 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:41:19.002067 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:41:19.002067 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:41:19.002067 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:41:19.002067 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:41:19.002067 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:41:19.002067 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:41:19.002067 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:41:19.002067 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:41:19.002067 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 14 17:41:19.002067 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 14 17:41:19.002067 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 14 17:41:19.003161 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 14 17:41:19.003161 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:41:19.003161 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:41:19.003161 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:41:19.003161 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:41:19.003161 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:41:19.003161 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:41:19.003161 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:41:19.003161 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:41:19.003161 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:41:19.003161 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:41:19.003161 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:41:19.003161 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:41:19.003161 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:41:19.003161 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:41:19.003161 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:41:19.003161 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:41:19.004278 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 14 17:41:19.004278 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 14 17:41:19.004278 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 14 17:41:19.004278 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 14 17:41:19.004278 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 14 17:41:19.004278 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 14 17:41:19.004278 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:41:19.004278 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:41:19.004278 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 628/1258] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 14 17:41:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:41:19.009503 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5337f5be-14ad-4710-9ea9-1c4ee8cf2901 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:41:19.112146 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5337f5be-14ad-4710-9ea9-1c4ee8cf2901 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:41:19.146797 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd74079d-1731-4538-8cb5-5f1e81f21139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:41:19.147492 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd74079d-1731-4538-8cb5-5f1e81f21139 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:19.147787 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd74079d-1731-4538-8cb5-5f1e81f21139 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:19.148212 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd74079d-1731-4538-8cb5-5f1e81f21139 None admin] PATH_INFO: `/v3/projects` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:19.149000 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd74079d-1731-4538-8cb5-5f1e81f21139 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:41:19.149321 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd74079d-1731-4538-8cb5-5f1e81f21139 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:41:19.150838 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd74079d-1731-4538-8cb5-5f1e81f21139 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:41:19.164035 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 631/1259] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jun 14 17:41:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:41:19.170781 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb95416-0755-4627-bf7f-e596a413310c None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:41:19.198700 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:41:19.284210 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb95416-0755-4627-bf7f-e596a413310c None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:41:19.322078 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79832eef-2e2e-4676-bacc-bd788c80bf30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:41:19.322760 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79832eef-2e2e-4676-bacc-bd788c80bf30 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:19.323071 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79832eef-2e2e-4676-bacc-bd788c80bf30 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:19.323361 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79832eef-2e2e-4676-bacc-bd788c80bf30 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:19.324274 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79832eef-2e2e-4676-bacc-bd788c80bf30 None admin] RBAC: Adding query filter params (role.id=1348580877d04014bfdec4d866b98a74, scope.project.id=f3e1d023a52c42b98d018617987ef83c, user.id=6a8049f9c66b4b5185c26084fd8239ab) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:41:19.324553 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79832eef-2e2e-4676-bacc-bd788c80bf30 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:41:19.326885 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79832eef-2e2e-4676-bacc-bd788c80bf30 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:41:19.333797 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 629/1260] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 14 17:41:19 2022] GET /identity/v3/role_assignments?user.id=6a8049f9c66b4b5185c26084fd8239ab&scope.project.id=f3e1d023a52c42b98d018617987ef83c&role.id=1348580877d04014bfdec4d866b98a74 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:41:21.530391 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d294cd20-c533-49e3-a334-e32d0f2d293a None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:21.530927 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d294cd20-c533-49e3-a334-e32d0f2d293a None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:21.530927 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d294cd20-c533-49e3-a334-e32d0f2d293a None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:21.532352 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 632/1261] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:41:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:41:21.537714 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeee4a4-f880-4ce3-9504-f6e8c00821b1 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:21.538218 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeee4a4-f880-4ce3-9504-f6e8c00821b1 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:21.538313 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeee4a4-f880-4ce3-9504-f6e8c00821b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:21.556370 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-ebeee4a4-f880-4ce3-9504-f6e8c00821b1 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:41:21.557562 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-ebeee4a4-f880-4ce3-9504-f6e8c00821b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:41:21.625386 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 630/1262] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:41:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 17:41:21.648848 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d294cd20-c533-49e3-a334-e32d0f2d293a None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:41:21.660671 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:41:21.753389 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d294cd20-c533-49e3-a334-e32d0f2d293a None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:41:21.794293 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd515e8-0214-42e9-ba02-254e21ba610a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:41:21.795184 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd515e8-0214-42e9-ba02-254e21ba610a None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:21.795510 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd515e8-0214-42e9-ba02-254e21ba610a None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:21.795791 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd515e8-0214-42e9-ba02-254e21ba610a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:21.807248 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd515e8-0214-42e9-ba02-254e21ba610a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:41:21.815921 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-2bd515e8-0214-42e9-ba02-254e21ba610a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 17:41:21.815921 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:41:21.815921 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:41:21.815921 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:41:21.815921 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:41:21.815921 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:41:21.815921 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:41:21.815921 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:41:21.815921 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:41:21.815921 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:41:21.815921 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:41:21.815921 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:41:21.815921 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:41:21.815921 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:41:21.815921 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:41:21.815921 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:41:21.820410 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:41:21.820410 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:41:21.820410 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:41:21.820410 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:41:21.820410 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:41:21.820410 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:41:21.820410 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:41:21.820410 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:41:21.820410 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:41:21.820410 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:41:21.820410 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:41:21.820410 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:41:21.820410 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:41:21.820410 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:41:21.820410 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:41:21.820410 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:41:21.821418 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:41:21.821418 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:41:21.821418 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:41:21.821418 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:41:21.821418 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:41:21.821418 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:41:21.821418 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:41:21.821418 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:41:21.821418 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:41:21.821418 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:41:21.821418 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 17:41:21.821418 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:41:21.821418 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 633/1263] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jun 14 17:41:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:41:21.824120 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeee4a4-f880-4ce3-9504-f6e8c00821b1 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:41:21.844447 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:41:21.927557 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeee4a4-f880-4ce3-9504-f6e8c00821b1 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:41:21.961815 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c899098-06c6-4cb1-806a-47152be0d014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:41:21.962495 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c899098-06c6-4cb1-806a-47152be0d014 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:21.962781 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c899098-06c6-4cb1-806a-47152be0d014 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:21.963067 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c899098-06c6-4cb1-806a-47152be0d014 None admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:21.963840 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c899098-06c6-4cb1-806a-47152be0d014 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:41:21.964152 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c899098-06c6-4cb1-806a-47152be0d014 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:41:21.966211 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c899098-06c6-4cb1-806a-47152be0d014 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:41:21.975085 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 631/1264] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 14 17:41:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:41:21.981388 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd515e8-0214-42e9-ba02-254e21ba610a None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:41:22.050199 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:41:22.086481 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd515e8-0214-42e9-ba02-254e21ba610a None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:41:22.122495 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c915b606-ff18-412c-86d5-dfdfbe98dbb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:41:22.123291 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c915b606-ff18-412c-86d5-dfdfbe98dbb5 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:22.123608 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c915b606-ff18-412c-86d5-dfdfbe98dbb5 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:22.123899 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c915b606-ff18-412c-86d5-dfdfbe98dbb5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:22.135614 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c915b606-ff18-412c-86d5-dfdfbe98dbb5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:41:22.137131 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c915b606-ff18-412c-86d5-dfdfbe98dbb5 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:41:22.155501 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-c915b606-ff18-412c-86d5-dfdfbe98dbb5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:41:22.155501 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:41:22.155501 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:41:22.155501 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:41:22.155501 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:41:22.155501 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:41:22.155501 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:41:22.155501 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:41:22.155501 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:41:22.155501 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:41:22.155501 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:41:22.155501 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:41:22.155501 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:41:22.155501 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:41:22.155501 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:41:22.156579 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:41:22.156579 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:41:22.156579 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:41:22.156579 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:41:22.156579 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:41:22.156579 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:41:22.156579 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:41:22.156579 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:41:22.156579 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:41:22.156579 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:41:22.156579 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:41:22.156579 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:41:22.156579 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:41:22.156579 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:41:22.156579 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:41:22.156579 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:41:22.156579 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:41:22.157520 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:41:22.157520 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:41:22.157520 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:41:22.157520 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:41:22.157520 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 634/1265] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 14 17:41:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:41:22.162710 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c899098-06c6-4cb1-806a-47152be0d014 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:41:22.245247 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:41:22.265527 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c899098-06c6-4cb1-806a-47152be0d014 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:41:22.300061 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880b3ba3-3751-4758-97bb-dcdf7c88080f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:41:22.300762 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880b3ba3-3751-4758-97bb-dcdf7c88080f None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:22.300991 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880b3ba3-3751-4758-97bb-dcdf7c88080f None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:22.301276 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880b3ba3-3751-4758-97bb-dcdf7c88080f None admin] PATH_INFO: `/v3/domains` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:22.301992 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880b3ba3-3751-4758-97bb-dcdf7c88080f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:41:22.302301 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880b3ba3-3751-4758-97bb-dcdf7c88080f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:41:22.303727 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880b3ba3-3751-4758-97bb-dcdf7c88080f None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:41:22.316351 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 632/1266] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 14 17:41:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:41:22.322050 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c915b606-ff18-412c-86d5-dfdfbe98dbb5 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:41:22.428699 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c915b606-ff18-412c-86d5-dfdfbe98dbb5 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:41:22.450874 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:41:22.465157 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e40e2d1-6ada-40ad-be1d-e65f1b6b024a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:41:22.466385 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e40e2d1-6ada-40ad-be1d-e65f1b6b024a None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:22.466655 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e40e2d1-6ada-40ad-be1d-e65f1b6b024a None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:22.466935 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e40e2d1-6ada-40ad-be1d-e65f1b6b024a None admin] PATH_INFO: `/v3/users/placement` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:22.476062 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e40e2d1-6ada-40ad-be1d-e65f1b6b024a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:41:22.477563 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e40e2d1-6ada-40ad-be1d-e65f1b6b024a None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:41:22.494181 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-6e40e2d1-6ada-40ad-be1d-e65f1b6b024a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 14 17:41:22.494181 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:41:22.494181 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:41:22.494181 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:41:22.494181 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:41:22.494181 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:41:22.494181 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:41:22.494181 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:41:22.494181 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:41:22.494181 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:41:22.494181 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:41:22.494181 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:41:22.494181 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 14 17:41:22.494181 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 14 17:41:22.494181 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 14 17:41:22.494181 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 14 17:41:22.495620 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:41:22.495620 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:41:22.495620 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 14 17:41:22.495620 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:41:22.495620 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 14 17:41:22.495620 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:41:22.495620 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:41:22.495620 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:41:22.495620 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:41:22.495620 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:41:22.495620 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:41:22.495620 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:41:22.495620 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:41:22.495620 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:41:22.495620 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:41:22.495620 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:41:22.495620 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:41:22.495620 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:41:22.497571 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:41:22.497571 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:41:22.497571 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 14 17:41:22.497571 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 14 17:41:22.497571 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 14 17:41:22.497571 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 14 17:41:22.497571 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 14 17:41:22.497571 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 14 17:41:22.497571 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 14 17:41:22.497571 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:41:22.497571 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 635/1267] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 14 17:41:22 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:41:22.502846 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880b3ba3-3751-4758-97bb-dcdf7c88080f None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:41:22.613813 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880b3ba3-3751-4758-97bb-dcdf7c88080f None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:41:22.652290 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aad8fb0-7dd3-4ef1-9491-03ffdba3b65f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:41:22.652958 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aad8fb0-7dd3-4ef1-9491-03ffdba3b65f None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:22.653803 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aad8fb0-7dd3-4ef1-9491-03ffdba3b65f None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:22.654117 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aad8fb0-7dd3-4ef1-9491-03ffdba3b65f None admin] PATH_INFO: `/v3/users` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:22.655049 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aad8fb0-7dd3-4ef1-9491-03ffdba3b65f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:41:22.655392 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aad8fb0-7dd3-4ef1-9491-03ffdba3b65f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:41:22.656879 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aad8fb0-7dd3-4ef1-9491-03ffdba3b65f None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:41:22.666495 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:41:22.676006 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 633/1268] 10.222.0.36 () {56 vars in 1143 bytes} [Tue Jun 14 17:41:22 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:41:22.682073 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e40e2d1-6ada-40ad-be1d-e65f1b6b024a None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:41:22.790475 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e40e2d1-6ada-40ad-be1d-e65f1b6b024a None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:41:22.826642 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da6700d-4c30-4f7d-a154-41f8cab6e26d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:41:22.827477 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da6700d-4c30-4f7d-a154-41f8cab6e26d None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:22.827765 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da6700d-4c30-4f7d-a154-41f8cab6e26d None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:22.828052 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da6700d-4c30-4f7d-a154-41f8cab6e26d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:22.838820 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da6700d-4c30-4f7d-a154-41f8cab6e26d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:41:22.840338 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da6700d-4c30-4f7d-a154-41f8cab6e26d None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:41:22.857681 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-8da6700d-4c30-4f7d-a154-41f8cab6e26d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:41:22.857681 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:41:22.857681 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:41:22.857681 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:41:22.857681 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:41:22.857681 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:41:22.857681 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:41:22.857681 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:41:22.857681 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:41:22.857681 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:41:22.857681 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:41:22.857681 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:41:22.857681 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:41:22.857681 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:41:22.857681 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:41:22.858628 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:41:22.858628 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:41:22.858628 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:41:22.858628 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:41:22.858628 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:41:22.858628 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:41:22.858628 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:41:22.858628 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:41:22.858628 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:41:22.858628 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:41:22.858628 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:41:22.858628 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:41:22.858628 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:41:22.858628 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:41:22.858628 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:41:22.858628 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:41:22.858628 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:41:22.864393 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:41:22.864393 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:41:22.864393 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:41:22.864393 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:41:22.864393 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 636/1269] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 14 17:41:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:41:22.865228 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aad8fb0-7dd3-4ef1-9491-03ffdba3b65f None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:41:22.969024 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aad8fb0-7dd3-4ef1-9491-03ffdba3b65f None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:41:23.003282 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bc215c-f81d-4a21-ba3c-d56f69777666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:41:23.003986 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc215c-f81d-4a21-ba3c-d56f69777666 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:23.004270 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc215c-f81d-4a21-ba3c-d56f69777666 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:23.004557 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc215c-f81d-4a21-ba3c-d56f69777666 None admin] PATH_INFO: `/v3/domains` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:23.005279 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bc215c-f81d-4a21-ba3c-d56f69777666 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:41:23.005593 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bc215c-f81d-4a21-ba3c-d56f69777666 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:41:23.007211 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bc215c-f81d-4a21-ba3c-d56f69777666 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:41:23.019040 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 634/1270] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 14 17:41:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:41:23.024829 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da6700d-4c30-4f7d-a154-41f8cab6e26d None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:41:23.058385 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:41:23.128898 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da6700d-4c30-4f7d-a154-41f8cab6e26d None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:41:23.165286 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3778fc-553a-4570-b490-28c155b3bf16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:41:23.166088 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3778fc-553a-4570-b490-28c155b3bf16 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:23.166381 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3778fc-553a-4570-b490-28c155b3bf16 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:23.166671 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3778fc-553a-4570-b490-28c155b3bf16 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:23.173777 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3778fc-553a-4570-b490-28c155b3bf16 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:41:23.175246 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3778fc-553a-4570-b490-28c155b3bf16 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:41:23.190031 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-df3778fc-553a-4570-b490-28c155b3bf16 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:41:23.190031 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:41:23.190031 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:41:23.190031 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:41:23.190031 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:41:23.190031 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:41:23.190031 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:41:23.190031 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:41:23.190031 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:41:23.190031 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:41:23.190031 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:41:23.190031 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:41:23.190031 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 14 17:41:23.190031 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 14 17:41:23.190031 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 14 17:41:23.197192 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 14 17:41:23.197192 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:41:23.197192 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:41:23.197192 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:41:23.197192 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:41:23.197192 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:41:23.197192 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:41:23.197192 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:41:23.197192 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:41:23.197192 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:41:23.197192 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:41:23.197192 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:41:23.197192 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:41:23.197192 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:41:23.197192 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:41:23.197192 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:41:23.197192 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:41:23.198225 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 14 17:41:23.198225 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 14 17:41:23.198225 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 14 17:41:23.198225 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 14 17:41:23.198225 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 14 17:41:23.198225 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 14 17:41:23.198225 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:41:23.198225 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:41:23.198225 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 637/1271] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 14 17:41:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:41:23.198743 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bc215c-f81d-4a21-ba3c-d56f69777666 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:41:23.259321 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:41:23.300777 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bc215c-f81d-4a21-ba3c-d56f69777666 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:41:23.334972 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83157e7-196e-4749-8891-6e3931086f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:41:23.335672 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83157e7-196e-4749-8891-6e3931086f43 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:23.335971 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83157e7-196e-4749-8891-6e3931086f43 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:23.336245 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83157e7-196e-4749-8891-6e3931086f43 None admin] PATH_INFO: `/v3/projects` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:23.337037 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83157e7-196e-4749-8891-6e3931086f43 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:41:23.337351 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83157e7-196e-4749-8891-6e3931086f43 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:41:23.338824 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83157e7-196e-4749-8891-6e3931086f43 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:41:23.351114 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 635/1272] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jun 14 17:41:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:41:23.357891 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3778fc-553a-4570-b490-28c155b3bf16 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:41:23.455352 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:41:23.464340 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3778fc-553a-4570-b490-28c155b3bf16 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:41:23.500965 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940ddb44-266b-4609-a98a-193933d2de03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:41:23.501860 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940ddb44-266b-4609-a98a-193933d2de03 None admin] REQUEST_METHOD: `PUT` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:23.502148 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940ddb44-266b-4609-a98a-193933d2de03 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:23.502429 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940ddb44-266b-4609-a98a-193933d2de03 None admin] PATH_INFO: `/v3/projects/f3e1d023a52c42b98d018617987ef83c/users/6a8049f9c66b4b5185c26084fd8239ab/roles/1348580877d04014bfdec4d866b98a74` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:23.504418 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940ddb44-266b-4609-a98a-193933d2de03 None admin] RBAC: Authorizing `identity:create_grant(project_id=f3e1d023a52c42b98d018617987ef83c, user_id=6a8049f9c66b4b5185c26084fd8239ab, role_id=1348580877d04014bfdec4d866b98a74)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:41:23.505846 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940ddb44-266b-4609-a98a-193933d2de03 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:41:23.643230 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 638/1273] 10.222.0.36 () {58 vars in 1439 bytes} [Tue Jun 14 17:41:23 2022] PUT /identity/v3/projects/f3e1d023a52c42b98d018617987ef83c/users/6a8049f9c66b4b5185c26084fd8239ab/roles/1348580877d04014bfdec4d866b98a74 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 17:41:25.805691 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fa1949-df6c-4f03-ad80-63981cae737b None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:25.806287 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fa1949-df6c-4f03-ad80-63981cae737b None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:25.806287 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fa1949-df6c-4f03-ad80-63981cae737b None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:25.807711 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 636/1274] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:41:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:41:25.814690 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ad75f-0f72-4f9b-bfa6-c144a46b7be9 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:25.815212 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ad75f-0f72-4f9b-bfa6-c144a46b7be9 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:25.815320 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ad75f-0f72-4f9b-bfa6-c144a46b7be9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:25.833827 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-9f7ad75f-0f72-4f9b-bfa6-c144a46b7be9 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:41:25.838108 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-9f7ad75f-0f72-4f9b-bfa6-c144a46b7be9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:41:25.914952 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 639/1275] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:41:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 17:41:25.940084 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fa1949-df6c-4f03-ad80-63981cae737b None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:41:26.052018 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fa1949-df6c-4f03-ad80-63981cae737b None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:41:26.072420 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:41:26.093229 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a438f9-3507-4dba-96f5-1542be7774bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:41:26.094053 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a438f9-3507-4dba-96f5-1542be7774bd None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:26.094340 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a438f9-3507-4dba-96f5-1542be7774bd None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:26.094717 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a438f9-3507-4dba-96f5-1542be7774bd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:26.107504 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a438f9-3507-4dba-96f5-1542be7774bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:41:26.116896 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-e4a438f9-3507-4dba-96f5-1542be7774bd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 17:41:26.116896 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:41:26.116896 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:41:26.116896 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:41:26.116896 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:41:26.116896 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:41:26.116896 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:41:26.116896 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:41:26.116896 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:41:26.116896 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:41:26.116896 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:41:26.116896 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:41:26.116896 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:41:26.116896 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:41:26.116896 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:41:26.116896 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:41:26.118118 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:41:26.118118 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:41:26.118118 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:41:26.118118 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:41:26.118118 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:41:26.118118 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:41:26.118118 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:41:26.118118 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:41:26.118118 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:41:26.118118 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:41:26.118118 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:41:26.118118 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:41:26.118118 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:41:26.118118 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:41:26.118118 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:41:26.118118 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:41:26.119033 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:41:26.119033 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:41:26.119033 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:41:26.119033 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:41:26.119033 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:41:26.119033 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:41:26.119033 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:41:26.119033 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:41:26.119033 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:41:26.119033 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:41:26.119033 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 17:41:26.119033 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:41:26.119033 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 637/1276] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jun 14 17:41:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:41:26.125114 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7ad75f-0f72-4f9b-bfa6-c144a46b7be9 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:41:26.210113 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:41:26.228334 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7ad75f-0f72-4f9b-bfa6-c144a46b7be9 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:41:26.263156 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452a2fc5-0ec3-42bd-9cc4-4b952251946b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:41:26.263784 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452a2fc5-0ec3-42bd-9cc4-4b952251946b None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:26.264298 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452a2fc5-0ec3-42bd-9cc4-4b952251946b None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:26.264896 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452a2fc5-0ec3-42bd-9cc4-4b952251946b None admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:26.265538 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452a2fc5-0ec3-42bd-9cc4-4b952251946b None admin] RBAC: Adding query filter params (name=admin) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:41:26.266201 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452a2fc5-0ec3-42bd-9cc4-4b952251946b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:41:26.267647 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452a2fc5-0ec3-42bd-9cc4-4b952251946b None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:41:26.276882 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 640/1277] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 14 17:41:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:41:26.283134 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a438f9-3507-4dba-96f5-1542be7774bd None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:41:26.386442 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a438f9-3507-4dba-96f5-1542be7774bd None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:41:26.425596 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c07b8f5-d35c-4e7d-bde7-a8b627cb8127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:41:26.426396 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c07b8f5-d35c-4e7d-bde7-a8b627cb8127 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:26.426685 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c07b8f5-d35c-4e7d-bde7-a8b627cb8127 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:26.426969 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c07b8f5-d35c-4e7d-bde7-a8b627cb8127 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:26.439935 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c07b8f5-d35c-4e7d-bde7-a8b627cb8127 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:41:26.441451 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c07b8f5-d35c-4e7d-bde7-a8b627cb8127 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:41:26.459976 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-4c07b8f5-d35c-4e7d-bde7-a8b627cb8127 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:41:26.459976 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:41:26.459976 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:41:26.459976 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:41:26.459976 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:41:26.459976 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:41:26.459976 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:41:26.459976 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:41:26.459976 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:41:26.459976 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:41:26.459976 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:41:26.459976 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:41:26.459976 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:41:26.459976 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:41:26.459976 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:41:26.461732 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:41:26.461732 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:41:26.461732 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:41:26.461732 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:41:26.461732 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:41:26.461732 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:41:26.461732 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:41:26.461732 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:41:26.461732 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:41:26.461732 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:41:26.461732 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:41:26.461732 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:41:26.461732 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:41:26.461732 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:41:26.461732 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:41:26.461732 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:41:26.461732 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:41:26.463004 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:41:26.463004 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:41:26.463004 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:41:26.463004 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:41:26.463004 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 638/1278] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 14 17:41:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:41:26.467920 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452a2fc5-0ec3-42bd-9cc4-4b952251946b None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:41:26.571632 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452a2fc5-0ec3-42bd-9cc4-4b952251946b None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:41:26.605950 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b97152f-01b0-4716-b018-2cc9322b4a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:41:26.607410 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97152f-01b0-4716-b018-2cc9322b4a49 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:26.607780 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97152f-01b0-4716-b018-2cc9322b4a49 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:26.608070 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97152f-01b0-4716-b018-2cc9322b4a49 None admin] PATH_INFO: `/v3/domains` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:26.608808 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b97152f-01b0-4716-b018-2cc9322b4a49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:41:26.609114 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b97152f-01b0-4716-b018-2cc9322b4a49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:41:26.610488 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b97152f-01b0-4716-b018-2cc9322b4a49 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:41:26.622818 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 641/1279] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 14 17:41:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:41:26.628697 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c07b8f5-d35c-4e7d-bde7-a8b627cb8127 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:41:26.661625 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:41:26.730655 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c07b8f5-d35c-4e7d-bde7-a8b627cb8127 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:41:26.765476 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e271d4d2-6451-414a-8b13-3a83d470e9ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:41:26.766280 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e271d4d2-6451-414a-8b13-3a83d470e9ad None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:26.766565 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e271d4d2-6451-414a-8b13-3a83d470e9ad None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:26.766840 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e271d4d2-6451-414a-8b13-3a83d470e9ad None admin] PATH_INFO: `/v3/users/placement` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:26.774710 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e271d4d2-6451-414a-8b13-3a83d470e9ad None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:41:26.776180 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e271d4d2-6451-414a-8b13-3a83d470e9ad None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:41:26.791268 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-e271d4d2-6451-414a-8b13-3a83d470e9ad None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 14 17:41:26.791268 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:41:26.791268 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:41:26.791268 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:41:26.791268 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:41:26.791268 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:41:26.791268 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:41:26.791268 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:41:26.791268 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:41:26.791268 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:41:26.791268 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:41:26.791268 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:41:26.791268 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 14 17:41:26.791268 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 14 17:41:26.791268 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 14 17:41:26.791268 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 14 17:41:26.792503 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:41:26.792503 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:41:26.792503 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 14 17:41:26.792503 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:41:26.792503 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 14 17:41:26.792503 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:41:26.792503 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:41:26.792503 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:41:26.792503 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:41:26.792503 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:41:26.792503 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:41:26.792503 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:41:26.792503 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:41:26.792503 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:41:26.792503 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:41:26.792503 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:41:26.792503 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:41:26.792503 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:41:26.793463 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:41:26.793463 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:41:26.793463 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 14 17:41:26.793463 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 14 17:41:26.793463 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 14 17:41:26.793463 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 14 17:41:26.793463 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 14 17:41:26.793463 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 14 17:41:26.793463 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 14 17:41:26.793463 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:41:26.793463 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 639/1280] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 14 17:41:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:41:26.800378 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b97152f-01b0-4716-b018-2cc9322b4a49 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:41:26.804379 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:41:26.905298 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b97152f-01b0-4716-b018-2cc9322b4a49 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:41:26.938557 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b5dac5-7d37-4e71-8928-9ad8e080ca36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:41:26.939403 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b5dac5-7d37-4e71-8928-9ad8e080ca36 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:26.939688 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b5dac5-7d37-4e71-8928-9ad8e080ca36 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:26.939960 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b5dac5-7d37-4e71-8928-9ad8e080ca36 None admin] PATH_INFO: `/v3/users` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:26.940790 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b5dac5-7d37-4e71-8928-9ad8e080ca36 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:41:26.941099 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b5dac5-7d37-4e71-8928-9ad8e080ca36 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:41:26.942525 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b5dac5-7d37-4e71-8928-9ad8e080ca36 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:41:26.961246 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 642/1281] 10.222.0.36 () {56 vars in 1143 bytes} [Tue Jun 14 17:41:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:41:26.968015 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e271d4d2-6451-414a-8b13-3a83d470e9ad None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:41:27.064164 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:41:27.073750 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e271d4d2-6451-414a-8b13-3a83d470e9ad None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:41:27.108371 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4246b94-a1f0-474b-97b2-c495cb0c7504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:41:27.109027 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4246b94-a1f0-474b-97b2-c495cb0c7504 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:27.109317 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4246b94-a1f0-474b-97b2-c495cb0c7504 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:27.109600 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4246b94-a1f0-474b-97b2-c495cb0c7504 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:27.181237 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4246b94-a1f0-474b-97b2-c495cb0c7504 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:41:27.182769 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4246b94-a1f0-474b-97b2-c495cb0c7504 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:41:27.275685 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:41:27.286358 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 640/1282] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 14 17:41:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 14 17:41:27.292330 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b5dac5-7d37-4e71-8928-9ad8e080ca36 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:41:27.354494 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:41:27.393276 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b5dac5-7d37-4e71-8928-9ad8e080ca36 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:41:27.427878 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524cadb0-70b1-4e65-beec-adf520e09e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:41:27.428764 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524cadb0-70b1-4e65-beec-adf520e09e52 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:27.429044 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524cadb0-70b1-4e65-beec-adf520e09e52 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:27.429319 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524cadb0-70b1-4e65-beec-adf520e09e52 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:27.439105 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524cadb0-70b1-4e65-beec-adf520e09e52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:41:27.440657 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524cadb0-70b1-4e65-beec-adf520e09e52 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:41:27.458755 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-524cadb0-70b1-4e65-beec-adf520e09e52 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:41:27.458755 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:41:27.458755 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:41:27.458755 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:41:27.458755 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:41:27.458755 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:41:27.458755 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:41:27.458755 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:41:27.458755 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:41:27.458755 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:41:27.458755 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:41:27.458755 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:41:27.458755 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:41:27.458755 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:41:27.458755 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:41:27.463168 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:41:27.463168 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:41:27.463168 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:41:27.463168 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:41:27.463168 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:41:27.463168 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:41:27.463168 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:41:27.463168 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:41:27.463168 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:41:27.463168 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:41:27.463168 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:41:27.463168 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:41:27.463168 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:41:27.463168 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:41:27.463168 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:41:27.463168 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:41:27.463168 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:41:27.464861 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:41:27.464861 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:41:27.464861 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:41:27.464861 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:41:27.464861 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 643/1283] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 14 17:41:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:41:27.466598 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4246b94-a1f0-474b-97b2-c495cb0c7504 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:41:27.574000 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4246b94-a1f0-474b-97b2-c495cb0c7504 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:41:27.609921 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865b5146-fd12-4bc7-8196-e8aab692cfa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:41:27.610589 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865b5146-fd12-4bc7-8196-e8aab692cfa3 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:27.610871 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865b5146-fd12-4bc7-8196-e8aab692cfa3 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:27.611149 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865b5146-fd12-4bc7-8196-e8aab692cfa3 None admin] PATH_INFO: `/v3/domains` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:27.611901 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865b5146-fd12-4bc7-8196-e8aab692cfa3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:41:27.612238 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865b5146-fd12-4bc7-8196-e8aab692cfa3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:41:27.613610 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865b5146-fd12-4bc7-8196-e8aab692cfa3 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:41:27.624881 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 641/1284] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 14 17:41:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:41:27.630804 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524cadb0-70b1-4e65-beec-adf520e09e52 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:41:27.736777 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524cadb0-70b1-4e65-beec-adf520e09e52 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:41:27.751160 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:41:27.771717 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3221515-0604-4a14-9da1-698570bd9af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:41:27.772517 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3221515-0604-4a14-9da1-698570bd9af4 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:27.772805 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3221515-0604-4a14-9da1-698570bd9af4 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:27.773086 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3221515-0604-4a14-9da1-698570bd9af4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:27.780768 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3221515-0604-4a14-9da1-698570bd9af4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:41:27.782254 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3221515-0604-4a14-9da1-698570bd9af4 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:41:27.796634 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-f3221515-0604-4a14-9da1-698570bd9af4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:41:27.796634 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:41:27.796634 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:41:27.796634 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:41:27.796634 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:41:27.796634 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:41:27.796634 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:41:27.796634 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:41:27.796634 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:41:27.796634 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:41:27.796634 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:41:27.796634 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:41:27.796634 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 14 17:41:27.796634 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 14 17:41:27.796634 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 14 17:41:27.797709 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 14 17:41:27.797709 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:41:27.797709 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:41:27.797709 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:41:27.797709 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:41:27.797709 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:41:27.797709 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:41:27.797709 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:41:27.797709 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( Jun 14 17:41:27.797709 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:41:27.797709 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:41:27.797709 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:41:27.797709 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:41:27.797709 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:41:27.797709 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:41:27.797709 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:41:27.797709 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:41:27.799094 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 14 17:41:27.799094 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 14 17:41:27.799094 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 14 17:41:27.799094 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 14 17:41:27.799094 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 14 17:41:27.799094 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 14 17:41:27.799094 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:41:27.799094 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: ERROR keystone.server.flask.application Jun 14 17:41:27.799094 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 644/1285] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 14 17:41:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 17:41:27.803796 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865b5146-fd12-4bc7-8196-e8aab692cfa3 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:41:27.854592 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:41:27.906332 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865b5146-fd12-4bc7-8196-e8aab692cfa3 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:41:27.938938 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca3348c-95a9-4507-93dc-c01ec2844997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:41:27.941802 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca3348c-95a9-4507-93dc-c01ec2844997 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:27.941802 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca3348c-95a9-4507-93dc-c01ec2844997 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:27.941802 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca3348c-95a9-4507-93dc-c01ec2844997 None admin] PATH_INFO: `/v3/projects` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:27.941802 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca3348c-95a9-4507-93dc-c01ec2844997 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:41:27.941802 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca3348c-95a9-4507-93dc-c01ec2844997 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:41:27.942681 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca3348c-95a9-4507-93dc-c01ec2844997 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:41:27.955193 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 642/1286] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jun 14 17:41:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:41:27.961439 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3221515-0604-4a14-9da1-698570bd9af4 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:41:28.065274 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3221515-0604-4a14-9da1-698570bd9af4 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:41:28.099813 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4847aa21-7e59-40b5-9936-83b16de2d233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:41:28.100473 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4847aa21-7e59-40b5-9936-83b16de2d233 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:28.100763 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4847aa21-7e59-40b5-9936-83b16de2d233 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:28.101045 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4847aa21-7e59-40b5-9936-83b16de2d233 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:28.101871 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4847aa21-7e59-40b5-9936-83b16de2d233 None admin] RBAC: Adding query filter params (role.id=1348580877d04014bfdec4d866b98a74, scope.project.id=f3e1d023a52c42b98d018617987ef83c, user.id=6a8049f9c66b4b5185c26084fd8239ab) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:41:28.102187 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4847aa21-7e59-40b5-9936-83b16de2d233 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:41:28.103831 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4847aa21-7e59-40b5-9936-83b16de2d233 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:41:28.113490 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 645/1287] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 14 17:41:27 2022] GET /identity/v3/role_assignments?user.id=6a8049f9c66b4b5185c26084fd8239ab&scope.project.id=f3e1d023a52c42b98d018617987ef83c&role.id=1348580877d04014bfdec4d866b98a74 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:41:30.338307 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136bed59-bbfa-46f8-aa7f-4286f641ecad None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:30.338913 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136bed59-bbfa-46f8-aa7f-4286f641ecad None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:30.338913 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136bed59-bbfa-46f8-aa7f-4286f641ecad None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:30.340296 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 643/1288] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:41:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:41:30.346507 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e9890b-7fb7-42d7-9412-cbb715fc72d1 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:30.346954 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e9890b-7fb7-42d7-9412-cbb715fc72d1 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:30.347080 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e9890b-7fb7-42d7-9412-cbb715fc72d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:30.365302 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-17e9890b-7fb7-42d7-9412-cbb715fc72d1 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:41:30.366496 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-17e9890b-7fb7-42d7-9412-cbb715fc72d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:41:30.397654 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:41:30.436671 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 646/1289] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:41:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 17:41:30.460517 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136bed59-bbfa-46f8-aa7f-4286f641ecad None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:41:30.565056 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136bed59-bbfa-46f8-aa7f-4286f641ecad None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:41:30.575899 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:41:30.599229 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4ac52f-4aa5-49fa-9e9c-74beb48090e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:41:30.600070 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ac52f-4aa5-49fa-9e9c-74beb48090e6 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:30.600357 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ac52f-4aa5-49fa-9e9c-74beb48090e6 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:30.600636 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ac52f-4aa5-49fa-9e9c-74beb48090e6 None admin] PATH_INFO: `/v3/services/placement` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:30.601290 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4ac52f-4aa5-49fa-9e9c-74beb48090e6 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:41:30.602686 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4ac52f-4aa5-49fa-9e9c-74beb48090e6 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:41:30.615192 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-7d4ac52f-4aa5-49fa-9e9c-74beb48090e6 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 14 17:41:30.615192 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:41:30.615192 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 14 17:41:30.615192 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 14 17:41:30.615192 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 14 17:41:30.615192 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 14 17:41:30.615192 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 14 17:41:30.615192 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 17:41:30.615192 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 14 17:41:30.615192 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:41:30.615192 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 14 17:41:30.615192 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:41:30.615192 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:41:30.615192 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:41:30.615192 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:41:30.615192 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:41:30.615192 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:41:30.616484 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:41:30.616484 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:41:30.616484 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:41:30.616484 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:41:30.616484 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:41:30.616484 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:41:30.616484 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 14 17:41:30.616484 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 14 17:41:30.616484 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 14 17:41:30.616484 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 14 17:41:30.616484 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:41:30.616484 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:41:30.616484 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:41:30.616484 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:41:30.616484 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:41:30.616484 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:41:30.617722 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:41:30.617722 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:41:30.617722 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:41:30.617722 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:41:30.617722 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:41:30.617722 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:41:30.617722 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:41:30.617722 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:41:30.617722 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:41:30.617722 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:41:30.617722 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 14 17:41:30.617722 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 17:41:30.617722 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 14 17:41:30.617722 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:41:30.617722 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 644/1290] 10.222.0.36 () {56 vars in 1117 bytes} [Tue Jun 14 17:41:30 2022] GET /identity/v3/services/placement => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:41:30.622838 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e9890b-7fb7-42d7-9412-cbb715fc72d1 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:41:30.721433 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e9890b-7fb7-42d7-9412-cbb715fc72d1 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:41:30.755694 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ee2bae-5722-4e97-ba83-e5461e05b61a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:41:30.756373 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ee2bae-5722-4e97-ba83-e5461e05b61a None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:30.756666 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ee2bae-5722-4e97-ba83-e5461e05b61a None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:30.756952 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ee2bae-5722-4e97-ba83-e5461e05b61a None admin] PATH_INFO: `/v3/services` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:30.757916 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ee2bae-5722-4e97-ba83-e5461e05b61a None admin] RBAC: Adding query filter params (name=placement) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:41:30.758262 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ee2bae-5722-4e97-ba83-e5461e05b61a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:41:30.759681 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ee2bae-5722-4e97-ba83-e5461e05b61a None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:41:30.765429 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 647/1291] 10.222.0.36 () {56 vars in 1116 bytes} [Tue Jun 14 17:41:30 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:41:30.771206 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4ac52f-4aa5-49fa-9e9c-74beb48090e6 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:41:30.878007 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4ac52f-4aa5-49fa-9e9c-74beb48090e6 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:41:30.912855 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cb34e1-5378-4658-af1a-4fc179183679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:41:30.913527 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cb34e1-5378-4658-af1a-4fc179183679 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:30.913842 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cb34e1-5378-4658-af1a-4fc179183679 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:30.914128 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cb34e1-5378-4658-af1a-4fc179183679 None admin] PATH_INFO: `/v3/services` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:30.914868 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cb34e1-5378-4658-af1a-4fc179183679 None admin] RBAC: Adding query filter params (type=placement) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:41:30.915183 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cb34e1-5378-4658-af1a-4fc179183679 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:41:30.916588 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cb34e1-5378-4658-af1a-4fc179183679 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:41:30.921434 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 645/1292] 10.222.0.36 () {56 vars in 1116 bytes} [Tue Jun 14 17:41:30 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:41:33.094095 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4633dad3-c539-44df-84e0-1bf488669406 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:33.094648 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4633dad3-c539-44df-84e0-1bf488669406 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:33.094648 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4633dad3-c539-44df-84e0-1bf488669406 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:33.096054 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 648/1293] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:41:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:41:33.101298 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b19320-14a1-430f-8ec7-b82f1bb4d5b3 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:33.101762 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b19320-14a1-430f-8ec7-b82f1bb4d5b3 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:33.101861 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b19320-14a1-430f-8ec7-b82f1bb4d5b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:33.119643 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-76b19320-14a1-430f-8ec7-b82f1bb4d5b3 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:41:33.120903 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-76b19320-14a1-430f-8ec7-b82f1bb4d5b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:41:33.152776 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:41:33.191232 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 646/1294] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:41:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 17:41:33.216476 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4633dad3-c539-44df-84e0-1bf488669406 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:41:33.249034 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:41:33.319844 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4633dad3-c539-44df-84e0-1bf488669406 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:41:33.357980 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbb83f9-9c93-408c-ad4f-da81c1a90de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:41:33.363318 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbb83f9-9c93-408c-ad4f-da81c1a90de7 None admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:33.363318 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbb83f9-9c93-408c-ad4f-da81c1a90de7 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:33.363318 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbb83f9-9c93-408c-ad4f-da81c1a90de7 None admin] PATH_INFO: `/v3/services` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:33.363318 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbb83f9-9c93-408c-ad4f-da81c1a90de7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:41:33.363318 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbb83f9-9c93-408c-ad4f-da81c1a90de7 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:41:33.482791 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 649/1295] 10.222.0.36 () {60 vars in 1141 bytes} [Tue Jun 14 17:41:33 2022] POST /identity/v3/services => generated 246 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:41:35.668427 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84875614-65b6-42f2-934e-244857a25f91 None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:35.669063 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84875614-65b6-42f2-934e-244857a25f91 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:35.669063 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84875614-65b6-42f2-934e-244857a25f91 None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:35.670530 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 647/1296] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:41:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:41:35.676631 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac95b7-b0d2-4e0f-a589-df389471f140 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:35.677186 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac95b7-b0d2-4e0f-a589-df389471f140 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:35.677186 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac95b7-b0d2-4e0f-a589-df389471f140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:35.696101 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-42ac95b7-b0d2-4e0f-a589-df389471f140 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:41:35.697338 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-42ac95b7-b0d2-4e0f-a589-df389471f140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:41:35.781064 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 650/1297] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:41:35 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 17:41:35.804754 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84875614-65b6-42f2-934e-244857a25f91 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:41:35.921794 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84875614-65b6-42f2-934e-244857a25f91 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:41:35.959638 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d28c242-b5bf-4bde-8090-f890d5444774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:41:35.960449 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d28c242-b5bf-4bde-8090-f890d5444774 None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:35.960739 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d28c242-b5bf-4bde-8090-f890d5444774 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:35.961021 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d28c242-b5bf-4bde-8090-f890d5444774 None admin] PATH_INFO: `/v3/services/placement` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:35.961681 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d28c242-b5bf-4bde-8090-f890d5444774 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:41:35.963078 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d28c242-b5bf-4bde-8090-f890d5444774 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:41:35.975333 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-7d28c242-b5bf-4bde-8090-f890d5444774 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 14 17:41:35.975333 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:41:35.975333 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 14 17:41:35.975333 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 14 17:41:35.975333 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 14 17:41:35.975333 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 14 17:41:35.975333 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 14 17:41:35.975333 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 17:41:35.975333 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 14 17:41:35.975333 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:41:35.975333 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 14 17:41:35.975333 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:41:35.975333 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:41:35.975333 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:41:35.975333 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:41:35.975333 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:41:35.975333 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:41:35.982055 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:41:35.982055 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:41:35.982055 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:41:35.982055 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:41:35.982055 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:41:35.982055 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:41:35.982055 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 14 17:41:35.982055 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 14 17:41:35.982055 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 14 17:41:35.982055 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 14 17:41:35.982055 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:41:35.982055 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:41:35.982055 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:41:35.982055 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:41:35.982055 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:41:35.982055 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:41:35.983722 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:41:35.983722 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:41:35.983722 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:41:35.983722 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:41:35.983722 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:41:35.983722 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:41:35.983722 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:41:35.983722 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:41:35.983722 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:41:35.983722 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:41:35.983722 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 14 17:41:35.983722 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 17:41:35.983722 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 14 17:41:35.983722 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:41:35.983722 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 648/1298] 10.222.0.36 () {56 vars in 1117 bytes} [Tue Jun 14 17:41:35 2022] GET /identity/v3/services/placement => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:41:35.984737 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ac95b7-b0d2-4e0f-a589-df389471f140 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:41:36.002629 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:41:36.083900 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ac95b7-b0d2-4e0f-a589-df389471f140 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:41:36.118395 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ce32c6-3c37-4563-ad90-4e83e3b63819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:41:36.119071 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ce32c6-3c37-4563-ad90-4e83e3b63819 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:36.119382 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ce32c6-3c37-4563-ad90-4e83e3b63819 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:36.119665 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ce32c6-3c37-4563-ad90-4e83e3b63819 None admin] PATH_INFO: `/v3/services` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:36.120366 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ce32c6-3c37-4563-ad90-4e83e3b63819 None admin] RBAC: Adding query filter params (name=placement) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:41:36.120680 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ce32c6-3c37-4563-ad90-4e83e3b63819 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:41:36.122764 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ce32c6-3c37-4563-ad90-4e83e3b63819 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:41:36.129148 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 651/1299] 10.222.0.36 () {56 vars in 1116 bytes} [Tue Jun 14 17:41:35 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:41:36.135828 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d28c242-b5bf-4bde-8090-f890d5444774 None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:41:36.168047 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:41:36.243088 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d28c242-b5bf-4bde-8090-f890d5444774 None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:41:36.278997 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4d4a6b-bb9e-4c5c-8bf0-51feb28fb88d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:41:36.279694 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4d4a6b-bb9e-4c5c-8bf0-51feb28fb88d None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:36.279981 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4d4a6b-bb9e-4c5c-8bf0-51feb28fb88d None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:36.280259 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4d4a6b-bb9e-4c5c-8bf0-51feb28fb88d None admin] PATH_INFO: `/v3/endpoints` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:36.281053 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4d4a6b-bb9e-4c5c-8bf0-51feb28fb88d None admin] RBAC: Adding query filter params (interface=public, service_id=829ff29d18394db7808824344438a3d8, region_id=RegionOne) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:41:36.281372 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4d4a6b-bb9e-4c5c-8bf0-51feb28fb88d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:41:36.282785 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4d4a6b-bb9e-4c5c-8bf0-51feb28fb88d None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:41:36.287959 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 649/1300] 10.222.0.36 () {56 vars in 1251 bytes} [Tue Jun 14 17:41:36 2022] GET /identity/v3/endpoints?service_id=829ff29d18394db7808824344438a3d8&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:41:36.293985 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ce32c6-3c37-4563-ad90-4e83e3b63819 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:41:36.377909 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:41:36.397197 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ce32c6-3c37-4563-ad90-4e83e3b63819 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:41:36.431361 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23af298-410a-4d4d-9adb-e041b26421ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:41:36.432900 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23af298-410a-4d4d-9adb-e041b26421ef None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:36.432900 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23af298-410a-4d4d-9adb-e041b26421ef None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:36.432900 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23af298-410a-4d4d-9adb-e041b26421ef None admin] PATH_INFO: `/v3/services` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:36.433256 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23af298-410a-4d4d-9adb-e041b26421ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:41:36.435210 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23af298-410a-4d4d-9adb-e041b26421ef None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:41:36.442135 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 652/1301] 10.222.0.36 () {56 vars in 1087 bytes} [Tue Jun 14 17:41:36 2022] GET /identity/v3/services => generated 2191 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 17:41:38.615026 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb37d67-ac82-4ab5-814f-45db29fb82b4 None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:38.615638 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb37d67-ac82-4ab5-814f-45db29fb82b4 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:38.615638 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb37d67-ac82-4ab5-814f-45db29fb82b4 None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:38.617045 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 650/1302] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:41:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:41:38.622731 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a548bf9-c458-4815-83a2-6abef6fcc800 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:38.623146 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a548bf9-c458-4815-83a2-6abef6fcc800 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:38.623337 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a548bf9-c458-4815-83a2-6abef6fcc800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:38.640649 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-4a548bf9-c458-4815-83a2-6abef6fcc800 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:41:38.641845 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-4a548bf9-c458-4815-83a2-6abef6fcc800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:41:38.710161 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 653/1303] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:41:38 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 17:41:38.733949 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb37d67-ac82-4ab5-814f-45db29fb82b4 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:41:38.833869 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:41:38.840876 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb37d67-ac82-4ab5-814f-45db29fb82b4 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:41:38.876054 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d65256-cb3d-43b7-b1d2-b4e8891e994c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:41:38.876775 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d65256-cb3d-43b7-b1d2-b4e8891e994c None admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:38.877061 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d65256-cb3d-43b7-b1d2-b4e8891e994c None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:38.877339 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d65256-cb3d-43b7-b1d2-b4e8891e994c None admin] PATH_INFO: `/v3/services/placement` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:38.877984 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d65256-cb3d-43b7-b1d2-b4e8891e994c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:41:38.879384 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d65256-cb3d-43b7-b1d2-b4e8891e994c None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:41:38.891556 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application [None req-93d65256-cb3d-43b7-b1d2-b4e8891e994c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 14 17:41:38.891556 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:41:38.891556 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 14 17:41:38.891556 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 14 17:41:38.891556 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 14 17:41:38.891556 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 14 17:41:38.891556 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 14 17:41:38.891556 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 17:41:38.891556 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 14 17:41:38.891556 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:41:38.891556 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 14 17:41:38.891556 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:41:38.891556 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:41:38.891556 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:41:38.891556 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:41:38.891556 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:41:38.891556 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:41:38.892775 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:41:38.892775 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:41:38.892775 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:41:38.892775 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:41:38.892775 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:41:38.892775 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:41:38.892775 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 14 17:41:38.892775 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 14 17:41:38.892775 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 14 17:41:38.892775 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 14 17:41:38.892775 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:41:38.892775 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:41:38.892775 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:41:38.892775 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:41:38.892775 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:41:38.892775 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:41:38.894240 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:41:38.894240 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application with Lock( Jun 14 17:41:38.894240 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:41:38.894240 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:41:38.894240 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:41:38.894240 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:41:38.894240 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:41:38.894240 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:41:38.894240 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:41:38.894240 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:41:38.894240 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 14 17:41:38.894240 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 17:41:38.894240 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 14 17:41:38.894240 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: ERROR keystone.server.flask.application Jun 14 17:41:38.894240 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 651/1304] 10.222.0.36 () {56 vars in 1117 bytes} [Tue Jun 14 17:41:38 2022] GET /identity/v3/services/placement => generated 90 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:41:38.901706 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a548bf9-c458-4815-83a2-6abef6fcc800 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:41:38.977745 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:41:39.005105 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a548bf9-c458-4815-83a2-6abef6fcc800 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:41:39.046069 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c476c94-e1f0-42ce-9cb7-42996bbf5ca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:41:39.046770 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c476c94-e1f0-42ce-9cb7-42996bbf5ca8 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:39.047057 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c476c94-e1f0-42ce-9cb7-42996bbf5ca8 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:39.047439 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c476c94-e1f0-42ce-9cb7-42996bbf5ca8 None admin] PATH_INFO: `/v3/services` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:39.048172 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c476c94-e1f0-42ce-9cb7-42996bbf5ca8 None admin] RBAC: Adding query filter params (name=placement) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:41:39.048487 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c476c94-e1f0-42ce-9cb7-42996bbf5ca8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:41:39.049937 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c476c94-e1f0-42ce-9cb7-42996bbf5ca8 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:41:39.055975 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 654/1305] 10.222.0.36 () {56 vars in 1116 bytes} [Tue Jun 14 17:41:38 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:41:39.063155 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d65256-cb3d-43b7-b1d2-b4e8891e994c None admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:41:39.163761 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d65256-cb3d-43b7-b1d2-b4e8891e994c None admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:41:39.198788 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10efd2cb-5349-4866-b5d1-8040b3526726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:41:39.199484 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10efd2cb-5349-4866-b5d1-8040b3526726 None admin] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:39.199780 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10efd2cb-5349-4866-b5d1-8040b3526726 None admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:39.200135 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10efd2cb-5349-4866-b5d1-8040b3526726 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:39.200854 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10efd2cb-5349-4866-b5d1-8040b3526726 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:41:39.202230 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10efd2cb-5349-4866-b5d1-8040b3526726 None admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:41:39.416904 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 652/1306] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Jun 14 17:41:39 2022] POST /identity/v3/endpoints => generated 331 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:41:49.052484 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=30 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:41:49.410160 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:49:34.002259 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b1205b-fd31-499b-ba04-7f503f460a40 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:49:34.003533 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b1205b-fd31-499b-ba04-7f503f460a40 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:49:34.003533 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b1205b-fd31-499b-ba04-7f503f460a40 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:49:34.004536 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 655/1307] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:49:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:49:34.010146 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63389e23-de3d-4869-9fa2-3312d2061702 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:49:34.011012 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63389e23-de3d-4869-9fa2-3312d2061702 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:49:34.011928 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63389e23-de3d-4869-9fa2-3312d2061702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:49:34.110991 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-63389e23-de3d-4869-9fa2-3312d2061702 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:49:34.112243 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-63389e23-de3d-4869-9fa2-3312d2061702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:49:34.251325 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 653/1308] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:49:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:49:34.306900 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c5f9f-9d04-48e5-a13b-feab715bb4a6 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:49:34.307194 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c5f9f-9d04-48e5-a13b-feab715bb4a6 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:49:34.307507 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c5f9f-9d04-48e5-a13b-feab715bb4a6 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:49:34.309207 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 656/1309] 10.222.0.36 () {54 vars in 964 bytes} [Tue Jun 14 17:49:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:49:34.318063 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b015e541-ae56-42b0-a8bd-c30e1e4f2c93 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:49:34.318278 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b015e541-ae56-42b0-a8bd-c30e1e4f2c93 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:49:34.318564 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b015e541-ae56-42b0-a8bd-c30e1e4f2c93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:49:34.437891 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-b015e541-ae56-42b0-a8bd-c30e1e4f2c93 None None] MFA Rules not processed for user `5652329c71cd431fb579d69cef933b37`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:49:34.439124 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-b015e541-ae56-42b0-a8bd-c30e1e4f2c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:49:34.462496 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:49:34.535724 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 654/1310] 10.222.0.36 () {58 vars in 1061 bytes} [Tue Jun 14 17:49:34 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:49:34.544630 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4c5f9f-9d04-48e5-a13b-feab715bb4a6 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:49:34.547263 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-de4c5f9f-9d04-48e5-a13b-feab715bb4a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:49:34.668439 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4c5f9f-9d04-48e5-a13b-feab715bb4a6 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:49:34.751604 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba7d75e-4675-4eac-9f1d-16b13ad92695 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5652329c71cd431fb579d69cef933b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:49:34.752168 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba7d75e-4675-4eac-9f1d-16b13ad92695 service neutron] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:49:34.752455 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba7d75e-4675-4eac-9f1d-16b13ad92695 service neutron] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:49:34.752733 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba7d75e-4675-4eac-9f1d-16b13ad92695 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:49:34.754377 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-fba7d75e-4675-4eac-9f1d-16b13ad92695 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:49:34.813470 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:49:34.873686 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba7d75e-4675-4eac-9f1d-16b13ad92695 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:49:34.875758 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba7d75e-4675-4eac-9f1d-16b13ad92695 service neutron] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:49:34.895927 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 657/1311] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:49:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:49:37.452968 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba48789-288d-45f1-8de1-3d7d6f50bed5 None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:49:37.453690 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba48789-288d-45f1-8de1-3d7d6f50bed5 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:49:37.453690 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba48789-288d-45f1-8de1-3d7d6f50bed5 None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:49:37.455609 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 655/1312] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:49:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:49:37.461414 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf49b4ee-886d-49fc-aeaf-440e8b7e8ed1 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:49:37.461960 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf49b4ee-886d-49fc-aeaf-440e8b7e8ed1 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:49:37.461960 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf49b4ee-886d-49fc-aeaf-440e8b7e8ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:49:37.554615 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-cf49b4ee-886d-49fc-aeaf-440e8b7e8ed1 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:49:37.556185 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-cf49b4ee-886d-49fc-aeaf-440e8b7e8ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:49:37.667338 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 658/1313] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:49:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 17:49:37.705879 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba48789-288d-45f1-8de1-3d7d6f50bed5 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:49:37.707471 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-aba48789-288d-45f1-8de1-3d7d6f50bed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:49:37.818452 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba48789-288d-45f1-8de1-3d7d6f50bed5 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:49:37.898613 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:49:37.916860 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa17029-a372-4990-a772-ed4e0ed99529 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5652329c71cd431fb579d69cef933b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:49:37.916860 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa17029-a372-4990-a772-ed4e0ed99529 service neutron] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:49:37.916860 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa17029-a372-4990-a772-ed4e0ed99529 service neutron] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:49:37.916860 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa17029-a372-4990-a772-ed4e0ed99529 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:49:37.917162 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-0fa17029-a372-4990-a772-ed4e0ed99529 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:49:38.036325 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa17029-a372-4990-a772-ed4e0ed99529 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:49:38.037783 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa17029-a372-4990-a772-ed4e0ed99529 service neutron] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:49:38.057383 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 656/1314] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:49:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:49:40.820128 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5e127a-a4f7-40ff-af14-842a49c9ebad None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:49:40.820702 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5e127a-a4f7-40ff-af14-842a49c9ebad None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:49:40.820702 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5e127a-a4f7-40ff-af14-842a49c9ebad None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:49:40.822051 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 659/1315] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:49:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:49:40.827329 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f10e6b-3f0e-4d8a-be3e-860dc454da5c None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:49:40.827847 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f10e6b-3f0e-4d8a-be3e-860dc454da5c None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:49:40.828153 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f10e6b-3f0e-4d8a-be3e-860dc454da5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:49:40.893373 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-69f10e6b-3f0e-4d8a-be3e-860dc454da5c None None] MFA Rules not processed for user `48d36fad27cf4eff8510c2ec4719697c`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:49:40.894651 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-69f10e6b-3f0e-4d8a-be3e-860dc454da5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:49:40.948534 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:49:40.993760 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 657/1316] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:49:40 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:49:41.034981 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5e127a-a4f7-40ff-af14-842a49c9ebad None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:49:41.036632 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-dd5e127a-a4f7-40ff-af14-842a49c9ebad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:49:41.047119 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:49:41.142867 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5e127a-a4f7-40ff-af14-842a49c9ebad None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:49:41.215887 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852f467a-9bd8-4400-a129-63a71921f09b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5652329c71cd431fb579d69cef933b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:49:41.216541 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852f467a-9bd8-4400-a129-63a71921f09b service neutron] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:49:41.216830 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852f467a-9bd8-4400-a129-63a71921f09b service neutron] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:49:41.217110 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852f467a-9bd8-4400-a129-63a71921f09b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:49:41.219558 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-852f467a-9bd8-4400-a129-63a71921f09b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:49:41.290221 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:49:41.339068 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852f467a-9bd8-4400-a129-63a71921f09b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:49:41.340635 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852f467a-9bd8-4400-a129-63a71921f09b service neutron] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:49:41.359224 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 660/1317] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:49:41 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:49:44.695169 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c120e4b9-0580-4cf7-9cc4-f93a53fd417a None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:49:44.695783 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c120e4b9-0580-4cf7-9cc4-f93a53fd417a None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:49:44.695783 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c120e4b9-0580-4cf7-9cc4-f93a53fd417a None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:49:44.697125 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 658/1318] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:49:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:49:44.702318 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9387a9-8fa4-4eb3-ba80-72bbff766d5f None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:49:44.702755 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9387a9-8fa4-4eb3-ba80-72bbff766d5f None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:49:44.702986 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9387a9-8fa4-4eb3-ba80-72bbff766d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:49:44.770849 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-2c9387a9-8fa4-4eb3-ba80-72bbff766d5f None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:49:44.772123 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-2c9387a9-8fa4-4eb3-ba80-72bbff766d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:49:44.870689 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 661/1319] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:49:44 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:49:44.924758 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ccb8d8-0330-45a8-a0a7-4283cf4d4230 None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:49:44.925044 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ccb8d8-0330-45a8-a0a7-4283cf4d4230 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:49:44.925325 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ccb8d8-0330-45a8-a0a7-4283cf4d4230 None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:49:44.926719 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 659/1320] 10.222.0.36 () {54 vars in 964 bytes} [Tue Jun 14 17:49:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:49:44.932797 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b0be9d-5810-4897-886a-4dfd9e792f0e None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:49:44.933084 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b0be9d-5810-4897-886a-4dfd9e792f0e None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:49:44.937649 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b0be9d-5810-4897-886a-4dfd9e792f0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:49:44.954230 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:49:45.009841 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-e8b0be9d-5810-4897-886a-4dfd9e792f0e None None] MFA Rules not processed for user `5652329c71cd431fb579d69cef933b37`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:49:45.011039 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-e8b0be9d-5810-4897-886a-4dfd9e792f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:49:45.086355 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 662/1321] 10.222.0.36 () {58 vars in 1061 bytes} [Tue Jun 14 17:49:44 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:49:45.096289 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ccb8d8-0330-45a8-a0a7-4283cf4d4230 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:49:45.097833 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-62ccb8d8-0330-45a8-a0a7-4283cf4d4230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:49:45.201113 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ccb8d8-0330-45a8-a0a7-4283cf4d4230 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:49:45.277143 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a28858f-6805-4186-8f8d-9387db5ad0ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5652329c71cd431fb579d69cef933b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:49:45.277728 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a28858f-6805-4186-8f8d-9387db5ad0ac service neutron] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:49:45.278018 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a28858f-6805-4186-8f8d-9387db5ad0ac service neutron] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:49:45.278299 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a28858f-6805-4186-8f8d-9387db5ad0ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:49:45.280025 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-9a28858f-6805-4186-8f8d-9387db5ad0ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:49:45.288504 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:49:45.393128 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a28858f-6805-4186-8f8d-9387db5ad0ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:49:45.394564 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a28858f-6805-4186-8f8d-9387db5ad0ac service neutron] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:49:45.413268 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 660/1322] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:49:45 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:49:49.221182 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c078a8d0-3e06-4822-a61a-260202093580 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:49:49.221726 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c078a8d0-3e06-4822-a61a-260202093580 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:49:49.221843 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c078a8d0-3e06-4822-a61a-260202093580 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:49:49.223147 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 663/1323] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:49:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:49:49.228551 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fab355e-0867-4a37-af1c-5584cdd834a4 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:49:49.229017 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fab355e-0867-4a37-af1c-5584cdd834a4 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:49:49.229114 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fab355e-0867-4a37-af1c-5584cdd834a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:49:49.296365 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-8fab355e-0867-4a37-af1c-5584cdd834a4 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:49:49.297658 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-8fab355e-0867-4a37-af1c-5584cdd834a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:49:49.357797 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:49:49.398423 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 661/1324] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:49:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:49:49.435495 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c078a8d0-3e06-4822-a61a-260202093580 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:49:49.437183 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-c078a8d0-3e06-4822-a61a-260202093580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:49:49.555498 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c078a8d0-3e06-4822-a61a-260202093580 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:49:49.568561 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:49:49.635702 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335c9dd1-8c5c-4a50-b200-7aa346707c5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5652329c71cd431fb579d69cef933b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:49:49.636357 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335c9dd1-8c5c-4a50-b200-7aa346707c5c service neutron] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:49:49.636647 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335c9dd1-8c5c-4a50-b200-7aa346707c5c service neutron] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:49:49.636931 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335c9dd1-8c5c-4a50-b200-7aa346707c5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:49:49.638850 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-335c9dd1-8c5c-4a50-b200-7aa346707c5c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:49:49.753490 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335c9dd1-8c5c-4a50-b200-7aa346707c5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:49:49.754925 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335c9dd1-8c5c-4a50-b200-7aa346707c5c service neutron] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:49:49.773392 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 664/1325] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:49:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 17:49:52.012615 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a50808-ce8f-4b56-a99f-38233c88f6f0 None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:49:52.013433 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a50808-ce8f-4b56-a99f-38233c88f6f0 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:49:52.013433 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a50808-ce8f-4b56-a99f-38233c88f6f0 None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:49:52.016153 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 662/1326] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:49:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:49:52.021595 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95093fc2-0d2c-4dc8-be78-bb6fa1b64d7a None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:49:52.022034 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95093fc2-0d2c-4dc8-be78-bb6fa1b64d7a None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:49:52.022226 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95093fc2-0d2c-4dc8-be78-bb6fa1b64d7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:49:52.073317 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:49:52.093722 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-95093fc2-0d2c-4dc8-be78-bb6fa1b64d7a None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:49:52.094929 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-95093fc2-0d2c-4dc8-be78-bb6fa1b64d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:49:52.196938 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 665/1327] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:49:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:49:52.235004 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a50808-ce8f-4b56-a99f-38233c88f6f0 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:49:52.236595 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-53a50808-ce8f-4b56-a99f-38233c88f6f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:49:52.346479 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a50808-ce8f-4b56-a99f-38233c88f6f0 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:49:52.423680 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e982fd-5aa5-47df-aaca-2ddb43565270 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5652329c71cd431fb579d69cef933b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:49:52.428863 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e982fd-5aa5-47df-aaca-2ddb43565270 service neutron] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:49:52.428863 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e982fd-5aa5-47df-aaca-2ddb43565270 service neutron] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:49:52.428863 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e982fd-5aa5-47df-aaca-2ddb43565270 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:49:52.428863 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-98e982fd-5aa5-47df-aaca-2ddb43565270 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:49:52.444449 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:49:52.548017 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e982fd-5aa5-47df-aaca-2ddb43565270 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:49:52.549614 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e982fd-5aa5-47df-aaca-2ddb43565270 service neutron] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:49:52.568680 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 663/1328] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:49:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:49:54.810496 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bcf955-8339-4c56-9845-d0c30cb8b300 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:49:54.811056 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bcf955-8339-4c56-9845-d0c30cb8b300 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:49:54.811056 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bcf955-8339-4c56-9845-d0c30cb8b300 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:49:54.812966 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 666/1329] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:49:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:49:54.818263 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7158d0-4670-431f-b500-8bddce1712a9 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:49:54.818694 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7158d0-4670-431f-b500-8bddce1712a9 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:49:54.818959 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7158d0-4670-431f-b500-8bddce1712a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:49:54.895228 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-1d7158d0-4670-431f-b500-8bddce1712a9 None None] MFA Rules not processed for user `48d36fad27cf4eff8510c2ec4719697c`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:49:54.896522 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-1d7158d0-4670-431f-b500-8bddce1712a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:49:54.971014 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:49:55.003328 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 664/1330] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:49:54 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:49:55.041484 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bcf955-8339-4c56-9845-d0c30cb8b300 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:49:55.043025 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-e3bcf955-8339-4c56-9845-d0c30cb8b300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:49:55.150361 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bcf955-8339-4c56-9845-d0c30cb8b300 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:49:55.170998 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:49:55.226126 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5896f3-c06f-45f3-b5b0-486883b6cf06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5652329c71cd431fb579d69cef933b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:49:55.226779 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5896f3-c06f-45f3-b5b0-486883b6cf06 service neutron] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:49:55.227065 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5896f3-c06f-45f3-b5b0-486883b6cf06 service neutron] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:49:55.227381 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5896f3-c06f-45f3-b5b0-486883b6cf06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:49:55.229043 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-2e5896f3-c06f-45f3-b5b0-486883b6cf06 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:49:55.376385 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5896f3-c06f-45f3-b5b0-486883b6cf06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:49:55.377757 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5896f3-c06f-45f3-b5b0-486883b6cf06 service neutron] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:49:55.399628 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 667/1331] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:49:55 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:49:58.200060 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25604a50-a708-475d-b1f7-6863bdb31551 None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:49:58.200639 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25604a50-a708-475d-b1f7-6863bdb31551 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:49:58.200639 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25604a50-a708-475d-b1f7-6863bdb31551 None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:49:58.203055 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 665/1332] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:49:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:49:58.208302 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f017a94c-799e-4669-b7d1-fccd7a0472b7 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:49:58.208780 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f017a94c-799e-4669-b7d1-fccd7a0472b7 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:49:58.208896 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f017a94c-799e-4669-b7d1-fccd7a0472b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:49:58.271545 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:49:58.274302 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-f017a94c-799e-4669-b7d1-fccd7a0472b7 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:49:58.275649 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-f017a94c-799e-4669-b7d1-fccd7a0472b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:49:58.375371 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 668/1333] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:49:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:49:58.412617 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25604a50-a708-475d-b1f7-6863bdb31551 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:49:58.414168 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-25604a50-a708-475d-b1f7-6863bdb31551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:49:58.518647 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25604a50-a708-475d-b1f7-6863bdb31551 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:49:58.590806 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a471f7be-4427-47d1-bf37-9ce733b0c046 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5652329c71cd431fb579d69cef933b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:49:58.591483 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a471f7be-4427-47d1-bf37-9ce733b0c046 service neutron] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:49:58.591772 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a471f7be-4427-47d1-bf37-9ce733b0c046 service neutron] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:49:58.592050 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a471f7be-4427-47d1-bf37-9ce733b0c046 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:49:58.594204 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-a471f7be-4427-47d1-bf37-9ce733b0c046 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:49:58.621232 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:49:58.702783 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a471f7be-4427-47d1-bf37-9ce733b0c046 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:49:58.704254 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a471f7be-4427-47d1-bf37-9ce733b0c046 service neutron] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:49:58.722647 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 666/1334] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:49:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:50:00.943388 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9059ce1a-df0a-452c-b05c-d3c2f7e79081 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:50:00.943980 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9059ce1a-df0a-452c-b05c-d3c2f7e79081 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:50:00.943980 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9059ce1a-df0a-452c-b05c-d3c2f7e79081 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:50:00.945275 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 669/1335] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:50:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:50:00.950313 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a006ef27-cd26-4100-8787-ae7dd7836aa3 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:50:00.950763 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a006ef27-cd26-4100-8787-ae7dd7836aa3 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:50:00.950898 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a006ef27-cd26-4100-8787-ae7dd7836aa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:50:01.020339 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-a006ef27-cd26-4100-8787-ae7dd7836aa3 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:50:01.021613 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-a006ef27-cd26-4100-8787-ae7dd7836aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:50:01.100242 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:50:01.124221 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 667/1336] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:50:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:50:01.164268 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9059ce1a-df0a-452c-b05c-d3c2f7e79081 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:50:01.165797 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-9059ce1a-df0a-452c-b05c-d3c2f7e79081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:50:01.271078 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9059ce1a-df0a-452c-b05c-d3c2f7e79081 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:50:01.299487 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:50:01.345886 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23669870-56e2-474d-8edd-72dc11379db9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5652329c71cd431fb579d69cef933b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:50:01.346542 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23669870-56e2-474d-8edd-72dc11379db9 service neutron] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:50:01.346828 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23669870-56e2-474d-8edd-72dc11379db9 service neutron] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:50:01.347111 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23669870-56e2-474d-8edd-72dc11379db9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:50:01.348826 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-23669870-56e2-474d-8edd-72dc11379db9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:50:01.458172 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23669870-56e2-474d-8edd-72dc11379db9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:50:01.459659 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23669870-56e2-474d-8edd-72dc11379db9 service neutron] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:50:01.478817 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 670/1337] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:50:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 17:50:04.575805 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642096c9-612f-4df8-ad4c-df3b90bcb348 None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:50:04.576426 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642096c9-612f-4df8-ad4c-df3b90bcb348 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:50:04.576426 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642096c9-612f-4df8-ad4c-df3b90bcb348 None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:50:04.577819 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 668/1338] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:50:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:50:04.582981 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe7a511-ea0d-47eb-985d-ebf96d37dacd None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:50:04.583492 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe7a511-ea0d-47eb-985d-ebf96d37dacd None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:50:04.583623 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe7a511-ea0d-47eb-985d-ebf96d37dacd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:50:04.652955 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-cbe7a511-ea0d-47eb-985d-ebf96d37dacd None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:50:04.664301 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-cbe7a511-ea0d-47eb-985d-ebf96d37dacd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:50:04.664301 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:50:04.757668 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 671/1339] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:50:04 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:50:04.793933 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642096c9-612f-4df8-ad4c-df3b90bcb348 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:50:04.796988 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-642096c9-612f-4df8-ad4c-df3b90bcb348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:50:04.892519 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642096c9-612f-4df8-ad4c-df3b90bcb348 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:50:04.896070 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acfe0bd-72bb-4f4f-878f-cde42a702d95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5652329c71cd431fb579d69cef933b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:50:04.896723 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acfe0bd-72bb-4f4f-878f-cde42a702d95 service neutron] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:50:04.897017 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acfe0bd-72bb-4f4f-878f-cde42a702d95 service neutron] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:50:04.897297 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acfe0bd-72bb-4f4f-878f-cde42a702d95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:50:04.907652 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acfe0bd-72bb-4f4f-878f-cde42a702d95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:50:04.909094 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acfe0bd-72bb-4f4f-878f-cde42a702d95 service neutron] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:50:04.918660 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 669/1340] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:50:04 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:50:09.496004 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e84ca2-43a1-4a68-9b86-33d886eb54e9 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:50:09.496558 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e84ca2-43a1-4a68-9b86-33d886eb54e9 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:50:09.496558 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e84ca2-43a1-4a68-9b86-33d886eb54e9 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:50:09.499724 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 672/1341] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:50:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:50:09.504187 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a30c21-22d5-4719-b02b-414fb5a8f3ae None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:50:09.505058 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a30c21-22d5-4719-b02b-414fb5a8f3ae None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:50:09.505349 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a30c21-22d5-4719-b02b-414fb5a8f3ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:50:09.536373 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-87a30c21-22d5-4719-b02b-414fb5a8f3ae None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:50:09.537569 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-87a30c21-22d5-4719-b02b-414fb5a8f3ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:50:09.627155 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 670/1342] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:50:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 17:50:09.665908 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e84ca2-43a1-4a68-9b86-33d886eb54e9 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:50:09.683005 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e84ca2-43a1-4a68-9b86-33d886eb54e9 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:50:09.683005 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b34836-f325-4ed2-a0ee-fac10490f22b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5652329c71cd431fb579d69cef933b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:50:09.683456 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b34836-f325-4ed2-a0ee-fac10490f22b service neutron] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:50:09.683749 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b34836-f325-4ed2-a0ee-fac10490f22b service neutron] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:50:09.684069 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b34836-f325-4ed2-a0ee-fac10490f22b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:50:09.694630 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b34836-f325-4ed2-a0ee-fac10490f22b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:50:09.696096 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b34836-f325-4ed2-a0ee-fac10490f22b service neutron] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:50:09.706091 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 673/1343] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:50:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:50:13.173477 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572368a0-8c5f-4178-afd9-a6b62780cd1f None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:50:13.174134 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572368a0-8c5f-4178-afd9-a6b62780cd1f None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:50:13.174134 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572368a0-8c5f-4178-afd9-a6b62780cd1f None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:50:13.175563 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 671/1344] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:50:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:50:13.181461 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ecff5b-7c28-4204-b6a4-2298a747a44f None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:50:13.182028 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ecff5b-7c28-4204-b6a4-2298a747a44f None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:50:13.182028 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ecff5b-7c28-4204-b6a4-2298a747a44f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:50:13.202663 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-a6ecff5b-7c28-4204-b6a4-2298a747a44f None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:50:13.203996 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-a6ecff5b-7c28-4204-b6a4-2298a747a44f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:50:13.212259 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 674/1345] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:50:13 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:50:13.251125 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572368a0-8c5f-4178-afd9-a6b62780cd1f None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:50:13.252915 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-572368a0-8c5f-4178-afd9-a6b62780cd1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:50:13.268902 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572368a0-8c5f-4178-afd9-a6b62780cd1f None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:50:13.273753 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253306a8-4973-4b6d-8c99-c46bfaea8be4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5652329c71cd431fb579d69cef933b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:50:13.274891 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253306a8-4973-4b6d-8c99-c46bfaea8be4 service neutron] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:50:13.275423 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253306a8-4973-4b6d-8c99-c46bfaea8be4 service neutron] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:50:13.275924 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253306a8-4973-4b6d-8c99-c46bfaea8be4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:50:13.287818 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253306a8-4973-4b6d-8c99-c46bfaea8be4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:50:13.289334 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253306a8-4973-4b6d-8c99-c46bfaea8be4 service neutron] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:50:13.302278 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 672/1346] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:50:13 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:50:18.218699 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39166b20-3c71-46b0-be60-6faed51ce12d None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:50:18.219156 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39166b20-3c71-46b0-be60-6faed51ce12d None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:50:18.219278 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39166b20-3c71-46b0-be60-6faed51ce12d None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:50:18.221004 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 675/1347] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:50:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:50:18.226670 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ddfa02-ee32-4c7a-8766-5cf5dabe3e06 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:50:18.227211 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ddfa02-ee32-4c7a-8766-5cf5dabe3e06 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:50:18.227211 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ddfa02-ee32-4c7a-8766-5cf5dabe3e06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:50:18.246520 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-53ddfa02-ee32-4c7a-8766-5cf5dabe3e06 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:50:18.247818 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-53ddfa02-ee32-4c7a-8766-5cf5dabe3e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:50:18.256137 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 673/1348] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:50:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:50:18.296144 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39166b20-3c71-46b0-be60-6faed51ce12d None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:50:18.307765 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39166b20-3c71-46b0-be60-6faed51ce12d None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:50:18.312007 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bbd93b-b553-4643-bf80-eadff042f243 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5652329c71cd431fb579d69cef933b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:50:18.312738 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bbd93b-b553-4643-bf80-eadff042f243 service neutron] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:50:18.313028 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bbd93b-b553-4643-bf80-eadff042f243 service neutron] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:50:18.317164 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bbd93b-b553-4643-bf80-eadff042f243 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:50:18.325290 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bbd93b-b553-4643-bf80-eadff042f243 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:50:18.328311 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bbd93b-b553-4643-bf80-eadff042f243 service neutron] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:50:18.344956 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 676/1349] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:50:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:50:23.712729 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f146dee-d51d-471f-853b-ab1dbd6be620 None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:50:23.713285 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f146dee-d51d-471f-853b-ab1dbd6be620 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:50:23.713285 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f146dee-d51d-471f-853b-ab1dbd6be620 None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:50:23.714645 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 674/1350] 10.222.0.36 () {54 vars in 921 bytes} [Tue Jun 14 17:50:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:50:23.721076 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df76256-db52-4a22-a258-3d5941c90abc None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:50:23.721655 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df76256-db52-4a22-a258-3d5941c90abc None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:50:23.721655 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df76256-db52-4a22-a258-3d5941c90abc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:50:23.812975 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-0df76256-db52-4a22-a258-3d5941c90abc None None] MFA Rules not processed for user `6a8049f9c66b4b5185c26084fd8239ab`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:50:23.814201 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-0df76256-db52-4a22-a258-3d5941c90abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:50:23.882250 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:50:23.927602 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 677/1351] 10.222.0.36 () {58 vars in 1018 bytes} [Tue Jun 14 17:50:23 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:50:28.240655 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=98 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:50:28.305194 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fe731d-41a7-41b2-8d63-5d8862f8c6a7 None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:50:28.305681 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fe731d-41a7-41b2-8d63-5d8862f8c6a7 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:50:28.306028 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fe731d-41a7-41b2-8d63-5d8862f8c6a7 None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:50:28.307858 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 675/1352] 10.222.0.36 () {54 vars in 921 bytes} [Tue Jun 14 17:50:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:50:28.314186 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdf6cd5-4c09-4949-966a-d89eed6de323 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:50:28.314706 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdf6cd5-4c09-4949-966a-d89eed6de323 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:50:28.315102 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdf6cd5-4c09-4949-966a-d89eed6de323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:50:28.351874 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-9fdf6cd5-4c09-4949-966a-d89eed6de323 None None] MFA Rules not processed for user `6a8049f9c66b4b5185c26084fd8239ab`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:50:28.353137 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-9fdf6cd5-4c09-4949-966a-d89eed6de323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:50:28.364882 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 678/1353] 10.222.0.36 () {58 vars in 1018 bytes} [Tue Jun 14 17:50:28 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 17:50:30.034755 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5e8049-cbcc-49e0-be0d-3281e6adf32a None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:50:30.035914 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5e8049-cbcc-49e0-be0d-3281e6adf32a None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:50:30.035914 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5e8049-cbcc-49e0-be0d-3281e6adf32a None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:50:30.037792 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 676/1354] 10.222.0.36 () {54 vars in 921 bytes} [Tue Jun 14 17:50:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:50:30.043348 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b13f1f-b80e-4d61-94fd-857fa9d441b2 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:50:30.044067 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b13f1f-b80e-4d61-94fd-857fa9d441b2 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:50:30.044067 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b13f1f-b80e-4d61-94fd-857fa9d441b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:50:30.063650 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-15b13f1f-b80e-4d61-94fd-857fa9d441b2 None None] MFA Rules not processed for user `6a8049f9c66b4b5185c26084fd8239ab`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:50:30.064845 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-15b13f1f-b80e-4d61-94fd-857fa9d441b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:50:30.073876 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 679/1355] 10.222.0.36 () {58 vars in 1018 bytes} [Tue Jun 14 17:50:30 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:50:34.051528 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc1c498-5878-42bd-8f3f-f927c5daefe2 None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:50:34.052391 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc1c498-5878-42bd-8f3f-f927c5daefe2 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:50:34.052828 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc1c498-5878-42bd-8f3f-f927c5daefe2 None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:50:34.058559 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 677/1356] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:50:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:50:34.061042 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca78383d-e160-405c-836b-45e834f2dbf9 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:50:34.061952 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca78383d-e160-405c-836b-45e834f2dbf9 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:50:34.062242 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca78383d-e160-405c-836b-45e834f2dbf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:50:34.083879 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-ca78383d-e160-405c-836b-45e834f2dbf9 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:50:34.085346 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-ca78383d-e160-405c-836b-45e834f2dbf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:50:34.095918 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 680/1357] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:50:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:50:34.154750 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d65471e-2c36-46ee-824d-7e0edddedacd None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:50:34.155156 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d65471e-2c36-46ee-824d-7e0edddedacd None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:50:34.155713 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d65471e-2c36-46ee-824d-7e0edddedacd None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:50:34.157651 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 678/1358] 10.222.0.36 () {54 vars in 961 bytes} [Tue Jun 14 17:50:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:50:34.168089 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddec037-bc02-4cf0-99c0-0d64a97084fd None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:50:34.168908 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddec037-bc02-4cf0-99c0-0d64a97084fd None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:50:34.169760 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddec037-bc02-4cf0-99c0-0d64a97084fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:50:34.236701 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-8ddec037-bc02-4cf0-99c0-0d64a97084fd None None] MFA Rules not processed for user `e4696d396adb495ab300a9a5a5727595`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:50:34.238397 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-8ddec037-bc02-4cf0-99c0-0d64a97084fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:50:34.388605 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 681/1359] 10.222.0.36 () {58 vars in 1058 bytes} [Tue Jun 14 17:50:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:50:34.402668 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d65471e-2c36-46ee-824d-7e0edddedacd None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:50:34.422462 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d65471e-2c36-46ee-824d-7e0edddedacd None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:50:34.430729 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357d09d3-b9de-4254-9448-f79bf8ce69a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4696d396adb495ab300a9a5a5727595', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:50:34.431616 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357d09d3-b9de-4254-9448-f79bf8ce69a1 service nova] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:50:34.432104 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357d09d3-b9de-4254-9448-f79bf8ce69a1 service nova] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:50:34.432386 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357d09d3-b9de-4254-9448-f79bf8ce69a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:50:34.444460 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357d09d3-b9de-4254-9448-f79bf8ce69a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:50:34.446656 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357d09d3-b9de-4254-9448-f79bf8ce69a1 service nova] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:50:34.458808 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 679/1360] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:50:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 17:50:36.881354 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce27a322-33e1-49df-bb1c-f1f22a274fde None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:50:36.881906 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce27a322-33e1-49df-bb1c-f1f22a274fde None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:50:36.881906 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce27a322-33e1-49df-bb1c-f1f22a274fde None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:50:36.883465 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 682/1361] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:50:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:50:36.889710 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f4e164-694a-407e-be90-82c2ed4b6c64 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:50:36.890551 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f4e164-694a-407e-be90-82c2ed4b6c64 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:50:36.890997 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f4e164-694a-407e-be90-82c2ed4b6c64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:50:36.910869 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-c6f4e164-694a-407e-be90-82c2ed4b6c64 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:50:36.912120 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-c6f4e164-694a-407e-be90-82c2ed4b6c64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:50:36.923668 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 680/1362] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:50:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:50:36.967110 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce27a322-33e1-49df-bb1c-f1f22a274fde None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:50:36.983686 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce27a322-33e1-49df-bb1c-f1f22a274fde None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:50:36.990030 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be00f5d-e41f-404d-85f7-e1e35838b2e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4696d396adb495ab300a9a5a5727595', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:50:36.990733 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be00f5d-e41f-404d-85f7-e1e35838b2e8 service nova] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:50:36.991032 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be00f5d-e41f-404d-85f7-e1e35838b2e8 service nova] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:50:36.991343 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be00f5d-e41f-404d-85f7-e1e35838b2e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:50:37.001549 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be00f5d-e41f-404d-85f7-e1e35838b2e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:50:37.003144 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be00f5d-e41f-404d-85f7-e1e35838b2e8 service nova] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:50:37.015892 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 683/1363] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:50:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:50:39.659487 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3198acbc-e019-4a33-a35f-589c34cda3a7 None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:50:39.660044 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3198acbc-e019-4a33-a35f-589c34cda3a7 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:50:39.660044 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3198acbc-e019-4a33-a35f-589c34cda3a7 None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:50:39.661436 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 681/1364] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:50:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:50:39.666737 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa718b4-257e-4477-b1a2-a19266891ff9 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:50:39.667158 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa718b4-257e-4477-b1a2-a19266891ff9 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:50:39.667310 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa718b4-257e-4477-b1a2-a19266891ff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:50:39.686983 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-0aa718b4-257e-4477-b1a2-a19266891ff9 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:50:39.688363 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-0aa718b4-257e-4477-b1a2-a19266891ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:50:39.696847 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 684/1365] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:50:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:50:39.746644 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23d85ed-ecc3-467c-a9eb-75f6b64b303b None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:50:39.748365 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23d85ed-ecc3-467c-a9eb-75f6b64b303b None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:50:39.748894 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23d85ed-ecc3-467c-a9eb-75f6b64b303b None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:50:39.751015 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 682/1366] 10.222.0.36 () {54 vars in 961 bytes} [Tue Jun 14 17:50:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:50:39.758951 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45b977e-8f1a-4d3d-a8b6-a87536d0706b None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:50:39.759423 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45b977e-8f1a-4d3d-a8b6-a87536d0706b None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:50:39.764689 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45b977e-8f1a-4d3d-a8b6-a87536d0706b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:50:39.797737 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-c45b977e-8f1a-4d3d-a8b6-a87536d0706b None None] MFA Rules not processed for user `e4696d396adb495ab300a9a5a5727595`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:50:39.799171 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-c45b977e-8f1a-4d3d-a8b6-a87536d0706b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:50:39.810342 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 685/1367] 10.222.0.36 () {58 vars in 1058 bytes} [Tue Jun 14 17:50:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:50:39.820356 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23d85ed-ecc3-467c-a9eb-75f6b64b303b None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:50:39.835890 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23d85ed-ecc3-467c-a9eb-75f6b64b303b None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:50:39.841604 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc8d376-1d6e-4345-848e-bd8b468d58dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4696d396adb495ab300a9a5a5727595', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:50:39.842414 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc8d376-1d6e-4345-848e-bd8b468d58dd service nova] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:50:39.842697 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc8d376-1d6e-4345-848e-bd8b468d58dd service nova] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:50:39.842973 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc8d376-1d6e-4345-848e-bd8b468d58dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:50:39.851931 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc8d376-1d6e-4345-848e-bd8b468d58dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:50:39.853897 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc8d376-1d6e-4345-848e-bd8b468d58dd service nova] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:50:39.864684 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 683/1368] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:50:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:50:42.376206 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6e362e-a90e-4aea-aaf2-1c71d66e77c3 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:50:42.376856 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6e362e-a90e-4aea-aaf2-1c71d66e77c3 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:50:42.377189 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6e362e-a90e-4aea-aaf2-1c71d66e77c3 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:50:42.378753 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 686/1369] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:50:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:50:42.384775 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac787f85-fcba-4477-bbe1-8659ddb614d4 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:50:42.385535 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac787f85-fcba-4477-bbe1-8659ddb614d4 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:50:42.385535 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac787f85-fcba-4477-bbe1-8659ddb614d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:50:42.405562 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-ac787f85-fcba-4477-bbe1-8659ddb614d4 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:50:42.406791 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-ac787f85-fcba-4477-bbe1-8659ddb614d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:50:42.415436 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 684/1370] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:50:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 17:50:42.460675 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6e362e-a90e-4aea-aaf2-1c71d66e77c3 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:50:42.477589 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6e362e-a90e-4aea-aaf2-1c71d66e77c3 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:50:42.484113 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d918c305-2d48-444b-99f1-93de15fb463e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4696d396adb495ab300a9a5a5727595', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:50:42.484775 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d918c305-2d48-444b-99f1-93de15fb463e service nova] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:50:42.485061 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d918c305-2d48-444b-99f1-93de15fb463e service nova] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:50:42.485340 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d918c305-2d48-444b-99f1-93de15fb463e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:50:42.495329 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d918c305-2d48-444b-99f1-93de15fb463e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:50:42.497652 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d918c305-2d48-444b-99f1-93de15fb463e service nova] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:50:42.509085 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 687/1371] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:50:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:50:42.728068 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba4ab4-fe09-4c2b-bdb7-0ab73ff47c57 None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:50:42.728433 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba4ab4-fe09-4c2b-bdb7-0ab73ff47c57 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:50:42.728824 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba4ab4-fe09-4c2b-bdb7-0ab73ff47c57 None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:50:42.730202 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 685/1372] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:50:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:50:42.743790 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc74419-f3a6-484f-a74f-94b93327f1f8 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:50:42.743790 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc74419-f3a6-484f-a74f-94b93327f1f8 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:50:42.743790 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc74419-f3a6-484f-a74f-94b93327f1f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:50:42.757744 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-4fc74419-f3a6-484f-a74f-94b93327f1f8 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:50:42.759003 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-4fc74419-f3a6-484f-a74f-94b93327f1f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:50:42.775581 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 688/1373] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:50:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:50:43.117441 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e75090-039a-476c-887d-7076514d08ad None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:50:43.117842 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e75090-039a-476c-887d-7076514d08ad None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:50:43.118224 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e75090-039a-476c-887d-7076514d08ad None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:50:43.120005 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 686/1374] 10.222.0.36 () {54 vars in 963 bytes} [Tue Jun 14 17:50:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 14 17:50:43.125792 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e00990-ffeb-4ea1-93b8-fd33d714ac34 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:50:43.126080 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e00990-ffeb-4ea1-93b8-fd33d714ac34 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:50:43.126368 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e00990-ffeb-4ea1-93b8-fd33d714ac34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:50:43.180012 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-67e00990-ffeb-4ea1-93b8-fd33d714ac34 None None] MFA Rules not processed for user `17945e7d72954b8787e0ba09a9903247`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:50:43.181358 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-67e00990-ffeb-4ea1-93b8-fd33d714ac34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:50:43.186804 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:50:43.249710 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 689/1375] 10.222.0.36 () {58 vars in 1060 bytes} [Tue Jun 14 17:50:43 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:50:43.258160 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e75090-039a-476c-887d-7076514d08ad None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:50:43.270723 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e75090-039a-476c-887d-7076514d08ad None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:50:43.275362 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac6d34e-8a9c-4009-8d1f-7db995dc8306 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17945e7d72954b8787e0ba09a9903247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:50:43.276052 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac6d34e-8a9c-4009-8d1f-7db995dc8306 service cinder] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:50:43.276480 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac6d34e-8a9c-4009-8d1f-7db995dc8306 service cinder] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:50:43.276957 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac6d34e-8a9c-4009-8d1f-7db995dc8306 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:50:43.288252 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac6d34e-8a9c-4009-8d1f-7db995dc8306 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:50:43.298321 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac6d34e-8a9c-4009-8d1f-7db995dc8306 service cinder] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:50:43.300859 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 687/1376] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:50:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:50:45.023140 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd42450-19ce-4199-abd2-2913f2f67e2f None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:50:45.025822 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd42450-19ce-4199-abd2-2913f2f67e2f None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:50:45.025822 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd42450-19ce-4199-abd2-2913f2f67e2f None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:50:45.026239 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 690/1377] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:50:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 14 17:50:45.032618 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae44e2e1-df42-4d76-bc76-7174a5ad68d9 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:50:45.033218 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae44e2e1-df42-4d76-bc76-7174a5ad68d9 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:50:45.033218 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae44e2e1-df42-4d76-bc76-7174a5ad68d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:50:45.057647 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-ae44e2e1-df42-4d76-bc76-7174a5ad68d9 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:50:45.058947 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-ae44e2e1-df42-4d76-bc76-7174a5ad68d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:50:45.067836 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 688/1378] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:50:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:50:45.121956 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd42450-19ce-4199-abd2-2913f2f67e2f None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:50:45.137466 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd42450-19ce-4199-abd2-2913f2f67e2f None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:50:45.144042 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8880e633-6103-418f-9f51-92c9dc97b0e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4696d396adb495ab300a9a5a5727595', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:50:45.144733 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8880e633-6103-418f-9f51-92c9dc97b0e6 service nova] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:50:45.145021 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8880e633-6103-418f-9f51-92c9dc97b0e6 service nova] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:50:45.145351 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8880e633-6103-418f-9f51-92c9dc97b0e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:50:45.155748 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8880e633-6103-418f-9f51-92c9dc97b0e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:50:45.157305 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8880e633-6103-418f-9f51-92c9dc97b0e6 service nova] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:50:45.168523 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 691/1379] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:50:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 17:50:47.609676 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513aca62-b3e5-417b-abce-b18789db0494 None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:50:47.610470 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513aca62-b3e5-417b-abce-b18789db0494 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:50:47.610470 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513aca62-b3e5-417b-abce-b18789db0494 None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:50:47.612490 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 689/1380] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:50:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 14 17:50:47.621546 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1f5141-3089-416d-8c4c-8bee3c51df98 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:50:47.623165 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1f5141-3089-416d-8c4c-8bee3c51df98 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:50:47.623955 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1f5141-3089-416d-8c4c-8bee3c51df98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:50:47.653016 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-df1f5141-3089-416d-8c4c-8bee3c51df98 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:50:47.654633 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-df1f5141-3089-416d-8c4c-8bee3c51df98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:50:47.664496 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 692/1381] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:50:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:50:47.719454 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513aca62-b3e5-417b-abce-b18789db0494 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:50:47.734931 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513aca62-b3e5-417b-abce-b18789db0494 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:50:47.740542 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5afe0c1-6473-4bc6-9359-10d60c259a2b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4696d396adb495ab300a9a5a5727595', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:50:47.741186 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5afe0c1-6473-4bc6-9359-10d60c259a2b service nova] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:50:47.741470 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5afe0c1-6473-4bc6-9359-10d60c259a2b service nova] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:50:47.741934 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5afe0c1-6473-4bc6-9359-10d60c259a2b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:50:47.752019 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5afe0c1-6473-4bc6-9359-10d60c259a2b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:50:47.753618 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5afe0c1-6473-4bc6-9359-10d60c259a2b service nova] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:50:47.764519 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 690/1382] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:50:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 17:50:50.159610 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc260961-d29b-4342-b210-7093640b8e01 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:50:50.160148 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc260961-d29b-4342-b210-7093640b8e01 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:50:50.160148 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc260961-d29b-4342-b210-7093640b8e01 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:50:50.161719 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 693/1383] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:50:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:50:50.167167 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e79641-4fc2-4199-a574-478092cfb4c1 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:50:50.168028 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e79641-4fc2-4199-a574-478092cfb4c1 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:50:50.168314 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e79641-4fc2-4199-a574-478092cfb4c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:50:50.187959 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-48e79641-4fc2-4199-a574-478092cfb4c1 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:50:50.189172 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-48e79641-4fc2-4199-a574-478092cfb4c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:50:50.197535 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 691/1384] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:50:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:50:50.266020 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc260961-d29b-4342-b210-7093640b8e01 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:50:50.284740 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc260961-d29b-4342-b210-7093640b8e01 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:50:50.290639 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1a969c-e17d-496b-83e0-b2c5f124721b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4696d396adb495ab300a9a5a5727595', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:50:50.300153 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1a969c-e17d-496b-83e0-b2c5f124721b service nova] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:50:50.300153 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1a969c-e17d-496b-83e0-b2c5f124721b service nova] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:50:50.300153 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1a969c-e17d-496b-83e0-b2c5f124721b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:50:50.303053 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1a969c-e17d-496b-83e0-b2c5f124721b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:50:50.304897 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1a969c-e17d-496b-83e0-b2c5f124721b service nova] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:50:50.316665 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 694/1385] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:50:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:50:52.689769 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8148762-749a-41df-8736-333b48710c0e None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:50:52.690343 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8148762-749a-41df-8736-333b48710c0e None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:50:52.690443 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8148762-749a-41df-8736-333b48710c0e None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:50:52.691906 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 692/1386] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:50:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:50:52.697992 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177ed312-7bb5-4267-ad26-2cb4c57b923d None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:50:52.698453 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177ed312-7bb5-4267-ad26-2cb4c57b923d None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:50:52.698841 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177ed312-7bb5-4267-ad26-2cb4c57b923d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:50:52.722428 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-177ed312-7bb5-4267-ad26-2cb4c57b923d None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:50:52.724229 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-177ed312-7bb5-4267-ad26-2cb4c57b923d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:50:52.734924 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 695/1387] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:50:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:50:52.782571 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8148762-749a-41df-8736-333b48710c0e None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:50:52.798546 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8148762-749a-41df-8736-333b48710c0e None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:50:52.804335 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f729b4-b1d0-48b0-8e5c-447256a85446 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4696d396adb495ab300a9a5a5727595', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:50:52.805026 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f729b4-b1d0-48b0-8e5c-447256a85446 service nova] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:50:52.805299 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f729b4-b1d0-48b0-8e5c-447256a85446 service nova] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:50:52.805592 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f729b4-b1d0-48b0-8e5c-447256a85446 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:50:52.815201 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f729b4-b1d0-48b0-8e5c-447256a85446 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:50:52.816890 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f729b4-b1d0-48b0-8e5c-447256a85446 service nova] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:50:52.828060 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 693/1388] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:50:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:50:55.276257 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacccd3c-fc1b-4216-8231-ec3d2b29b7f8 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:50:55.276845 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacccd3c-fc1b-4216-8231-ec3d2b29b7f8 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:50:55.276992 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacccd3c-fc1b-4216-8231-ec3d2b29b7f8 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:50:55.279272 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 696/1389] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:50:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:50:55.285119 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dab6474-efc1-4742-831b-317b9d83e084 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:50:55.285977 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dab6474-efc1-4742-831b-317b9d83e084 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:50:55.285977 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dab6474-efc1-4742-831b-317b9d83e084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:50:55.306965 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-0dab6474-efc1-4742-831b-317b9d83e084 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:50:55.308278 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-0dab6474-efc1-4742-831b-317b9d83e084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:50:55.316524 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 694/1390] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:50:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:50:55.366835 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacccd3c-fc1b-4216-8231-ec3d2b29b7f8 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:50:55.383013 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacccd3c-fc1b-4216-8231-ec3d2b29b7f8 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:50:55.390828 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad244fd-41f9-4c17-b502-68d6df7f4f77 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4696d396adb495ab300a9a5a5727595', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:50:55.391731 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad244fd-41f9-4c17-b502-68d6df7f4f77 service nova] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:50:55.392035 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad244fd-41f9-4c17-b502-68d6df7f4f77 service nova] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:50:55.392403 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad244fd-41f9-4c17-b502-68d6df7f4f77 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:50:55.402356 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad244fd-41f9-4c17-b502-68d6df7f4f77 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:50:55.404896 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad244fd-41f9-4c17-b502-68d6df7f4f77 service nova] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:50:55.415960 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 697/1391] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:50:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:50:57.832856 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee9ef41-5421-4776-83f9-011252385041 None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:50:57.833448 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee9ef41-5421-4776-83f9-011252385041 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:50:57.833448 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee9ef41-5421-4776-83f9-011252385041 None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:50:57.834819 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 695/1392] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:50:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:50:57.840632 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cf8ae9-be5f-4ea0-ac5a-2ce0771ca438 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:50:57.841062 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cf8ae9-be5f-4ea0-ac5a-2ce0771ca438 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:50:57.841218 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cf8ae9-be5f-4ea0-ac5a-2ce0771ca438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:50:57.860983 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-82cf8ae9-be5f-4ea0-ac5a-2ce0771ca438 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:50:57.862206 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-82cf8ae9-be5f-4ea0-ac5a-2ce0771ca438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:50:57.870177 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 698/1393] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:50:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:50:57.916315 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee9ef41-5421-4776-83f9-011252385041 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:50:57.931485 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee9ef41-5421-4776-83f9-011252385041 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:50:57.937947 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf32deb-6182-4e2c-ac0e-edbf14b365c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4696d396adb495ab300a9a5a5727595', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:50:57.938653 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf32deb-6182-4e2c-ac0e-edbf14b365c9 service nova] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:50:57.938906 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf32deb-6182-4e2c-ac0e-edbf14b365c9 service nova] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:50:57.939190 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf32deb-6182-4e2c-ac0e-edbf14b365c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:50:57.948428 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf32deb-6182-4e2c-ac0e-edbf14b365c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:50:57.950665 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf32deb-6182-4e2c-ac0e-edbf14b365c9 service nova] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:50:57.962187 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 696/1394] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:50:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:50:59.318849 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0067de30-5dbe-43bb-9aa1-59561a7531a2 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:50:59.319439 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0067de30-5dbe-43bb-9aa1-59561a7531a2 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:50:59.319439 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0067de30-5dbe-43bb-9aa1-59561a7531a2 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:50:59.320820 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 699/1395] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:50:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:50:59.326605 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c2e19f-bb93-497e-ba3c-72f3aef0687e None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:50:59.327324 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c2e19f-bb93-497e-ba3c-72f3aef0687e None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:50:59.327678 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c2e19f-bb93-497e-ba3c-72f3aef0687e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:50:59.334391 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=52 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:50:59.349344 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-89c2e19f-bb93-497e-ba3c-72f3aef0687e None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:50:59.350780 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-89c2e19f-bb93-497e-ba3c-72f3aef0687e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:50:59.360924 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 697/1396] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:50:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 17:50:59.418198 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a07843-8806-4d03-be04-4d7ad35f7ea8 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:50:59.418704 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a07843-8806-4d03-be04-4d7ad35f7ea8 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:50:59.419452 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a07843-8806-4d03-be04-4d7ad35f7ea8 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:50:59.420393 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 700/1397] 10.222.0.36 () {54 vars in 962 bytes} [Tue Jun 14 17:50:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:50:59.425499 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2406e7f-724e-44e4-9368-ddcefd5c6c6e None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:50:59.425799 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2406e7f-724e-44e4-9368-ddcefd5c6c6e None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:50:59.426087 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2406e7f-724e-44e4-9368-ddcefd5c6c6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:50:59.477418 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-f2406e7f-724e-44e4-9368-ddcefd5c6c6e None None] MFA Rules not processed for user `359f5ed4eb684e769f552484ca9a34c7`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:50:59.478677 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-f2406e7f-724e-44e4-9368-ddcefd5c6c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:50:59.542959 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 698/1398] 10.222.0.36 () {58 vars in 1059 bytes} [Tue Jun 14 17:50:59 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:50:59.551430 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a07843-8806-4d03-be04-4d7ad35f7ea8 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:50:59.562571 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a07843-8806-4d03-be04-4d7ad35f7ea8 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:50:59.566087 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186a1768-cd8e-4913-a8f2-bffc6bb9187f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359f5ed4eb684e769f552484ca9a34c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:50:59.566724 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186a1768-cd8e-4913-a8f2-bffc6bb9187f service glance] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:50:59.567009 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186a1768-cd8e-4913-a8f2-bffc6bb9187f service glance] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:50:59.567290 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186a1768-cd8e-4913-a8f2-bffc6bb9187f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:50:59.576958 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186a1768-cd8e-4913-a8f2-bffc6bb9187f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:50:59.578429 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186a1768-cd8e-4913-a8f2-bffc6bb9187f service glance] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:50:59.588149 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 701/1399] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:50:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:51:00.375217 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf5389a-a5d4-49be-bf70-455f981a18d5 None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:51:00.375793 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf5389a-a5d4-49be-bf70-455f981a18d5 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:51:00.375793 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf5389a-a5d4-49be-bf70-455f981a18d5 None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:51:00.377248 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 699/1400] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:51:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:51:00.383075 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce3afa9-9490-415b-a5f9-a3ef792591ef None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:51:00.383829 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce3afa9-9490-415b-a5f9-a3ef792591ef None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:51:00.383829 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce3afa9-9490-415b-a5f9-a3ef792591ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:51:00.402357 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-3ce3afa9-9490-415b-a5f9-a3ef792591ef None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:51:00.403820 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-3ce3afa9-9490-415b-a5f9-a3ef792591ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:51:00.411839 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 702/1401] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:51:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:51:00.458571 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf5389a-a5d4-49be-bf70-455f981a18d5 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:51:00.474244 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf5389a-a5d4-49be-bf70-455f981a18d5 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:51:00.484327 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b45c52-96fe-47db-834a-3795f694cd00 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4696d396adb495ab300a9a5a5727595', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:51:00.484327 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b45c52-96fe-47db-834a-3795f694cd00 service nova] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:51:00.484327 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b45c52-96fe-47db-834a-3795f694cd00 service nova] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:51:00.484327 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b45c52-96fe-47db-834a-3795f694cd00 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:51:00.490517 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b45c52-96fe-47db-834a-3795f694cd00 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:51:00.492278 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b45c52-96fe-47db-834a-3795f694cd00 service nova] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:51:00.506238 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 700/1402] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:51:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:51:00.792233 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e22b10-242a-48de-8e7e-b637245df1fb None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:51:00.799420 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e22b10-242a-48de-8e7e-b637245df1fb None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:51:00.799420 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e22b10-242a-48de-8e7e-b637245df1fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:51:00.844620 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-97e22b10-242a-48de-8e7e-b637245df1fb None None] MFA Rules not processed for user `f1e32638fe5c4d2d8d3e2e4ea8250aaa`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:51:00.845838 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-97e22b10-242a-48de-8e7e-b637245df1fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:51:00.922980 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 703/1403] 10.222.0.36 () {58 vars in 1009 bytes} [Tue Jun 14 17:51:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:51:00.975559 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1cbff2-42a2-4316-ba62-80a7363db2e9 None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:51:00.975888 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1cbff2-42a2-4316-ba62-80a7363db2e9 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:51:00.976115 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1cbff2-42a2-4316-ba62-80a7363db2e9 None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:51:00.977621 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 701/1404] 10.222.0.36 () {54 vars in 942 bytes} [Tue Jun 14 17:51:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:51:00.985885 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb42c052-9425-408a-bf50-41bdb8b3615f None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:51:00.986371 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb42c052-9425-408a-bf50-41bdb8b3615f None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:51:00.986923 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb42c052-9425-408a-bf50-41bdb8b3615f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:51:00.996316 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:51:01.051115 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-bb42c052-9425-408a-bf50-41bdb8b3615f None None] MFA Rules not processed for user `ba38b47a31b14526be0aa2054841881b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:51:01.052363 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-bb42c052-9425-408a-bf50-41bdb8b3615f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:51:01.129090 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 704/1405] 10.222.0.36 () {58 vars in 1039 bytes} [Tue Jun 14 17:51:00 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:51:01.139100 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1cbff2-42a2-4316-ba62-80a7363db2e9 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:51:01.152531 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1cbff2-42a2-4316-ba62-80a7363db2e9 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:51:01.159084 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d42550-b09d-4a06-b80e-3f15975ceff1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba38b47a31b14526be0aa2054841881b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:51:01.159783 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d42550-b09d-4a06-b80e-3f15975ceff1 service swift] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:51:01.160086 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d42550-b09d-4a06-b80e-3f15975ceff1 service swift] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:51:01.162663 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d42550-b09d-4a06-b80e-3f15975ceff1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:51:01.170427 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d42550-b09d-4a06-b80e-3f15975ceff1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:51:01.172114 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d42550-b09d-4a06-b80e-3f15975ceff1 service swift] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:51:01.181076 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 702/1406] 10.222.0.36 () {60 vars in 1384 bytes} [Tue Jun 14 17:51:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 14 17:51:03.097292 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f3756a-6adc-4125-8c6a-ae230d29127e None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:51:03.097858 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f3756a-6adc-4125-8c6a-ae230d29127e None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:51:03.097858 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f3756a-6adc-4125-8c6a-ae230d29127e None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:51:03.099266 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 705/1407] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:51:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:51:03.107866 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501c3bc3-70d7-4681-90bc-135a80d8b0f9 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:51:03.108637 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501c3bc3-70d7-4681-90bc-135a80d8b0f9 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:51:03.108799 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501c3bc3-70d7-4681-90bc-135a80d8b0f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:51:03.138522 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-501c3bc3-70d7-4681-90bc-135a80d8b0f9 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:51:03.140560 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-501c3bc3-70d7-4681-90bc-135a80d8b0f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:51:03.155032 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 703/1408] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:51:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 17:51:03.229152 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f3756a-6adc-4125-8c6a-ae230d29127e None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:51:03.256040 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f3756a-6adc-4125-8c6a-ae230d29127e None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:51:03.264268 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0fcc7f-1288-42a1-9712-457fe34e4cb3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4696d396adb495ab300a9a5a5727595', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:51:03.265062 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0fcc7f-1288-42a1-9712-457fe34e4cb3 service nova] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:51:03.265450 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0fcc7f-1288-42a1-9712-457fe34e4cb3 service nova] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:51:03.265842 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0fcc7f-1288-42a1-9712-457fe34e4cb3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:51:03.283192 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0fcc7f-1288-42a1-9712-457fe34e4cb3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:51:03.286052 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0fcc7f-1288-42a1-9712-457fe34e4cb3 service nova] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:51:03.303353 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 706/1409] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:51:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:51:13.131281 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=55 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:51:13.294874 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=49 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:51:26.613020 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c228462c-47d7-4238-bc37-098aa844065c None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:51:26.613737 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c228462c-47d7-4238-bc37-098aa844065c None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:51:26.613737 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c228462c-47d7-4238-bc37-098aa844065c None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:51:26.615033 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 704/1410] 10.222.0.36 () {54 vars in 918 bytes} [Tue Jun 14 17:51:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 14 17:51:26.622135 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87111a73-dd6b-4689-9360-2c31b2394c64 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:51:26.622804 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87111a73-dd6b-4689-9360-2c31b2394c64 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:51:26.622804 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87111a73-dd6b-4689-9360-2c31b2394c64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:51:26.642977 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-87111a73-dd6b-4689-9360-2c31b2394c64 None None] MFA Rules not processed for user `6a8049f9c66b4b5185c26084fd8239ab`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:51:26.644231 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-87111a73-dd6b-4689-9360-2c31b2394c64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:51:26.653204 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 707/1411] 10.222.0.36 () {58 vars in 1015 bytes} [Tue Jun 14 17:51:26 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:51:26.668820 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b44ea8-0e16-4eff-b50f-ba7dd7d1d3de None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:51:26.669229 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b44ea8-0e16-4eff-b50f-ba7dd7d1d3de None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:51:26.669516 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b44ea8-0e16-4eff-b50f-ba7dd7d1d3de None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:51:26.671132 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 705/1412] 10.222.0.36 () {54 vars in 918 bytes} [Tue Jun 14 17:51:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:51:26.676277 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deacfc4-87af-4b4c-add4-f4e8beec3918 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:51:26.676573 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deacfc4-87af-4b4c-add4-f4e8beec3918 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:51:26.676890 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deacfc4-87af-4b4c-add4-f4e8beec3918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:51:26.695921 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-5deacfc4-87af-4b4c-add4-f4e8beec3918 None None] MFA Rules not processed for user `e4696d396adb495ab300a9a5a5727595`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:51:26.697149 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-5deacfc4-87af-4b4c-add4-f4e8beec3918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:51:26.706772 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 708/1413] 10.222.0.36 () {58 vars in 1015 bytes} [Tue Jun 14 17:51:26 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:51:29.391713 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f8ed69-bf80-43fa-a0c4-618c13b98406 None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:51:29.392288 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f8ed69-bf80-43fa-a0c4-618c13b98406 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:51:29.392288 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f8ed69-bf80-43fa-a0c4-618c13b98406 None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:51:29.393654 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 706/1414] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 14 17:51:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:51:29.399352 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19be18eb-9f99-48d0-9d12-d18669c85d93 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:51:29.399874 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19be18eb-9f99-48d0-9d12-d18669c85d93 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:51:29.399969 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19be18eb-9f99-48d0-9d12-d18669c85d93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:51:29.419207 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-19be18eb-9f99-48d0-9d12-d18669c85d93 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:51:29.420602 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-19be18eb-9f99-48d0-9d12-d18669c85d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:51:29.428703 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 709/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 14 17:51:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:51:29.473934 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f8ed69-bf80-43fa-a0c4-618c13b98406 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:51:29.488565 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f8ed69-bf80-43fa-a0c4-618c13b98406 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:51:29.494153 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0ecdb3-f304-4b7c-8b7d-194de6326790 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4696d396adb495ab300a9a5a5727595', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:51:29.494834 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0ecdb3-f304-4b7c-8b7d-194de6326790 service nova] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:51:29.495117 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0ecdb3-f304-4b7c-8b7d-194de6326790 service nova] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:51:29.495928 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0ecdb3-f304-4b7c-8b7d-194de6326790 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:51:29.505896 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0ecdb3-f304-4b7c-8b7d-194de6326790 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:51:29.507596 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0ecdb3-f304-4b7c-8b7d-194de6326790 service nova] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:51:29.519942 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 707/1416] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:51:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:51:30.514978 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e791c7b-56aa-440a-a576-5a36e19570c3 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:51:30.515601 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e791c7b-56aa-440a-a576-5a36e19570c3 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:51:30.515601 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e791c7b-56aa-440a-a576-5a36e19570c3 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:51:30.516950 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 710/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 14 17:51:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:51:30.521975 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b4f56b-0b07-46ec-b8aa-c788964c0972 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:51:30.522462 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b4f56b-0b07-46ec-b8aa-c788964c0972 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:51:30.522565 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b4f56b-0b07-46ec-b8aa-c788964c0972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:51:30.542100 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-73b4f56b-0b07-46ec-b8aa-c788964c0972 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:51:30.543890 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-73b4f56b-0b07-46ec-b8aa-c788964c0972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:51:30.551944 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 708/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 14 17:51:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:51:30.722730 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e791c7b-56aa-440a-a576-5a36e19570c3 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:51:30.738947 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e791c7b-56aa-440a-a576-5a36e19570c3 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:51:30.744653 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1503d1-60c1-4d28-ba9a-166613416f05 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4696d396adb495ab300a9a5a5727595', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:51:30.745810 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1503d1-60c1-4d28-ba9a-166613416f05 service nova] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:51:30.746119 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1503d1-60c1-4d28-ba9a-166613416f05 service nova] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:51:30.746397 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1503d1-60c1-4d28-ba9a-166613416f05 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:51:30.755708 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1503d1-60c1-4d28-ba9a-166613416f05 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:51:30.757299 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1503d1-60c1-4d28-ba9a-166613416f05 service nova] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:51:30.768708 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 711/1419] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:51:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:51:31.756171 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f648e-3b2c-4c4b-8593-a40b99742921 None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:51:31.756765 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f648e-3b2c-4c4b-8593-a40b99742921 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:51:31.756765 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f648e-3b2c-4c4b-8593-a40b99742921 None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:51:31.758102 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 709/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 14 17:51:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:51:31.763880 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f75673a-5774-4186-a1d1-b4190212fa75 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:51:31.764345 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f75673a-5774-4186-a1d1-b4190212fa75 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:51:31.764465 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f75673a-5774-4186-a1d1-b4190212fa75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:51:31.791577 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-9f75673a-5774-4186-a1d1-b4190212fa75 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:51:31.794126 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-9f75673a-5774-4186-a1d1-b4190212fa75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:51:31.807268 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 712/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 14 17:51:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:51:31.962510 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078f648e-3b2c-4c4b-8593-a40b99742921 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:51:31.977165 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078f648e-3b2c-4c4b-8593-a40b99742921 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:51:32.007706 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdabc0e2-59d3-4094-9ca5-ed124d078965 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4696d396adb495ab300a9a5a5727595', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:51:32.007706 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdabc0e2-59d3-4094-9ca5-ed124d078965 service nova] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:51:32.007706 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdabc0e2-59d3-4094-9ca5-ed124d078965 service nova] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:51:32.007706 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdabc0e2-59d3-4094-9ca5-ed124d078965 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:51:32.008069 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdabc0e2-59d3-4094-9ca5-ed124d078965 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:51:32.008069 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdabc0e2-59d3-4094-9ca5-ed124d078965 service nova] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:51:32.008069 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 710/1422] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:51:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:51:32.952924 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87916349-d86b-48a3-9922-c0dfbddf8ec0 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:51:32.953495 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87916349-d86b-48a3-9922-c0dfbddf8ec0 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:51:32.953495 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87916349-d86b-48a3-9922-c0dfbddf8ec0 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:51:32.954872 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 713/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 14 17:51:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:51:32.960432 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f6f970-9a1b-40f7-894b-fb746afb4cb4 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:51:32.960985 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f6f970-9a1b-40f7-894b-fb746afb4cb4 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:51:32.960985 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f6f970-9a1b-40f7-894b-fb746afb4cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:51:32.982915 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-53f6f970-9a1b-40f7-894b-fb746afb4cb4 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:51:32.984208 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-53f6f970-9a1b-40f7-894b-fb746afb4cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:51:32.992471 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 711/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 14 17:51:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:51:33.147093 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87916349-d86b-48a3-9922-c0dfbddf8ec0 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:51:33.162712 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87916349-d86b-48a3-9922-c0dfbddf8ec0 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:51:33.169447 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44615156-54c7-464e-8d34-66b5a9c9fea0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4696d396adb495ab300a9a5a5727595', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:51:33.170229 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44615156-54c7-464e-8d34-66b5a9c9fea0 service nova] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:51:33.170665 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44615156-54c7-464e-8d34-66b5a9c9fea0 service nova] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:51:33.171060 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44615156-54c7-464e-8d34-66b5a9c9fea0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:51:33.180885 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44615156-54c7-464e-8d34-66b5a9c9fea0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:51:33.184761 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44615156-54c7-464e-8d34-66b5a9c9fea0 service nova] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:51:33.193779 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 714/1425] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:51:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:51:34.162266 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d612a1f6-9eac-4c5e-8af3-3033e1386405 None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:51:34.162818 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d612a1f6-9eac-4c5e-8af3-3033e1386405 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:51:34.162818 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d612a1f6-9eac-4c5e-8af3-3033e1386405 None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:51:34.164263 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 712/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 14 17:51:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:51:34.170092 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccb9998-faac-4ef1-9f6c-ad375cc3c612 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:51:34.170571 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccb9998-faac-4ef1-9f6c-ad375cc3c612 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:51:34.170680 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccb9998-faac-4ef1-9f6c-ad375cc3c612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:51:34.190684 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-fccb9998-faac-4ef1-9f6c-ad375cc3c612 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:51:34.191984 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-fccb9998-faac-4ef1-9f6c-ad375cc3c612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:51:34.201154 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 715/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 14 17:51:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:51:34.357631 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d612a1f6-9eac-4c5e-8af3-3033e1386405 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:51:34.373310 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d612a1f6-9eac-4c5e-8af3-3033e1386405 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:51:34.379020 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbbc82a-1711-4ed2-87d9-b64e5c683fdd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4696d396adb495ab300a9a5a5727595', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:51:34.379731 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbbc82a-1711-4ed2-87d9-b64e5c683fdd service nova] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:51:34.380017 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbbc82a-1711-4ed2-87d9-b64e5c683fdd service nova] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:51:34.380330 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbbc82a-1711-4ed2-87d9-b64e5c683fdd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:51:34.389916 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbbc82a-1711-4ed2-87d9-b64e5c683fdd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:51:34.391570 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbbc82a-1711-4ed2-87d9-b64e5c683fdd service nova] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:51:34.401514 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 713/1428] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:51:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:51:35.347758 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece75f91-565a-4f83-9da2-d52ab9f3e666 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:51:35.348338 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece75f91-565a-4f83-9da2-d52ab9f3e666 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:51:35.348338 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece75f91-565a-4f83-9da2-d52ab9f3e666 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:51:35.349650 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 716/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 14 17:51:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:51:35.355831 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53d05cc-cc7b-4567-b8ac-02e606d3564f None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:51:35.356687 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53d05cc-cc7b-4567-b8ac-02e606d3564f None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:51:35.356687 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53d05cc-cc7b-4567-b8ac-02e606d3564f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:51:35.375529 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-e53d05cc-cc7b-4567-b8ac-02e606d3564f None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:51:35.376771 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-e53d05cc-cc7b-4567-b8ac-02e606d3564f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:51:35.387270 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 714/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 14 17:51:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 17:51:35.542545 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece75f91-565a-4f83-9da2-d52ab9f3e666 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:51:35.557130 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece75f91-565a-4f83-9da2-d52ab9f3e666 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:51:35.563272 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721c714c-6851-4988-86f6-f314eafbe69b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4696d396adb495ab300a9a5a5727595', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:51:35.563932 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721c714c-6851-4988-86f6-f314eafbe69b service nova] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:51:35.564217 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721c714c-6851-4988-86f6-f314eafbe69b service nova] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:51:35.564492 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721c714c-6851-4988-86f6-f314eafbe69b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:51:35.572795 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721c714c-6851-4988-86f6-f314eafbe69b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:51:35.575276 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721c714c-6851-4988-86f6-f314eafbe69b service nova] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:51:35.585350 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 717/1431] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:51:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:51:36.556331 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdffba72-8557-4575-8bbc-7690ed0f1423 None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:51:36.556888 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdffba72-8557-4575-8bbc-7690ed0f1423 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:51:36.556888 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdffba72-8557-4575-8bbc-7690ed0f1423 None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:51:36.559412 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 715/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 14 17:51:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:51:36.565246 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef636ff-0ebc-439b-8433-4cf563155b63 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:51:36.565821 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef636ff-0ebc-439b-8433-4cf563155b63 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:51:36.565821 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef636ff-0ebc-439b-8433-4cf563155b63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:51:36.584899 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-cef636ff-0ebc-439b-8433-4cf563155b63 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:51:36.586131 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-cef636ff-0ebc-439b-8433-4cf563155b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:51:36.594797 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 718/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 14 17:51:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:51:36.749055 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdffba72-8557-4575-8bbc-7690ed0f1423 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:51:36.764700 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdffba72-8557-4575-8bbc-7690ed0f1423 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:51:36.770227 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2607e67-2080-46c9-9438-db63d23026b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4696d396adb495ab300a9a5a5727595', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:51:36.770924 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2607e67-2080-46c9-9438-db63d23026b1 service nova] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:51:36.771205 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2607e67-2080-46c9-9438-db63d23026b1 service nova] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:51:36.771506 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2607e67-2080-46c9-9438-db63d23026b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:51:36.780707 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2607e67-2080-46c9-9438-db63d23026b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:51:36.782377 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2607e67-2080-46c9-9438-db63d23026b1 service nova] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:51:36.792318 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 716/1434] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:51:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:51:37.716533 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4232609e-6846-44ee-94a7-332ded8b7fa3 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:51:37.717127 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4232609e-6846-44ee-94a7-332ded8b7fa3 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:51:37.717127 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4232609e-6846-44ee-94a7-332ded8b7fa3 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:51:37.718461 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 719/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 14 17:51:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:51:37.723524 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e86ba1-8208-4607-8258-85b5978bf6a8 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:51:37.723960 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e86ba1-8208-4607-8258-85b5978bf6a8 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:51:37.724092 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e86ba1-8208-4607-8258-85b5978bf6a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:51:37.742028 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-d2e86ba1-8208-4607-8258-85b5978bf6a8 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:51:37.743242 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-d2e86ba1-8208-4607-8258-85b5978bf6a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:51:37.751895 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 717/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 14 17:51:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:51:37.906080 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4232609e-6846-44ee-94a7-332ded8b7fa3 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:51:37.920507 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4232609e-6846-44ee-94a7-332ded8b7fa3 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:51:37.926041 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827556b9-ff81-4a9f-a68b-b6030ceba11c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4696d396adb495ab300a9a5a5727595', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:51:37.926681 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827556b9-ff81-4a9f-a68b-b6030ceba11c service nova] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:51:37.926969 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827556b9-ff81-4a9f-a68b-b6030ceba11c service nova] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:51:37.927251 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827556b9-ff81-4a9f-a68b-b6030ceba11c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:51:37.935919 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827556b9-ff81-4a9f-a68b-b6030ceba11c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:51:37.937543 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827556b9-ff81-4a9f-a68b-b6030ceba11c service nova] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:51:37.947596 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 720/1437] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:51:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:51:38.908104 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6791cc0-197c-4be9-8bcb-caa2910fc838 None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:51:38.908574 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6791cc0-197c-4be9-8bcb-caa2910fc838 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:51:38.908696 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6791cc0-197c-4be9-8bcb-caa2910fc838 None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:51:38.910034 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 718/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 14 17:51:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:51:38.915028 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240baaa0-b0b4-4b88-8f3c-e42f201f6ab5 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:51:38.915489 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240baaa0-b0b4-4b88-8f3c-e42f201f6ab5 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:51:38.915646 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240baaa0-b0b4-4b88-8f3c-e42f201f6ab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:51:38.934898 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-240baaa0-b0b4-4b88-8f3c-e42f201f6ab5 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:51:38.936152 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-240baaa0-b0b4-4b88-8f3c-e42f201f6ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:51:38.944130 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 721/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 14 17:51:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 17:51:39.100135 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6791cc0-197c-4be9-8bcb-caa2910fc838 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:51:39.115801 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6791cc0-197c-4be9-8bcb-caa2910fc838 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:51:39.121432 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab365465-78a4-45ef-988a-10dcfe8ec24d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4696d396adb495ab300a9a5a5727595', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:51:39.122087 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab365465-78a4-45ef-988a-10dcfe8ec24d service nova] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:51:39.122378 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab365465-78a4-45ef-988a-10dcfe8ec24d service nova] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:51:39.122690 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab365465-78a4-45ef-988a-10dcfe8ec24d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:51:39.131573 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab365465-78a4-45ef-988a-10dcfe8ec24d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:51:39.133169 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab365465-78a4-45ef-988a-10dcfe8ec24d service nova] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:51:39.143359 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 719/1440] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:51:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:51:41.266491 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff91a8d-9548-42ce-be68-9c55adf70fb5 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:51:41.267070 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff91a8d-9548-42ce-be68-9c55adf70fb5 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:51:41.267181 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff91a8d-9548-42ce-be68-9c55adf70fb5 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:51:41.268499 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 722/1441] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 14 17:51:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:51:41.273821 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ace99ea-4f6e-4ef2-bcd9-f82b6de6255e None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:51:41.274248 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ace99ea-4f6e-4ef2-bcd9-f82b6de6255e None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:51:41.274386 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ace99ea-4f6e-4ef2-bcd9-f82b6de6255e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:51:41.294052 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-8ace99ea-4f6e-4ef2-bcd9-f82b6de6255e None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:51:41.295277 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-8ace99ea-4f6e-4ef2-bcd9-f82b6de6255e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:51:41.307198 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 720/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 14 17:51:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:51:41.343491 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff91a8d-9548-42ce-be68-9c55adf70fb5 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:51:41.354334 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff91a8d-9548-42ce-be68-9c55adf70fb5 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:51:41.358463 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f86c15-5e57-42a4-b053-2f018d88261f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5652329c71cd431fb579d69cef933b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:51:41.359098 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f86c15-5e57-42a4-b053-2f018d88261f service neutron] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:51:41.359441 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f86c15-5e57-42a4-b053-2f018d88261f service neutron] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:51:41.359754 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f86c15-5e57-42a4-b053-2f018d88261f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:51:41.368796 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f86c15-5e57-42a4-b053-2f018d88261f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:51:41.370775 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f86c15-5e57-42a4-b053-2f018d88261f service neutron] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:51:41.381345 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 723/1443] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:51:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:51:43.805934 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0912f48-fcf9-4c3c-b68b-c0a98ba18d95 None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:51:43.806519 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0912f48-fcf9-4c3c-b68b-c0a98ba18d95 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:51:43.806519 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0912f48-fcf9-4c3c-b68b-c0a98ba18d95 None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:51:43.807957 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 721/1444] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 14 17:51:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 14 17:51:43.813782 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d6f4fc-1b66-4397-8d39-45c38ab0869a None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:51:43.814270 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d6f4fc-1b66-4397-8d39-45c38ab0869a None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:51:43.814419 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d6f4fc-1b66-4397-8d39-45c38ab0869a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:51:43.832343 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-a2d6f4fc-1b66-4397-8d39-45c38ab0869a None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:51:43.833571 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-a2d6f4fc-1b66-4397-8d39-45c38ab0869a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:51:43.842702 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 724/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 14 17:51:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:51:43.881040 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0912f48-fcf9-4c3c-b68b-c0a98ba18d95 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:51:43.893099 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0912f48-fcf9-4c3c-b68b-c0a98ba18d95 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:51:43.896770 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22e9d00-9340-4c18-ab46-e25311e2e640 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5652329c71cd431fb579d69cef933b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:51:43.897422 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22e9d00-9340-4c18-ab46-e25311e2e640 service neutron] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:51:43.897708 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22e9d00-9340-4c18-ab46-e25311e2e640 service neutron] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:51:43.897987 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22e9d00-9340-4c18-ab46-e25311e2e640 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:51:43.908998 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22e9d00-9340-4c18-ab46-e25311e2e640 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:51:43.910456 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22e9d00-9340-4c18-ab46-e25311e2e640 service neutron] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:51:43.921137 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 722/1446] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:51:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:51:46.547452 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5812af1-2b88-46e7-bcba-c72297953124 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:51:46.548143 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5812af1-2b88-46e7-bcba-c72297953124 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:51:46.548143 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5812af1-2b88-46e7-bcba-c72297953124 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:51:46.549456 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 725/1447] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 14 17:51:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:51:46.558967 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdabb6b-ccaa-4bc0-a9da-2b91b012d075 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:51:46.559768 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdabb6b-ccaa-4bc0-a9da-2b91b012d075 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:51:46.559768 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdabb6b-ccaa-4bc0-a9da-2b91b012d075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:51:46.579132 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-3fdabb6b-ccaa-4bc0-a9da-2b91b012d075 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:51:46.580415 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-3fdabb6b-ccaa-4bc0-a9da-2b91b012d075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:51:46.588634 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 723/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 14 17:51:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:51:46.630057 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5812af1-2b88-46e7-bcba-c72297953124 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:51:46.642164 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5812af1-2b88-46e7-bcba-c72297953124 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:51:46.645773 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f5a537-fb4c-49ac-a418-6d5f9e2cdeb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5652329c71cd431fb579d69cef933b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:51:46.646561 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f5a537-fb4c-49ac-a418-6d5f9e2cdeb3 service neutron] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:51:46.646866 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f5a537-fb4c-49ac-a418-6d5f9e2cdeb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:51:46.647251 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f5a537-fb4c-49ac-a418-6d5f9e2cdeb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:51:46.657808 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f5a537-fb4c-49ac-a418-6d5f9e2cdeb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:51:46.659255 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f5a537-fb4c-49ac-a418-6d5f9e2cdeb3 service neutron] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:51:46.670327 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 726/1449] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:51:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:51:49.025087 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de2bd72-6541-409d-90ee-67c762146a01 None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:51:49.025672 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de2bd72-6541-409d-90ee-67c762146a01 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:51:49.025672 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de2bd72-6541-409d-90ee-67c762146a01 None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:51:49.027682 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 724/1450] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 14 17:51:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:51:49.033004 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03400237-280d-45fe-be47-3ec9632d52ac None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:51:49.033470 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03400237-280d-45fe-be47-3ec9632d52ac None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:51:49.033581 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03400237-280d-45fe-be47-3ec9632d52ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:51:49.052100 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-03400237-280d-45fe-be47-3ec9632d52ac None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:51:49.053297 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-03400237-280d-45fe-be47-3ec9632d52ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:51:49.061542 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 727/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 14 17:51:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:51:49.100946 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de2bd72-6541-409d-90ee-67c762146a01 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:51:49.116192 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de2bd72-6541-409d-90ee-67c762146a01 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:51:49.119779 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8ec972-1392-4c05-88ba-4f12dae4b449 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5652329c71cd431fb579d69cef933b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:51:49.121164 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8ec972-1392-4c05-88ba-4f12dae4b449 service neutron] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:51:49.121453 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8ec972-1392-4c05-88ba-4f12dae4b449 service neutron] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:51:49.121743 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8ec972-1392-4c05-88ba-4f12dae4b449 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:51:49.131776 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8ec972-1392-4c05-88ba-4f12dae4b449 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:51:49.133226 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8ec972-1392-4c05-88ba-4f12dae4b449 service neutron] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:51:49.145873 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 725/1452] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:51:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:51:51.399651 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868e2f4c-9a20-47e4-b21a-2502ef3cbb6d None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:51:51.400558 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868e2f4c-9a20-47e4-b21a-2502ef3cbb6d None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:51:51.400558 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868e2f4c-9a20-47e4-b21a-2502ef3cbb6d None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:51:51.401677 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 728/1453] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 14 17:51:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:51:51.407409 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7265b350-e8e3-43b4-a534-f7e22e66548c None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:51:51.408032 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7265b350-e8e3-43b4-a534-f7e22e66548c None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:51:51.408032 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7265b350-e8e3-43b4-a534-f7e22e66548c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:51:51.427461 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-7265b350-e8e3-43b4-a534-f7e22e66548c None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:51:51.428686 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-7265b350-e8e3-43b4-a534-f7e22e66548c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:51:51.437650 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 726/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 14 17:51:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:51:51.474979 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868e2f4c-9a20-47e4-b21a-2502ef3cbb6d None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:51:51.486478 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868e2f4c-9a20-47e4-b21a-2502ef3cbb6d None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:51:51.490197 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade19865-da57-4f73-af76-eeab679db519 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5652329c71cd431fb579d69cef933b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:51:51.490841 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade19865-da57-4f73-af76-eeab679db519 service neutron] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:51:51.491132 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade19865-da57-4f73-af76-eeab679db519 service neutron] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:51:51.491440 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade19865-da57-4f73-af76-eeab679db519 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:51:51.502180 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade19865-da57-4f73-af76-eeab679db519 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:51:51.503689 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade19865-da57-4f73-af76-eeab679db519 service neutron] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:51:51.516058 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 729/1455] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:51:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:51:53.809409 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6ee305-ed1b-445d-8025-5e4c19a86825 None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:51:53.810002 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6ee305-ed1b-445d-8025-5e4c19a86825 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:51:53.810002 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6ee305-ed1b-445d-8025-5e4c19a86825 None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:51:53.811419 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 727/1456] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 14 17:51:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:51:53.817372 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bb5ffd-e119-4ff5-9de7-d456d96467ba None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:51:53.817883 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bb5ffd-e119-4ff5-9de7-d456d96467ba None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:51:53.817988 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bb5ffd-e119-4ff5-9de7-d456d96467ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:51:53.824635 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=70 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:51:53.836617 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-94bb5ffd-e119-4ff5-9de7-d456d96467ba None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:51:53.837823 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-94bb5ffd-e119-4ff5-9de7-d456d96467ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:51:53.848456 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 730/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 14 17:51:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:51:53.888731 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6ee305-ed1b-445d-8025-5e4c19a86825 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:51:53.894354 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=64 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:51:53.900388 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6ee305-ed1b-445d-8025-5e4c19a86825 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:51:53.905952 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d315a093-9350-4453-90bd-4e7abb5a6f06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5652329c71cd431fb579d69cef933b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:51:53.906461 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d315a093-9350-4453-90bd-4e7abb5a6f06 service neutron] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:51:53.906774 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d315a093-9350-4453-90bd-4e7abb5a6f06 service neutron] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:51:53.907081 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d315a093-9350-4453-90bd-4e7abb5a6f06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:51:53.917355 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d315a093-9350-4453-90bd-4e7abb5a6f06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:51:53.918814 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d315a093-9350-4453-90bd-4e7abb5a6f06 service neutron] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:51:53.929652 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 728/1458] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:51:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:51:56.233939 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f729499a-9f31-429a-97f3-ddaf579e23e9 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:51:56.234563 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f729499a-9f31-429a-97f3-ddaf579e23e9 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:51:56.234563 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f729499a-9f31-429a-97f3-ddaf579e23e9 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:51:56.235901 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 731/1459] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 14 17:51:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:51:56.241613 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c1aea6-fb94-4c4a-aeaf-eb4a75478f37 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:51:56.242053 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c1aea6-fb94-4c4a-aeaf-eb4a75478f37 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:51:56.242191 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c1aea6-fb94-4c4a-aeaf-eb4a75478f37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:51:56.261493 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-17c1aea6-fb94-4c4a-aeaf-eb4a75478f37 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:51:56.262704 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-17c1aea6-fb94-4c4a-aeaf-eb4a75478f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:51:56.270962 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 729/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 14 17:51:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:51:56.309599 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f729499a-9f31-429a-97f3-ddaf579e23e9 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:51:56.324194 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f729499a-9f31-429a-97f3-ddaf579e23e9 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:51:56.328870 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96a95f8-7f96-4c18-97f7-f3bc4b9f1db7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5652329c71cd431fb579d69cef933b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:51:56.329522 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a95f8-7f96-4c18-97f7-f3bc4b9f1db7 service neutron] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:51:56.329813 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a95f8-7f96-4c18-97f7-f3bc4b9f1db7 service neutron] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:51:56.330098 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a95f8-7f96-4c18-97f7-f3bc4b9f1db7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:51:56.339833 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96a95f8-7f96-4c18-97f7-f3bc4b9f1db7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:51:56.341277 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96a95f8-7f96-4c18-97f7-f3bc4b9f1db7 service neutron] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:51:56.350970 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 732/1461] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:51:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:51:58.652842 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa5706-ad23-48ea-9c4f-951955f1bdc4 None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:51:58.653473 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa5706-ad23-48ea-9c4f-951955f1bdc4 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:51:58.653473 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa5706-ad23-48ea-9c4f-951955f1bdc4 None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:51:58.654987 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 730/1462] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 14 17:51:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:51:58.661179 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01241a16-0d5c-4dbc-b39a-e86fece91aea None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:51:58.661753 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01241a16-0d5c-4dbc-b39a-e86fece91aea None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:51:58.661922 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01241a16-0d5c-4dbc-b39a-e86fece91aea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:51:58.681525 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-01241a16-0d5c-4dbc-b39a-e86fece91aea None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:51:58.683469 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-01241a16-0d5c-4dbc-b39a-e86fece91aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:51:58.691806 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 733/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 14 17:51:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:51:58.731814 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caa5706-ad23-48ea-9c4f-951955f1bdc4 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:51:58.743019 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caa5706-ad23-48ea-9c4f-951955f1bdc4 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:51:58.746790 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec670407-648c-4613-9942-d47db260b97d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5652329c71cd431fb579d69cef933b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:51:58.747487 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec670407-648c-4613-9942-d47db260b97d service neutron] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:51:58.747771 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec670407-648c-4613-9942-d47db260b97d service neutron] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:51:58.748050 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec670407-648c-4613-9942-d47db260b97d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:51:58.758351 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec670407-648c-4613-9942-d47db260b97d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:51:58.759875 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec670407-648c-4613-9942-d47db260b97d service neutron] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:51:58.771269 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 731/1464] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:51:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:52:01.234540 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a45821-de12-4852-b312-81bbc52575bb None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:52:01.235193 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a45821-de12-4852-b312-81bbc52575bb None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:52:01.235193 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a45821-de12-4852-b312-81bbc52575bb None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:52:01.236622 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 734/1465] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 14 17:52:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 14 17:52:01.244622 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537ecd6f-5783-4424-94f8-fd52c5159483 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:52:01.245207 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537ecd6f-5783-4424-94f8-fd52c5159483 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:52:01.245207 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537ecd6f-5783-4424-94f8-fd52c5159483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:52:01.265983 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-537ecd6f-5783-4424-94f8-fd52c5159483 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:52:01.267235 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-537ecd6f-5783-4424-94f8-fd52c5159483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:52:01.275544 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 732/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 14 17:52:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:52:01.313888 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a45821-de12-4852-b312-81bbc52575bb None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:52:01.326837 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a45821-de12-4852-b312-81bbc52575bb None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:52:01.330752 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5b4793-aa65-4681-9bac-9a7e49b4083b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5652329c71cd431fb579d69cef933b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:52:01.331451 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b4793-aa65-4681-9bac-9a7e49b4083b service neutron] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:52:01.333784 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b4793-aa65-4681-9bac-9a7e49b4083b service neutron] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:52:01.333784 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b4793-aa65-4681-9bac-9a7e49b4083b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:52:01.343152 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5b4793-aa65-4681-9bac-9a7e49b4083b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:52:01.344809 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5b4793-aa65-4681-9bac-9a7e49b4083b service neutron] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:52:01.357055 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 735/1467] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:52:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:52:03.711654 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb964a5f-1228-437a-bc59-b937fc465ac8 None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:52:03.712523 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb964a5f-1228-437a-bc59-b937fc465ac8 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:52:03.712523 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb964a5f-1228-437a-bc59-b937fc465ac8 None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:52:03.714260 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 733/1468] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 14 17:52:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 14 17:52:03.720219 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a6b590-c760-4ae0-8961-c253ddee75d7 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:52:03.720911 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a6b590-c760-4ae0-8961-c253ddee75d7 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:52:03.720911 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a6b590-c760-4ae0-8961-c253ddee75d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:52:03.740331 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-02a6b590-c760-4ae0-8961-c253ddee75d7 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:52:03.741564 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-02a6b590-c760-4ae0-8961-c253ddee75d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:52:03.750199 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 736/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 14 17:52:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:52:03.788344 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb964a5f-1228-437a-bc59-b937fc465ac8 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:52:03.799870 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb964a5f-1228-437a-bc59-b937fc465ac8 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:52:03.803559 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7658c957-31b7-4c0a-83c7-9ecd946b0337 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5652329c71cd431fb579d69cef933b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:52:03.804217 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7658c957-31b7-4c0a-83c7-9ecd946b0337 service neutron] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:52:03.804506 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7658c957-31b7-4c0a-83c7-9ecd946b0337 service neutron] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:52:03.804797 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7658c957-31b7-4c0a-83c7-9ecd946b0337 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:52:03.816033 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7658c957-31b7-4c0a-83c7-9ecd946b0337 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:52:03.817505 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7658c957-31b7-4c0a-83c7-9ecd946b0337 service neutron] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:52:03.829250 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 734/1470] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:52:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:52:13.734755 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=20 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:52:13.824198 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=23 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:52:24.781491 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28e3a49-4b42-4821-8a0f-923d5edfb8a6 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:52:24.782147 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28e3a49-4b42-4821-8a0f-923d5edfb8a6 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:52:24.782147 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28e3a49-4b42-4821-8a0f-923d5edfb8a6 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:52:24.783397 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 737/1471] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:52:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:52:24.789166 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc5a340-9e03-4411-b958-2a20ab4197a2 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:52:24.789693 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc5a340-9e03-4411-b958-2a20ab4197a2 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:52:24.789798 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc5a340-9e03-4411-b958-2a20ab4197a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:52:24.809320 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-7cc5a340-9e03-4411-b958-2a20ab4197a2 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:52:24.810531 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-7cc5a340-9e03-4411-b958-2a20ab4197a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:52:24.818455 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 735/1472] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:52:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 17:52:24.868222 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a771d8-08fe-4c95-8a93-27b06423e051 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:52:24.869934 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a771d8-08fe-4c95-8a93-27b06423e051 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:52:24.870134 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a771d8-08fe-4c95-8a93-27b06423e051 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:52:24.871873 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 738/1473] 10.222.0.36 () {54 vars in 962 bytes} [Tue Jun 14 17:52:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:52:24.876992 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcb7ba7-f891-460f-89f9-b903ab4d7839 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:52:24.877286 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcb7ba7-f891-460f-89f9-b903ab4d7839 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:52:24.877608 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcb7ba7-f891-460f-89f9-b903ab4d7839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:52:24.901330 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-fdcb7ba7-f891-460f-89f9-b903ab4d7839 None None] MFA Rules not processed for user `359f5ed4eb684e769f552484ca9a34c7`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:52:24.902544 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-fdcb7ba7-f891-460f-89f9-b903ab4d7839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:52:24.909439 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 736/1474] 10.222.0.36 () {58 vars in 1059 bytes} [Tue Jun 14 17:52:24 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:52:24.917654 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a771d8-08fe-4c95-8a93-27b06423e051 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:52:24.928555 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a771d8-08fe-4c95-8a93-27b06423e051 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:52:24.933192 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435e08e3-72eb-4a5a-baa7-e9117aeaa6ef service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359f5ed4eb684e769f552484ca9a34c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:52:24.933853 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435e08e3-72eb-4a5a-baa7-e9117aeaa6ef service glance] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:52:24.934140 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435e08e3-72eb-4a5a-baa7-e9117aeaa6ef service glance] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:52:24.934422 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435e08e3-72eb-4a5a-baa7-e9117aeaa6ef service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:52:24.944073 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435e08e3-72eb-4a5a-baa7-e9117aeaa6ef service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:52:24.945563 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435e08e3-72eb-4a5a-baa7-e9117aeaa6ef service glance] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:52:24.956894 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 739/1475] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:52:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:52:27.264174 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a7aa70-6805-40ed-8831-3063d14a17d1 None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:52:27.265050 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a7aa70-6805-40ed-8831-3063d14a17d1 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:52:27.265243 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a7aa70-6805-40ed-8831-3063d14a17d1 None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:52:27.266780 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 737/1476] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:52:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:52:27.272780 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e293c3-0d4f-4343-85b9-8875c7107aef None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:52:27.273273 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e293c3-0d4f-4343-85b9-8875c7107aef None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:52:27.273385 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e293c3-0d4f-4343-85b9-8875c7107aef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:52:27.294205 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-74e293c3-0d4f-4343-85b9-8875c7107aef None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:52:27.295506 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-74e293c3-0d4f-4343-85b9-8875c7107aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:52:27.303804 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 740/1477] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:52:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:52:27.329158 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a7aa70-6805-40ed-8831-3063d14a17d1 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:52:27.342812 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a7aa70-6805-40ed-8831-3063d14a17d1 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:52:27.347435 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1f39c4-528d-454b-8b00-fd77991da264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:52:27.348110 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1f39c4-528d-454b-8b00-fd77991da264 admin admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:52:27.348393 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1f39c4-528d-454b-8b00-fd77991da264 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:52:27.348679 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1f39c4-528d-454b-8b00-fd77991da264 admin admin] PATH_INFO: `/v3/projects` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:52:27.349416 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1f39c4-528d-454b-8b00-fd77991da264 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:52:27.351230 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: WARNING py.warnings [None req-aa1f39c4-528d-454b-8b00-fd77991da264 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 14 17:52:27.351230 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: warnings.warn(msg) Jun 14 17:52:27.351230 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: Jun 14 17:52:27.352403 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1f39c4-528d-454b-8b00-fd77991da264 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:52:27.375073 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 738/1478] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 14 17:52:27 2022] GET /identity/v3/projects => generated 2553 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 17:52:29.635154 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe661a5-c745-4831-b21c-a910ffde45f9 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:52:29.635783 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe661a5-c745-4831-b21c-a910ffde45f9 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:52:29.635783 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe661a5-c745-4831-b21c-a910ffde45f9 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:52:29.637164 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 741/1479] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:52:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:52:29.643543 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2750cde8-9691-4f41-a361-08719690c5c4 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:52:29.644131 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2750cde8-9691-4f41-a361-08719690c5c4 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:52:29.644131 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2750cde8-9691-4f41-a361-08719690c5c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:52:29.664802 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-2750cde8-9691-4f41-a361-08719690c5c4 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:52:29.666554 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-2750cde8-9691-4f41-a361-08719690c5c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:52:29.674645 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 739/1480] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:52:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:52:29.719506 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe661a5-c745-4831-b21c-a910ffde45f9 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:52:29.734996 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe661a5-c745-4831-b21c-a910ffde45f9 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:52:29.740422 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e166b0a5-f4f1-4405-98a8-a526b5866de0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4696d396adb495ab300a9a5a5727595', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:52:29.741088 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e166b0a5-f4f1-4405-98a8-a526b5866de0 service nova] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:52:29.741370 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e166b0a5-f4f1-4405-98a8-a526b5866de0 service nova] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:52:29.741651 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e166b0a5-f4f1-4405-98a8-a526b5866de0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:52:29.751793 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e166b0a5-f4f1-4405-98a8-a526b5866de0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:52:29.753387 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e166b0a5-f4f1-4405-98a8-a526b5866de0 service nova] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:52:29.764382 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 742/1481] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:52:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:52:32.157424 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc22d5f-77f3-4111-ab0b-85cae7e453e0 None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:52:32.157964 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc22d5f-77f3-4111-ab0b-85cae7e453e0 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:52:32.157964 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc22d5f-77f3-4111-ab0b-85cae7e453e0 None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:52:32.159346 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 740/1482] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:52:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:52:32.164682 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804a4e30-4ba5-4855-95cf-07acff28cf84 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:52:32.165213 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804a4e30-4ba5-4855-95cf-07acff28cf84 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:52:32.165403 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804a4e30-4ba5-4855-95cf-07acff28cf84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:52:32.183149 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-804a4e30-4ba5-4855-95cf-07acff28cf84 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:52:32.184392 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-804a4e30-4ba5-4855-95cf-07acff28cf84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:52:32.192325 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 743/1483] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:52:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:52:32.230037 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc22d5f-77f3-4111-ab0b-85cae7e453e0 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:52:32.241167 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc22d5f-77f3-4111-ab0b-85cae7e453e0 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:52:32.245577 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682bebfe-f9fd-4246-a256-40d2fe6c838a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5652329c71cd431fb579d69cef933b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:52:32.246237 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682bebfe-f9fd-4246-a256-40d2fe6c838a service neutron] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:52:32.246528 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682bebfe-f9fd-4246-a256-40d2fe6c838a service neutron] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:52:32.246812 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682bebfe-f9fd-4246-a256-40d2fe6c838a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:52:32.256473 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682bebfe-f9fd-4246-a256-40d2fe6c838a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:52:32.257904 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682bebfe-f9fd-4246-a256-40d2fe6c838a service neutron] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:52:32.269130 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 741/1484] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:52:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:52:34.640472 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2750691b-4a30-4457-8995-292ad4f0a5ee None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:52:34.641030 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2750691b-4a30-4457-8995-292ad4f0a5ee None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:52:34.641030 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2750691b-4a30-4457-8995-292ad4f0a5ee None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:52:34.642412 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 744/1485] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:52:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:52:34.647872 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3410d0-a8bb-4985-aa0f-b4c3a0415c3b None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:52:34.648398 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3410d0-a8bb-4985-aa0f-b4c3a0415c3b None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:52:34.648507 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3410d0-a8bb-4985-aa0f-b4c3a0415c3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:52:34.666836 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-3c3410d0-a8bb-4985-aa0f-b4c3a0415c3b None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:52:34.668097 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-3c3410d0-a8bb-4985-aa0f-b4c3a0415c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:52:34.676335 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 742/1486] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:52:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:52:34.715276 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2750691b-4a30-4457-8995-292ad4f0a5ee None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:52:34.726291 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2750691b-4a30-4457-8995-292ad4f0a5ee None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:52:34.730035 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f82817-8108-450b-ab42-08de97ab4682 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5652329c71cd431fb579d69cef933b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:52:34.730691 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f82817-8108-450b-ab42-08de97ab4682 service neutron] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:52:34.730981 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f82817-8108-450b-ab42-08de97ab4682 service neutron] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:52:34.731268 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f82817-8108-450b-ab42-08de97ab4682 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:52:34.741288 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f82817-8108-450b-ab42-08de97ab4682 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:52:34.742735 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f82817-8108-450b-ab42-08de97ab4682 service neutron] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:52:34.753759 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 745/1487] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:52:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:52:37.124918 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc03f5b-6a6c-433a-b3df-80ac80702110 None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:52:37.125487 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc03f5b-6a6c-433a-b3df-80ac80702110 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:52:37.125487 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc03f5b-6a6c-433a-b3df-80ac80702110 None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:52:37.126939 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 743/1488] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:52:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:52:37.132682 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7d5a45-b96c-4a1b-8a3f-eb85c67c9034 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:52:37.133221 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7d5a45-b96c-4a1b-8a3f-eb85c67c9034 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:52:37.133333 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7d5a45-b96c-4a1b-8a3f-eb85c67c9034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:52:37.156864 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-4c7d5a45-b96c-4a1b-8a3f-eb85c67c9034 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:52:37.158220 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-4c7d5a45-b96c-4a1b-8a3f-eb85c67c9034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:52:37.168243 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 746/1489] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:52:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 17:52:37.213047 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc03f5b-6a6c-433a-b3df-80ac80702110 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:52:37.227166 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc03f5b-6a6c-433a-b3df-80ac80702110 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:52:37.231102 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff488de-3071-4dea-959b-2fe2c1993ac5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5652329c71cd431fb579d69cef933b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:52:37.231805 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff488de-3071-4dea-959b-2fe2c1993ac5 service neutron] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:52:37.232097 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff488de-3071-4dea-959b-2fe2c1993ac5 service neutron] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:52:37.232373 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff488de-3071-4dea-959b-2fe2c1993ac5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:52:37.242109 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff488de-3071-4dea-959b-2fe2c1993ac5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:52:37.243738 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff488de-3071-4dea-959b-2fe2c1993ac5 service neutron] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:52:37.254309 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 744/1490] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:52:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:52:40.369509 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627059b3-45ea-4029-a7f7-2c037a4f1d36 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:52:40.370069 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627059b3-45ea-4029-a7f7-2c037a4f1d36 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:52:40.370069 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627059b3-45ea-4029-a7f7-2c037a4f1d36 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:52:40.371521 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 747/1491] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 14 17:52:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:52:40.377461 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d17e7ff-f5e6-4ada-964b-2659c7d4f73b None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:52:40.378253 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d17e7ff-f5e6-4ada-964b-2659c7d4f73b None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:52:40.378453 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d17e7ff-f5e6-4ada-964b-2659c7d4f73b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:52:40.398417 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-5d17e7ff-f5e6-4ada-964b-2659c7d4f73b None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:52:40.400030 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-5d17e7ff-f5e6-4ada-964b-2659c7d4f73b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:52:40.408460 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 745/1492] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 14 17:52:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:52:40.449993 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627059b3-45ea-4029-a7f7-2c037a4f1d36 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:52:40.461113 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627059b3-45ea-4029-a7f7-2c037a4f1d36 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:52:40.465554 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c123f6-69ed-4303-8f91-74488a0f5a1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5652329c71cd431fb579d69cef933b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:52:40.466224 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c123f6-69ed-4303-8f91-74488a0f5a1c service neutron] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:52:40.466513 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c123f6-69ed-4303-8f91-74488a0f5a1c service neutron] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:52:40.467133 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c123f6-69ed-4303-8f91-74488a0f5a1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:52:40.476693 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c123f6-69ed-4303-8f91-74488a0f5a1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:52:40.479010 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c123f6-69ed-4303-8f91-74488a0f5a1c service neutron] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:52:40.489368 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 748/1493] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:52:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:52:50.392458 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=33 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:52:50.484662 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=33 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:54:24.478052 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc67e63-1589-41d5-856c-d33bc2396b13 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:54:24.478647 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc67e63-1589-41d5-856c-d33bc2396b13 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:54:24.478647 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc67e63-1589-41d5-856c-d33bc2396b13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:54:24.498367 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-acc67e63-1589-41d5-856c-d33bc2396b13 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:54:24.498367 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-acc67e63-1589-41d5-856c-d33bc2396b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:54:24.506294 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 746/1494] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:54:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:54:24.516049 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfc98f5-e160-4b0a-8ac2-be7a22e306dc None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:54:24.516737 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfc98f5-e160-4b0a-8ac2-be7a22e306dc None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:54:24.516737 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfc98f5-e160-4b0a-8ac2-be7a22e306dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:54:24.535736 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-7cfc98f5-e160-4b0a-8ac2-be7a22e306dc None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:54:24.537044 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-7cfc98f5-e160-4b0a-8ac2-be7a22e306dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:54:24.545455 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 749/1495] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:54:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:54:24.550060 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc67e63-1589-41d5-856c-d33bc2396b13 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:54:24.560638 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc67e63-1589-41d5-856c-d33bc2396b13 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:54:24.565283 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70c5f62-50b3-4adf-8e42-3fc6486c98e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:54:24.565941 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70c5f62-50b3-4adf-8e42-3fc6486c98e4 admin admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:54:24.566232 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70c5f62-50b3-4adf-8e42-3fc6486c98e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:54:24.566516 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70c5f62-50b3-4adf-8e42-3fc6486c98e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:54:24.567800 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70c5f62-50b3-4adf-8e42-3fc6486c98e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:54:24.568204 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70c5f62-50b3-4adf-8e42-3fc6486c98e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:54:24.569236 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: WARNING py.warnings [None req-e70c5f62-50b3-4adf-8e42-3fc6486c98e4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 14 17:54:24.569236 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: warnings.warn(msg) Jun 14 17:54:24.569236 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: Jun 14 17:54:24.570145 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70c5f62-50b3-4adf-8e42-3fc6486c98e4 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:54:24.581761 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 747/1496] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 14 17:54:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:54:24.590681 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfc98f5-e160-4b0a-8ac2-be7a22e306dc None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:54:24.599896 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfc98f5-e160-4b0a-8ac2-be7a22e306dc None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:54:24.604490 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59aaf35-a8aa-4b8f-92fa-3760fa7d5551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:54:24.605136 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59aaf35-a8aa-4b8f-92fa-3760fa7d5551 admin admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:54:24.605425 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59aaf35-a8aa-4b8f-92fa-3760fa7d5551 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:54:24.605708 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59aaf35-a8aa-4b8f-92fa-3760fa7d5551 admin admin] PATH_INFO: `/v3/projects` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:54:24.606405 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59aaf35-a8aa-4b8f-92fa-3760fa7d5551 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:54:24.608212 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: WARNING py.warnings [None req-a59aaf35-a8aa-4b8f-92fa-3760fa7d5551 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 14 17:54:24.608212 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: warnings.warn(msg) Jun 14 17:54:24.608212 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: Jun 14 17:54:24.609411 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59aaf35-a8aa-4b8f-92fa-3760fa7d5551 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:54:24.710077 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 750/1497] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 14 17:54:24 2022] POST /identity/v3/projects => generated 379 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:54:24.714594 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70c5f62-50b3-4adf-8e42-3fc6486c98e4 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:54:24.725742 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70c5f62-50b3-4adf-8e42-3fc6486c98e4 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:54:24.783878 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de1ed51-430c-48a7-a1f1-5eada4dc63f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:54:24.784478 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de1ed51-430c-48a7-a1f1-5eada4dc63f2 admin admin] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:54:24.784772 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de1ed51-430c-48a7-a1f1-5eada4dc63f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:54:24.785058 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de1ed51-430c-48a7-a1f1-5eada4dc63f2 admin admin] PATH_INFO: `/v3/users` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:54:24.785823 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de1ed51-430c-48a7-a1f1-5eada4dc63f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:54:24.787435 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: WARNING py.warnings [None req-8de1ed51-430c-48a7-a1f1-5eada4dc63f2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 14 17:54:24.787435 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: warnings.warn(msg) Jun 14 17:54:24.787435 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: Jun 14 17:54:24.788691 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de1ed51-430c-48a7-a1f1-5eada4dc63f2 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:54:24.875624 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 748/1498] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 14 17:54:24 2022] POST /identity/v3/users => generated 290 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 17:54:24.902246 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59aaf35-a8aa-4b8f-92fa-3760fa7d5551 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:54:24.909666 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59aaf35-a8aa-4b8f-92fa-3760fa7d5551 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:54:24.939781 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c81b57-ee3f-4660-9bbc-773667e777be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:54:24.939781 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c81b57-ee3f-4660-9bbc-773667e777be admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:54:24.939781 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c81b57-ee3f-4660-9bbc-773667e777be admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:54:24.939781 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c81b57-ee3f-4660-9bbc-773667e777be admin admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:54:24.940282 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c81b57-ee3f-4660-9bbc-773667e777be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:54:24.940282 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: WARNING py.warnings [None req-a9c81b57-ee3f-4660-9bbc-773667e777be admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 14 17:54:24.940282 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: warnings.warn(msg) Jun 14 17:54:24.940282 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: Jun 14 17:54:24.940282 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c81b57-ee3f-4660-9bbc-773667e777be admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:54:24.940282 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 751/1499] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 17:54:24 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 17:54:24.943635 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de1ed51-430c-48a7-a1f1-5eada4dc63f2 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:54:24.954205 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de1ed51-430c-48a7-a1f1-5eada4dc63f2 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:54:24.960518 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa3b1da-c20f-49bb-b346-ec91fd6ff6f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:54:24.961220 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa3b1da-c20f-49bb-b346-ec91fd6ff6f9 admin admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:54:24.961506 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa3b1da-c20f-49bb-b346-ec91fd6ff6f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:54:24.961785 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa3b1da-c20f-49bb-b346-ec91fd6ff6f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:54:24.962527 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa3b1da-c20f-49bb-b346-ec91fd6ff6f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:54:24.964563 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: WARNING py.warnings [None req-daa3b1da-c20f-49bb-b346-ec91fd6ff6f9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 14 17:54:24.964563 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: warnings.warn(msg) Jun 14 17:54:24.964563 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: Jun 14 17:54:24.965571 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa3b1da-c20f-49bb-b346-ec91fd6ff6f9 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:54:24.981801 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 749/1500] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 17:54:24 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 14 17:54:24.986022 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c81b57-ee3f-4660-9bbc-773667e777be admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:54:24.996923 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c81b57-ee3f-4660-9bbc-773667e777be admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:54:25.001506 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f77ffa-25a2-4662-9552-e3122f717c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:54:25.002415 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f77ffa-25a2-4662-9552-e3122f717c23 admin admin] REQUEST_METHOD: `PUT` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:54:25.002696 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f77ffa-25a2-4662-9552-e3122f717c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:54:25.002976 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f77ffa-25a2-4662-9552-e3122f717c23 admin admin] PATH_INFO: `/v3/projects/dea9bdbf42eb44638178c080371203a5/users/44cc76b5843c46e0a7da594954c10515/roles/9ee80134743f4c2b88525b04df2facba` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:54:25.019039 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f77ffa-25a2-4662-9552-e3122f717c23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dea9bdbf42eb44638178c080371203a5, user_id=44cc76b5843c46e0a7da594954c10515, role_id=9ee80134743f4c2b88525b04df2facba)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:54:25.020146 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: WARNING py.warnings [None req-a5f77ffa-25a2-4662-9552-e3122f717c23 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 14 17:54:25.020146 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: warnings.warn(msg) Jun 14 17:54:25.020146 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: Jun 14 17:54:25.022428 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f77ffa-25a2-4662-9552-e3122f717c23 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:54:25.247238 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 752/1501] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 17:54:24 2022] PUT /identity/v3/projects/dea9bdbf42eb44638178c080371203a5/users/44cc76b5843c46e0a7da594954c10515/roles/9ee80134743f4c2b88525b04df2facba => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:54:25.258510 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4de3cc-8c26-4fb0-b1d1-2d7fc685409c None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:54:25.258805 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4de3cc-8c26-4fb0-b1d1-2d7fc685409c None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:54:25.259095 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4de3cc-8c26-4fb0-b1d1-2d7fc685409c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:54:25.286786 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-3d4de3cc-8c26-4fb0-b1d1-2d7fc685409c None None] MFA Rules not processed for user `44cc76b5843c46e0a7da594954c10515`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:54:25.288163 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-3d4de3cc-8c26-4fb0-b1d1-2d7fc685409c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:54:25.352833 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 750/1502] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:54:25 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:54:25.366663 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2fefd8-c1e8-4aa9-b10c-58f5bec6668b None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:54:25.366963 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2fefd8-c1e8-4aa9-b10c-58f5bec6668b None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:54:25.367250 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2fefd8-c1e8-4aa9-b10c-58f5bec6668b None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:54:25.368709 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 753/1503] 10.222.0.36 () {54 vars in 963 bytes} [Tue Jun 14 17:54:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:54:25.373476 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2dbbd4-af3b-44f7-840b-36c517c6b47c None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:54:25.373771 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2dbbd4-af3b-44f7-840b-36c517c6b47c None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:54:25.374054 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2dbbd4-af3b-44f7-840b-36c517c6b47c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:54:25.393031 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-2e2dbbd4-af3b-44f7-840b-36c517c6b47c None None] MFA Rules not processed for user `17945e7d72954b8787e0ba09a9903247`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:54:25.394235 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-2e2dbbd4-af3b-44f7-840b-36c517c6b47c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:54:25.439622 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:54:25.447256 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 751/1504] 10.222.0.36 () {58 vars in 1060 bytes} [Tue Jun 14 17:54:25 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:54:25.460847 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2fefd8-c1e8-4aa9-b10c-58f5bec6668b None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:54:25.466685 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2fefd8-c1e8-4aa9-b10c-58f5bec6668b None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:54:25.470289 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af38fb87-7ec2-4e95-a642-0959d9548ac2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17945e7d72954b8787e0ba09a9903247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:54:25.470939 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af38fb87-7ec2-4e95-a642-0959d9548ac2 service cinder] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:54:25.471230 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af38fb87-7ec2-4e95-a642-0959d9548ac2 service cinder] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:54:25.471549 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af38fb87-7ec2-4e95-a642-0959d9548ac2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:54:25.481278 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af38fb87-7ec2-4e95-a642-0959d9548ac2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:54:25.482739 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af38fb87-7ec2-4e95-a642-0959d9548ac2 service cinder] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:54:25.492173 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 754/1505] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:54:25 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:54:25.535610 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffb97d3-803e-40af-9801-63a538f676cc None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:54:25.537120 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffb97d3-803e-40af-9801-63a538f676cc None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:54:25.537414 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffb97d3-803e-40af-9801-63a538f676cc None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:54:25.538718 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 752/1506] 10.222.0.36 () {52 vars in 829 bytes} [Tue Jun 14 17:54:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:54:25.542385 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af38fb87-7ec2-4e95-a642-0959d9548ac2 service cinder] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:54:25.606914 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af38fb87-7ec2-4e95-a642-0959d9548ac2 service cinder] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:54:25.611695 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c7fa4f-8221-466b-b762-653c4248ccd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:54:25.617555 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c7fa4f-8221-466b-b762-653c4248ccd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:54:25.617555 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c7fa4f-8221-466b-b762-653c4248ccd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:54:25.617555 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c7fa4f-8221-466b-b762-653c4248ccd8 admin admin] PATH_INFO: `/v3/users/44cc76b5843c46e0a7da594954c10515` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:54:25.617555 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c7fa4f-8221-466b-b762-653c4248ccd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44cc76b5843c46e0a7da594954c10515)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:54:25.617555 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: WARNING py.warnings [None req-94c7fa4f-8221-466b-b762-653c4248ccd8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 14 17:54:25.617555 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: warnings.warn(msg) Jun 14 17:54:25.617555 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: Jun 14 17:54:25.618363 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c7fa4f-8221-466b-b762-653c4248ccd8 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:54:25.847653 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-94c7fa4f-8221-466b-b762-653c4248ccd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44cc76b5843c46e0a7da594954c10515'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:54:25.848778 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-94c7fa4f-8221-466b-b762-653c4248ccd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44cc76b5843c46e0a7da594954c10515'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:54:25.849506 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-94c7fa4f-8221-466b-b762-653c4248ccd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44cc76b5843c46e0a7da594954c10515'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:54:25.960411 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-94c7fa4f-8221-466b-b762-653c4248ccd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44cc76b5843c46e0a7da594954c10515'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:54:25.973220 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-94c7fa4f-8221-466b-b762-653c4248ccd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44cc76b5843c46e0a7da594954c10515'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:54:25.990407 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:54:25.998755 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 755/1507] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 14 17:54:25 2022] DELETE /identity/v3/users/44cc76b5843c46e0a7da594954c10515 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:54:26.003206 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b37a00c-a6eb-4f72-8839-40f2a6e77170 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:54:26.003551 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b37a00c-a6eb-4f72-8839-40f2a6e77170 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:54:26.003835 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b37a00c-a6eb-4f72-8839-40f2a6e77170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:54:26.022845 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-6b37a00c-a6eb-4f72-8839-40f2a6e77170 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:54:26.024037 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-6b37a00c-a6eb-4f72-8839-40f2a6e77170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:54:26.085924 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 753/1508] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:54:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:54:26.095172 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c7fa4f-8221-466b-b762-653c4248ccd8 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:54:26.097026 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-94c7fa4f-8221-466b-b762-653c4248ccd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:54:26.161660 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c7fa4f-8221-466b-b762-653c4248ccd8 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:54:26.165344 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841f6aeb-bee8-4ee0-a0fa-3a6cbbc86c78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5652329c71cd431fb579d69cef933b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:54:26.166006 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841f6aeb-bee8-4ee0-a0fa-3a6cbbc86c78 service neutron] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:54:26.166299 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841f6aeb-bee8-4ee0-a0fa-3a6cbbc86c78 service neutron] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:54:26.166585 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841f6aeb-bee8-4ee0-a0fa-3a6cbbc86c78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:54:26.176064 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841f6aeb-bee8-4ee0-a0fa-3a6cbbc86c78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:54:26.177690 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841f6aeb-bee8-4ee0-a0fa-3a6cbbc86c78 service neutron] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:54:26.187665 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 756/1509] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:54:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:54:26.670683 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b37a00c-a6eb-4f72-8839-40f2a6e77170 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:54:26.672238 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-6b37a00c-a6eb-4f72-8839-40f2a6e77170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:54:26.684988 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b37a00c-a6eb-4f72-8839-40f2a6e77170 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:54:26.689703 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bc4e34-ea5f-40b2-a2b7-190762f50712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:54:26.690639 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc4e34-ea5f-40b2-a2b7-190762f50712 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:54:26.690928 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc4e34-ea5f-40b2-a2b7-190762f50712 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:54:26.691504 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc4e34-ea5f-40b2-a2b7-190762f50712 admin admin] PATH_INFO: `/v3/projects/dea9bdbf42eb44638178c080371203a5` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:54:26.693354 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bc4e34-ea5f-40b2-a2b7-190762f50712 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dea9bdbf42eb44638178c080371203a5)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:54:26.694386 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: WARNING py.warnings [None req-11bc4e34-ea5f-40b2-a2b7-190762f50712 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 14 17:54:26.694386 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: warnings.warn(msg) Jun 14 17:54:26.694386 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: Jun 14 17:54:26.695758 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bc4e34-ea5f-40b2-a2b7-190762f50712 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:54:26.806208 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-11bc4e34-ea5f-40b2-a2b7-190762f50712 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dea9bdbf42eb44638178c080371203a5', 'request_id': 'req-11bc4e34-ea5f-40b2-a2b7-190762f50712'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:54:26.891730 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-11bc4e34-ea5f-40b2-a2b7-190762f50712 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dea9bdbf42eb44638178c080371203a5', 'request_id': 'req-11bc4e34-ea5f-40b2-a2b7-190762f50712'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:54:26.899843 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-11bc4e34-ea5f-40b2-a2b7-190762f50712 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dea9bdbf42eb44638178c080371203a5', 'request_id': 'req-11bc4e34-ea5f-40b2-a2b7-190762f50712'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:54:26.919878 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-11bc4e34-ea5f-40b2-a2b7-190762f50712 admin admin] The token cache is being invalidate because project dea9bdbf42eb44638178c080371203a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 17:54:26.920099 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-11bc4e34-ea5f-40b2-a2b7-190762f50712 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:54:26.920773 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-11bc4e34-ea5f-40b2-a2b7-190762f50712 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:54:26.922427 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 754/1510] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 14 17:54:26 2022] DELETE /identity/v3/projects/dea9bdbf42eb44638178c080371203a5 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:54:36.183061 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:54:36.916320 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:56:08.341358 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354cda64-30af-4c63-9219-521803e79331 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:56:08.341983 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354cda64-30af-4c63-9219-521803e79331 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:56:08.341983 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354cda64-30af-4c63-9219-521803e79331 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:56:08.343416 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 757/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 14 17:56:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:56:08.349335 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab68c32-1303-4cfe-85d7-aa7a7132e5d1 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:56:08.349816 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab68c32-1303-4cfe-85d7-aa7a7132e5d1 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:56:08.349918 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab68c32-1303-4cfe-85d7-aa7a7132e5d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:56:08.370968 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-2ab68c32-1303-4cfe-85d7-aa7a7132e5d1 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:56:08.370968 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-2ab68c32-1303-4cfe-85d7-aa7a7132e5d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:56:08.430013 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 755/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 14 17:56:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:56:08.605746 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354cda64-30af-4c63-9219-521803e79331 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:56:08.607802 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-354cda64-30af-4c63-9219-521803e79331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:56:08.688480 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354cda64-30af-4c63-9219-521803e79331 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:56:08.693952 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70189beb-3740-4775-8d91-41a3f2b74210 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4696d396adb495ab300a9a5a5727595', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:56:08.694598 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70189beb-3740-4775-8d91-41a3f2b74210 service nova] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:56:08.694885 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70189beb-3740-4775-8d91-41a3f2b74210 service nova] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:56:08.695169 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70189beb-3740-4775-8d91-41a3f2b74210 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:56:08.703437 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70189beb-3740-4775-8d91-41a3f2b74210 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:56:08.705034 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70189beb-3740-4775-8d91-41a3f2b74210 service nova] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:56:08.714809 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 758/1513] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:56:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:56:09.614927 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16c5254-e915-455e-81d0-8db2bb0e045e None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:56:09.615480 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16c5254-e915-455e-81d0-8db2bb0e045e None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:56:09.615480 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16c5254-e915-455e-81d0-8db2bb0e045e None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:56:09.616834 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 756/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 14 17:56:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 14 17:56:09.622015 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c410789f-fa84-41de-a2c5-1ec320b179ff None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:56:09.622495 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c410789f-fa84-41de-a2c5-1ec320b179ff None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:56:09.622593 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c410789f-fa84-41de-a2c5-1ec320b179ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:56:09.641578 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-c410789f-fa84-41de-a2c5-1ec320b179ff None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:56:09.642958 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-c410789f-fa84-41de-a2c5-1ec320b179ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:56:09.651658 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 759/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 14 17:56:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:56:09.805816 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16c5254-e915-455e-81d0-8db2bb0e045e None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:56:09.820622 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16c5254-e915-455e-81d0-8db2bb0e045e None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:56:09.826995 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505ae747-4d37-444a-ae62-9bb6676b8e6f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4696d396adb495ab300a9a5a5727595', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:56:09.827781 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ae747-4d37-444a-ae62-9bb6676b8e6f service nova] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:56:09.828136 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ae747-4d37-444a-ae62-9bb6676b8e6f service nova] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:56:09.828482 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ae747-4d37-444a-ae62-9bb6676b8e6f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:56:09.838338 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505ae747-4d37-444a-ae62-9bb6676b8e6f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:56:09.845411 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505ae747-4d37-444a-ae62-9bb6676b8e6f service nova] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:56:09.850926 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 757/1516] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:56:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:56:10.079724 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eb2f3a-5e89-4c79-9bb1-afd3edd4a3be None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:56:10.080048 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eb2f3a-5e89-4c79-9bb1-afd3edd4a3be None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:56:10.080345 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eb2f3a-5e89-4c79-9bb1-afd3edd4a3be None None] PATH_INFO: `/v3` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:56:10.081791 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 760/1517] 10.222.0.62 () {54 vars in 925 bytes} [Tue Jun 14 17:56:10 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:56:10.087682 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019be941-f129-40ea-92ec-012b1d2b31fc None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:56:10.087981 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019be941-f129-40ea-92ec-012b1d2b31fc None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:56:10.092048 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019be941-f129-40ea-92ec-012b1d2b31fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:56:10.108054 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-019be941-f129-40ea-92ec-012b1d2b31fc None None] MFA Rules not processed for user `6a8049f9c66b4b5185c26084fd8239ab`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:56:10.109369 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-019be941-f129-40ea-92ec-012b1d2b31fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:56:10.175695 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 758/1518] 10.222.0.62 () {58 vars in 1015 bytes} [Tue Jun 14 17:56:10 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:56:14.283709 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2935312-4e88-4ef7-84a4-76a503c1db84 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:56:14.284256 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2935312-4e88-4ef7-84a4-76a503c1db84 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:56:14.284256 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2935312-4e88-4ef7-84a4-76a503c1db84 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:56:14.285725 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 761/1519] 10.222.0.36 () {54 vars in 960 bytes} [Tue Jun 14 17:56:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:56:14.291416 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908c9dec-4bd3-488c-b057-a688064bb55f None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:56:14.291885 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908c9dec-4bd3-488c-b057-a688064bb55f None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:56:14.291983 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908c9dec-4bd3-488c-b057-a688064bb55f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:56:14.311688 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-908c9dec-4bd3-488c-b057-a688064bb55f None None] MFA Rules not processed for user `6a8049f9c66b4b5185c26084fd8239ab`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:56:14.312909 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-908c9dec-4bd3-488c-b057-a688064bb55f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:56:14.322413 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 759/1520] 10.222.0.36 () {58 vars in 1057 bytes} [Tue Jun 14 17:56:14 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:56:14.330412 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2935312-4e88-4ef7-84a4-76a503c1db84 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:56:14.344444 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2935312-4e88-4ef7-84a4-76a503c1db84 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:56:14.350030 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1add4fc8-5684-4852-ae04-9f239286fddc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a8049f9c66b4b5185c26084fd8239ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:56:14.350686 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1add4fc8-5684-4852-ae04-9f239286fddc service placement] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:56:14.350977 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1add4fc8-5684-4852-ae04-9f239286fddc service placement] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:56:14.351261 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1add4fc8-5684-4852-ae04-9f239286fddc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:56:14.360105 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1add4fc8-5684-4852-ae04-9f239286fddc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:56:14.361716 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1add4fc8-5684-4852-ae04-9f239286fddc service placement] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:56:14.373315 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 762/1521] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:56:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:56:21.187865 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92363a13-e954-4c69-9d0b-60c4ad83eee6 None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:56:21.188413 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92363a13-e954-4c69-9d0b-60c4ad83eee6 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:56:21.188530 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92363a13-e954-4c69-9d0b-60c4ad83eee6 None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:56:21.189899 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 760/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 14 17:56:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:56:21.196046 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45964b4-5d1d-4db0-b1ca-74b5e81a84c4 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:56:21.196489 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45964b4-5d1d-4db0-b1ca-74b5e81a84c4 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:56:21.196610 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45964b4-5d1d-4db0-b1ca-74b5e81a84c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:56:21.215532 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-c45964b4-5d1d-4db0-b1ca-74b5e81a84c4 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:56:21.216747 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-c45964b4-5d1d-4db0-b1ca-74b5e81a84c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:56:21.225283 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 763/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 14 17:56:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:56:21.389094 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92363a13-e954-4c69-9d0b-60c4ad83eee6 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:56:21.404501 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92363a13-e954-4c69-9d0b-60c4ad83eee6 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:56:21.410671 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1919f65-3cbc-48b5-9c98-e4881d35815b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4696d396adb495ab300a9a5a5727595', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:56:21.411353 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1919f65-3cbc-48b5-9c98-e4881d35815b service nova] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:56:21.411648 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1919f65-3cbc-48b5-9c98-e4881d35815b service nova] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:56:21.411937 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1919f65-3cbc-48b5-9c98-e4881d35815b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:56:21.420619 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1919f65-3cbc-48b5-9c98-e4881d35815b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:56:21.422254 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1919f65-3cbc-48b5-9c98-e4881d35815b service nova] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:56:21.433068 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 761/1524] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:56:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:56:22.310994 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc74323-3650-4ca8-a283-8bfd10efb9a1 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:56:22.311702 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc74323-3650-4ca8-a283-8bfd10efb9a1 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:56:22.311702 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc74323-3650-4ca8-a283-8bfd10efb9a1 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:56:22.312981 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 764/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 14 17:56:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:56:22.317856 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8fe22c-a037-45a0-aebb-3216eca64c89 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:56:22.318280 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8fe22c-a037-45a0-aebb-3216eca64c89 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:56:22.318529 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8fe22c-a037-45a0-aebb-3216eca64c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:56:22.336340 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-8d8fe22c-a037-45a0-aebb-3216eca64c89 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:56:22.337536 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-8d8fe22c-a037-45a0-aebb-3216eca64c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:56:22.345395 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 762/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 14 17:56:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:56:22.508203 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc74323-3650-4ca8-a283-8bfd10efb9a1 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:56:22.523732 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc74323-3650-4ca8-a283-8bfd10efb9a1 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:56:22.529124 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7ff229-3004-4ae6-803c-6c083a489bb0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4696d396adb495ab300a9a5a5727595', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:56:22.529773 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7ff229-3004-4ae6-803c-6c083a489bb0 service nova] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:56:22.530063 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7ff229-3004-4ae6-803c-6c083a489bb0 service nova] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:56:22.530350 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7ff229-3004-4ae6-803c-6c083a489bb0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:56:22.539702 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7ff229-3004-4ae6-803c-6c083a489bb0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:56:22.541314 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7ff229-3004-4ae6-803c-6c083a489bb0 service nova] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:56:22.551720 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 765/1527] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:56:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:56:26.672089 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69839ffd-0fd2-47de-a8e8-e59e5c68cad0 None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:56:26.672683 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69839ffd-0fd2-47de-a8e8-e59e5c68cad0 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:56:26.672683 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69839ffd-0fd2-47de-a8e8-e59e5c68cad0 None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:56:26.674048 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 763/1528] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 14 17:56:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:56:26.681777 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc619f1f-e01e-4e86-a061-d8c7a1599a71 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:56:26.682338 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc619f1f-e01e-4e86-a061-d8c7a1599a71 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:56:26.682449 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc619f1f-e01e-4e86-a061-d8c7a1599a71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:56:26.704906 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-bc619f1f-e01e-4e86-a061-d8c7a1599a71 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:56:26.706878 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-bc619f1f-e01e-4e86-a061-d8c7a1599a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:56:26.714714 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 766/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 14 17:56:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:56:26.751282 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69839ffd-0fd2-47de-a8e8-e59e5c68cad0 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:56:26.753502 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-69839ffd-0fd2-47de-a8e8-e59e5c68cad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:56:26.812369 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69839ffd-0fd2-47de-a8e8-e59e5c68cad0 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:56:26.816692 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a199c2-7d6a-4664-acce-90aef9b95f2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5652329c71cd431fb579d69cef933b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:56:26.817350 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a199c2-7d6a-4664-acce-90aef9b95f2a service neutron] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:56:26.817647 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a199c2-7d6a-4664-acce-90aef9b95f2a service neutron] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:56:26.817933 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a199c2-7d6a-4664-acce-90aef9b95f2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:56:26.828129 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a199c2-7d6a-4664-acce-90aef9b95f2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:56:26.829831 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a199c2-7d6a-4664-acce-90aef9b95f2a service neutron] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:56:26.835837 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:56:26.840705 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 764/1530] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:56:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:56:29.062518 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2866c2ba-da65-46a6-bffa-711a2242ca13 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:56:29.063087 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2866c2ba-da65-46a6-bffa-711a2242ca13 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:56:29.063087 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2866c2ba-da65-46a6-bffa-711a2242ca13 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:56:29.064542 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 767/1531] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 14 17:56:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:56:29.070451 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f5df28-6407-4d20-a818-71b952125ae2 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:56:29.070895 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f5df28-6407-4d20-a818-71b952125ae2 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:56:29.071011 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f5df28-6407-4d20-a818-71b952125ae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:56:29.090077 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-c0f5df28-6407-4d20-a818-71b952125ae2 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:56:29.093397 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-c0f5df28-6407-4d20-a818-71b952125ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:56:29.100072 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 765/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 14 17:56:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:56:29.137649 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2866c2ba-da65-46a6-bffa-711a2242ca13 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:56:29.139373 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-2866c2ba-da65-46a6-bffa-711a2242ca13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:56:29.153435 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2866c2ba-da65-46a6-bffa-711a2242ca13 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:56:29.157016 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d41dab-e0ad-410e-be7b-7497114e1b05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5652329c71cd431fb579d69cef933b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:56:29.157595 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d41dab-e0ad-410e-be7b-7497114e1b05 service neutron] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:56:29.157877 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d41dab-e0ad-410e-be7b-7497114e1b05 service neutron] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:56:29.158156 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d41dab-e0ad-410e-be7b-7497114e1b05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:56:29.167621 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d41dab-e0ad-410e-be7b-7497114e1b05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:56:29.169031 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d41dab-e0ad-410e-be7b-7497114e1b05 service neutron] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:56:29.179477 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 768/1533] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:56:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:56:32.964946 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc5a9ae-c593-44b8-b84d-767b90a1419c None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:56:32.965524 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc5a9ae-c593-44b8-b84d-767b90a1419c None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:56:32.965524 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc5a9ae-c593-44b8-b84d-767b90a1419c None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:56:32.966907 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 766/1534] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 14 17:56:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:56:32.973124 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976723d8-8e5a-472a-b06c-a407fb37df17 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:56:32.973590 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976723d8-8e5a-472a-b06c-a407fb37df17 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:56:32.973708 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976723d8-8e5a-472a-b06c-a407fb37df17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:56:32.992623 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-976723d8-8e5a-472a-b06c-a407fb37df17 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:56:32.993855 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-976723d8-8e5a-472a-b06c-a407fb37df17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:56:33.001941 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 769/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 14 17:56:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:56:33.273638 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc5a9ae-c593-44b8-b84d-767b90a1419c None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:56:33.275370 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-3bc5a9ae-c593-44b8-b84d-767b90a1419c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:56:33.332928 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc5a9ae-c593-44b8-b84d-767b90a1419c None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:56:33.336499 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7569eed2-a9a5-41a4-b4c9-bbbcbf03d411 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17945e7d72954b8787e0ba09a9903247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:56:33.337149 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7569eed2-a9a5-41a4-b4c9-bbbcbf03d411 service cinder] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:56:33.337439 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7569eed2-a9a5-41a4-b4c9-bbbcbf03d411 service cinder] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:56:33.337723 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7569eed2-a9a5-41a4-b4c9-bbbcbf03d411 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:56:33.347540 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7569eed2-a9a5-41a4-b4c9-bbbcbf03d411 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:56:33.348975 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7569eed2-a9a5-41a4-b4c9-bbbcbf03d411 service cinder] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:56:33.358746 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 767/1536] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:56:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:56:35.542371 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6bf8e2-d349-488c-9cf5-3675928019ee None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:56:35.542955 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6bf8e2-d349-488c-9cf5-3675928019ee None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:56:35.542955 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6bf8e2-d349-488c-9cf5-3675928019ee None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:56:35.544365 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 770/1537] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 14 17:56:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:56:35.550289 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98445c6e-9a16-4f88-a968-46e890e082d6 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:56:35.550740 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98445c6e-9a16-4f88-a968-46e890e082d6 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:56:35.551048 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98445c6e-9a16-4f88-a968-46e890e082d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:56:35.571489 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-98445c6e-9a16-4f88-a968-46e890e082d6 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:56:35.572994 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-98445c6e-9a16-4f88-a968-46e890e082d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:56:35.581662 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 768/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 14 17:56:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:56:35.855894 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6bf8e2-d349-488c-9cf5-3675928019ee None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:56:35.857557 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-fb6bf8e2-d349-488c-9cf5-3675928019ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:56:35.871401 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6bf8e2-d349-488c-9cf5-3675928019ee None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:56:35.874921 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4064f87-37f1-444f-bfe2-5522ee3839a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17945e7d72954b8787e0ba09a9903247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:56:35.875602 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4064f87-37f1-444f-bfe2-5522ee3839a2 service cinder] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:56:35.875892 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4064f87-37f1-444f-bfe2-5522ee3839a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:56:35.876176 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4064f87-37f1-444f-bfe2-5522ee3839a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:56:35.885834 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4064f87-37f1-444f-bfe2-5522ee3839a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:56:35.887647 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4064f87-37f1-444f-bfe2-5522ee3839a2 service cinder] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:56:35.898024 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 771/1539] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:56:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:56:45.563709 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=32 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:56:45.892994 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=70 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:58:04.712750 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d371a097-3257-47ec-a4c1-75a220239454 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:04.714642 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d371a097-3257-47ec-a4c1-75a220239454 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:04.714642 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d371a097-3257-47ec-a4c1-75a220239454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:04.737073 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-d371a097-3257-47ec-a4c1-75a220239454 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:58:04.738900 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-d371a097-3257-47ec-a4c1-75a220239454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:04.755171 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 769/1540] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:58:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:58:04.766340 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afa387e-0b19-433d-9653-13c6b2cfbf23 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:04.766967 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afa387e-0b19-433d-9653-13c6b2cfbf23 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:04.766967 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afa387e-0b19-433d-9653-13c6b2cfbf23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:04.796538 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-5afa387e-0b19-433d-9653-13c6b2cfbf23 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:58:04.797779 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-5afa387e-0b19-433d-9653-13c6b2cfbf23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:04.812065 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 772/1541] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:58:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 17:58:04.817701 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d371a097-3257-47ec-a4c1-75a220239454 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:04.832579 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d371a097-3257-47ec-a4c1-75a220239454 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:04.843114 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0353066-4e8e-40d4-8be5-913cfe8323ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:04.844232 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0353066-4e8e-40d4-8be5-913cfe8323ad admin admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:04.844785 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0353066-4e8e-40d4-8be5-913cfe8323ad admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:04.845286 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0353066-4e8e-40d4-8be5-913cfe8323ad admin admin] PATH_INFO: `/v3/domains` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:04.846259 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0353066-4e8e-40d4-8be5-913cfe8323ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:58:04.846802 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0353066-4e8e-40d4-8be5-913cfe8323ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:04.848720 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0353066-4e8e-40d4-8be5-913cfe8323ad admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:04.871899 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 770/1542] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 14 17:58:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:58:04.880579 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afa387e-0b19-433d-9653-13c6b2cfbf23 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:04.893890 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afa387e-0b19-433d-9653-13c6b2cfbf23 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:04.903994 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70db462f-8d9e-4d23-a3a1-6c1e755f353a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:04.905227 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db462f-8d9e-4d23-a3a1-6c1e755f353a admin admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:04.905519 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db462f-8d9e-4d23-a3a1-6c1e755f353a admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:04.906524 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db462f-8d9e-4d23-a3a1-6c1e755f353a admin admin] PATH_INFO: `/v3/projects` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:04.906704 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70db462f-8d9e-4d23-a3a1-6c1e755f353a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:04.908732 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70db462f-8d9e-4d23-a3a1-6c1e755f353a admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:05.023841 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedd4d78-ec42-444e-a95e-11f851776615 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:05.024203 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedd4d78-ec42-444e-a95e-11f851776615 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:05.024389 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedd4d78-ec42-444e-a95e-11f851776615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:05.046768 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 773/1543] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 14 17:58:04 2022] POST /identity/v3/projects => generated 367 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:58:05.048139 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fa0dc0-0e6a-40e5-b4a0-53e823a5741f None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:05.048433 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fa0dc0-0e6a-40e5-b4a0-53e823a5741f None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:05.048727 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fa0dc0-0e6a-40e5-b4a0-53e823a5741f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:05.071111 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-eedd4d78-ec42-444e-a95e-11f851776615 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:58:05.074455 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-eedd4d78-ec42-444e-a95e-11f851776615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:05.097744 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-d7fa0dc0-0e6a-40e5-b4a0-53e823a5741f None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:58:05.099127 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-d7fa0dc0-0e6a-40e5-b4a0-53e823a5741f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:05.153310 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 771/1544] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:58:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 17:58:05.154824 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b747bb4a-2d25-49f2-bcc1-a01e3d9dd556 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:05.155119 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b747bb4a-2d25-49f2-bcc1-a01e3d9dd556 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:05.155436 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b747bb4a-2d25-49f2-bcc1-a01e3d9dd556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:05.166198 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 774/1545] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:58:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:58:05.167039 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fa0dc0-0e6a-40e5-b4a0-53e823a5741f None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:05.178256 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fa0dc0-0e6a-40e5-b4a0-53e823a5741f None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:05.182306 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-b747bb4a-2d25-49f2-bcc1-a01e3d9dd556 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:58:05.183173 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cbbf7b-29f5-4c97-82e9-6d9f3832af3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:05.183557 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-b747bb4a-2d25-49f2-bcc1-a01e3d9dd556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:05.183887 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cbbf7b-29f5-4c97-82e9-6d9f3832af3d admin admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:05.184177 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cbbf7b-29f5-4c97-82e9-6d9f3832af3d admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:05.184463 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cbbf7b-29f5-4c97-82e9-6d9f3832af3d admin admin] PATH_INFO: `/v3/users` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:05.185161 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cbbf7b-29f5-4c97-82e9-6d9f3832af3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:05.186824 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: WARNING py.warnings [None req-e1cbbf7b-29f5-4c97-82e9-6d9f3832af3d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 14 17:58:05.186824 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: warnings.warn(msg) Jun 14 17:58:05.186824 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: Jun 14 17:58:05.188106 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cbbf7b-29f5-4c97-82e9-6d9f3832af3d admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:05.192571 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 772/1546] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:58:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:58:05.202455 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9351bc9b-a901-4a83-86b8-1bc2dfd26a0c None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:05.202455 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9351bc9b-a901-4a83-86b8-1bc2dfd26a0c None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:05.202455 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9351bc9b-a901-4a83-86b8-1bc2dfd26a0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:05.213272 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-9351bc9b-a901-4a83-86b8-1bc2dfd26a0c None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:58:05.214487 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-9351bc9b-a901-4a83-86b8-1bc2dfd26a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:05.222961 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 773/1547] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:58:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:58:05.224200 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a01f803-fa4b-4a8f-b5f4-2214ba3057a3 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:05.224493 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a01f803-fa4b-4a8f-b5f4-2214ba3057a3 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:05.224822 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a01f803-fa4b-4a8f-b5f4-2214ba3057a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:05.243782 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-9a01f803-fa4b-4a8f-b5f4-2214ba3057a3 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:58:05.245032 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-9a01f803-fa4b-4a8f-b5f4-2214ba3057a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:05.253767 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 774/1548] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:58:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:58:05.261961 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb563ee-b094-4d28-8b0e-139824a6948b None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:05.261961 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb563ee-b094-4d28-8b0e-139824a6948b None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:05.261961 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb563ee-b094-4d28-8b0e-139824a6948b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:05.274504 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-bdb563ee-b094-4d28-8b0e-139824a6948b None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:58:05.275749 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-bdb563ee-b094-4d28-8b0e-139824a6948b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:05.284188 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 775/1549] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:58:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:58:05.285421 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fba476-a79b-4878-a3f8-b5a2b4024e96 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:05.285718 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fba476-a79b-4878-a3f8-b5a2b4024e96 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:05.286004 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fba476-a79b-4878-a3f8-b5a2b4024e96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:05.289862 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 775/1550] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 14 17:58:05 2022] POST /identity/v3/users => generated 284 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:58:05.289862 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f0166-394f-49e7-8aaa-390523e1892c None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:05.289862 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f0166-394f-49e7-8aaa-390523e1892c None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:05.289862 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f0166-394f-49e7-8aaa-390523e1892c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:05.309694 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-a14f0166-394f-49e7-8aaa-390523e1892c None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:58:05.316074 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-77fba476-a79b-4878-a3f8-b5a2b4024e96 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:58:05.316263 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-a14f0166-394f-49e7-8aaa-390523e1892c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:05.316360 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-77fba476-a79b-4878-a3f8-b5a2b4024e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:05.319757 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 776/1551] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:58:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:58:05.320227 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 776/1552] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:58:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:58:05.321482 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1622504e-9ab2-4fff-8047-f049ccde00ad None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:05.321782 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1622504e-9ab2-4fff-8047-f049ccde00ad None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:05.322066 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1622504e-9ab2-4fff-8047-f049ccde00ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:05.325088 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb77bea6-ee83-4006-8ffe-cb69765ec619 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:05.325385 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb77bea6-ee83-4006-8ffe-cb69765ec619 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:05.325675 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb77bea6-ee83-4006-8ffe-cb69765ec619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:05.341130 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-1622504e-9ab2-4fff-8047-f049ccde00ad None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:58:05.342954 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-1622504e-9ab2-4fff-8047-f049ccde00ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:05.346038 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-cb77bea6-ee83-4006-8ffe-cb69765ec619 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:58:05.347220 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-cb77bea6-ee83-4006-8ffe-cb69765ec619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:05.352687 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 777/1553] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:58:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:58:05.354020 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3fb972-e796-4197-90e6-1b542ebf2a5b None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:05.354317 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3fb972-e796-4197-90e6-1b542ebf2a5b None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:05.354597 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3fb972-e796-4197-90e6-1b542ebf2a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:05.363038 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 777/1554] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:58:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:58:05.363038 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88462ce0-0483-4cea-ac0b-acd22ffad3a3 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:05.363038 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88462ce0-0483-4cea-ac0b-acd22ffad3a3 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:05.363038 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88462ce0-0483-4cea-ac0b-acd22ffad3a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:05.374331 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-be3fb972-e796-4197-90e6-1b542ebf2a5b None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:58:05.375573 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-be3fb972-e796-4197-90e6-1b542ebf2a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:05.383759 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 778/1555] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:58:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:58:05.384652 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3fb972-e796-4197-90e6-1b542ebf2a5b None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:05.385695 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-88462ce0-0483-4cea-ac0b-acd22ffad3a3 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:58:05.387147 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-88462ce0-0483-4cea-ac0b-acd22ffad3a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:05.394811 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3fb972-e796-4197-90e6-1b542ebf2a5b None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:05.396457 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 778/1556] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:58:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:58:05.397779 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb72cbec-9511-4aad-9d45-b7f216db99a8 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:05.398074 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb72cbec-9511-4aad-9d45-b7f216db99a8 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:05.398357 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb72cbec-9511-4aad-9d45-b7f216db99a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:05.403048 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbc6025-8e77-4a50-9710-021c4c04f504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:05.403829 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbc6025-8e77-4a50-9710-021c4c04f504 admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:05.404066 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbc6025-8e77-4a50-9710-021c4c04f504 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:05.404892 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbc6025-8e77-4a50-9710-021c4c04f504 admin admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:05.405753 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbc6025-8e77-4a50-9710-021c4c04f504 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:05.407412 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbc6025-8e77-4a50-9710-021c4c04f504 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:05.422421 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 779/1557] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 17:58:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 17:58:05.422637 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-eb72cbec-9511-4aad-9d45-b7f216db99a8 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:58:05.422752 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbc6025-8e77-4a50-9710-021c4c04f504 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:05.422855 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-eb72cbec-9511-4aad-9d45-b7f216db99a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:05.430468 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 779/1558] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:58:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:58:05.431767 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d57e6a-84c3-4f91-85f2-8a5b7c9aa1e9 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:05.432065 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d57e6a-84c3-4f91-85f2-8a5b7c9aa1e9 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:05.432181 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbc6025-8e77-4a50-9710-021c4c04f504 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:05.432447 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d57e6a-84c3-4f91-85f2-8a5b7c9aa1e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:05.437360 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df10d150-85f5-4902-b73c-5c5698317f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:05.438213 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df10d150-85f5-4902-b73c-5c5698317f47 admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:05.438499 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df10d150-85f5-4902-b73c-5c5698317f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:05.438810 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df10d150-85f5-4902-b73c-5c5698317f47 admin admin] PATH_INFO: `/v3/domains` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:05.439573 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df10d150-85f5-4902-b73c-5c5698317f47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:58:05.439892 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df10d150-85f5-4902-b73c-5c5698317f47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:05.440937 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: WARNING py.warnings [None req-df10d150-85f5-4902-b73c-5c5698317f47 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 14 17:58:05.440937 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: warnings.warn(msg) Jun 14 17:58:05.440937 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: Jun 14 17:58:05.441938 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df10d150-85f5-4902-b73c-5c5698317f47 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:05.452033 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-57d57e6a-84c3-4f91-85f2-8a5b7c9aa1e9 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:58:05.453265 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-57d57e6a-84c3-4f91-85f2-8a5b7c9aa1e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:05.454816 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 780/1559] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 14 17:58:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:58:05.455751 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df10d150-85f5-4902-b73c-5c5698317f47 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:05.464478 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 780/1560] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:58:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:58:05.465558 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d57e6a-84c3-4f91-85f2-8a5b7c9aa1e9 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:05.468622 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df10d150-85f5-4902-b73c-5c5698317f47 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:05.474049 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2fe371-41ec-419c-9a45-b497ce2fc8f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:05.474724 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2fe371-41ec-419c-9a45-b497ce2fc8f1 admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:05.475014 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2fe371-41ec-419c-9a45-b497ce2fc8f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:05.475314 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2fe371-41ec-419c-9a45-b497ce2fc8f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:05.476116 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2fe371-41ec-419c-9a45-b497ce2fc8f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:58:05.476244 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d57e6a-84c3-4f91-85f2-8a5b7c9aa1e9 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:05.476431 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2fe371-41ec-419c-9a45-b497ce2fc8f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:05.478097 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2fe371-41ec-419c-9a45-b497ce2fc8f1 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:05.481662 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1287f6-3def-4c48-9a0f-3753ccf82ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:05.482970 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1287f6-3def-4c48-9a0f-3753ccf82ffd admin admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:05.483269 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1287f6-3def-4c48-9a0f-3753ccf82ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:05.483585 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1287f6-3def-4c48-9a0f-3753ccf82ffd admin admin] PATH_INFO: `/v3/domains` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:05.484351 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1287f6-3def-4c48-9a0f-3753ccf82ffd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:58:05.484668 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1287f6-3def-4c48-9a0f-3753ccf82ffd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:05.486820 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1287f6-3def-4c48-9a0f-3753ccf82ffd admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:05.491216 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 781/1561] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 14 17:58:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:58:05.492140 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2fe371-41ec-419c-9a45-b497ce2fc8f1 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:05.502396 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2fe371-41ec-419c-9a45-b497ce2fc8f1 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:05.503098 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 781/1562] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 14 17:58:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:58:05.504060 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1287f6-3def-4c48-9a0f-3753ccf82ffd admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:05.507241 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd04ac6d-a663-4779-9fb6-d6a139ae3b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:05.507940 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd04ac6d-a663-4779-9fb6-d6a139ae3b04 admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:05.508232 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd04ac6d-a663-4779-9fb6-d6a139ae3b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:05.508517 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd04ac6d-a663-4779-9fb6-d6a139ae3b04 admin admin] PATH_INFO: `/v3/domains` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:05.509249 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd04ac6d-a663-4779-9fb6-d6a139ae3b04 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:58:05.509563 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd04ac6d-a663-4779-9fb6-d6a139ae3b04 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:05.511224 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd04ac6d-a663-4779-9fb6-d6a139ae3b04 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:05.515890 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1287f6-3def-4c48-9a0f-3753ccf82ffd admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:05.520976 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cdb06b-3275-4dc2-a09f-c499660a96df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:05.521641 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cdb06b-3275-4dc2-a09f-c499660a96df admin admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:05.521934 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cdb06b-3275-4dc2-a09f-c499660a96df admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:05.522234 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cdb06b-3275-4dc2-a09f-c499660a96df admin admin] PATH_INFO: `/v3/domains` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:05.522935 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cdb06b-3275-4dc2-a09f-c499660a96df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:58:05.523244 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cdb06b-3275-4dc2-a09f-c499660a96df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:05.524579 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 782/1563] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 14 17:58:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:58:05.524886 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cdb06b-3275-4dc2-a09f-c499660a96df admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:05.525422 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd04ac6d-a663-4779-9fb6-d6a139ae3b04 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:05.536312 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd04ac6d-a663-4779-9fb6-d6a139ae3b04 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:05.541111 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e38ea0-911c-407c-b9e8-c31fb7104fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:05.541789 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e38ea0-911c-407c-b9e8-c31fb7104fc8 admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:05.542081 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e38ea0-911c-407c-b9e8-c31fb7104fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:05.542365 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e38ea0-911c-407c-b9e8-c31fb7104fc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:05.543242 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e38ea0-911c-407c-b9e8-c31fb7104fc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:05.544876 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e38ea0-911c-407c-b9e8-c31fb7104fc8 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:05.546615 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 782/1564] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 14 17:58:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:58:05.548709 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cdb06b-3275-4dc2-a09f-c499660a96df admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:05.556240 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 783/1565] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 17:58:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 17:58:05.557116 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e38ea0-911c-407c-b9e8-c31fb7104fc8 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:05.559454 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cdb06b-3275-4dc2-a09f-c499660a96df admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:05.564227 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca5421b-e9a5-4714-870f-6f8e3b1213a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:05.564896 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca5421b-e9a5-4714-870f-6f8e3b1213a7 admin admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:05.565319 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca5421b-e9a5-4714-870f-6f8e3b1213a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:05.565613 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca5421b-e9a5-4714-870f-6f8e3b1213a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:05.566430 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca5421b-e9a5-4714-870f-6f8e3b1213a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:58:05.566748 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca5421b-e9a5-4714-870f-6f8e3b1213a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:05.567263 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e38ea0-911c-407c-b9e8-c31fb7104fc8 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:05.568388 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca5421b-e9a5-4714-870f-6f8e3b1213a7 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:05.572659 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30714ba-5ede-434e-b169-03fdf0a60cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:05.573525 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30714ba-5ede-434e-b169-03fdf0a60cb5 admin admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:05.573991 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30714ba-5ede-434e-b169-03fdf0a60cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:05.574450 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30714ba-5ede-434e-b169-03fdf0a60cb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:05.575514 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30714ba-5ede-434e-b169-03fdf0a60cb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:05.578586 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30714ba-5ede-434e-b169-03fdf0a60cb5 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:05.581659 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 783/1566] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 14 17:58:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:58:05.582593 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca5421b-e9a5-4714-870f-6f8e3b1213a7 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:05.593573 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca5421b-e9a5-4714-870f-6f8e3b1213a7 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:05.598454 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72274ee-d575-43c4-a8f6-47bffc75e1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:05.599124 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72274ee-d575-43c4-a8f6-47bffc75e1a8 admin admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:05.599449 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72274ee-d575-43c4-a8f6-47bffc75e1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:05.599735 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72274ee-d575-43c4-a8f6-47bffc75e1a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:05.600524 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72274ee-d575-43c4-a8f6-47bffc75e1a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:58:05.600877 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72274ee-d575-43c4-a8f6-47bffc75e1a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:05.602488 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72274ee-d575-43c4-a8f6-47bffc75e1a8 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:05.615815 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 784/1567] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 14 17:58:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:58:05.624136 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72274ee-d575-43c4-a8f6-47bffc75e1a8 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:05.627620 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72274ee-d575-43c4-a8f6-47bffc75e1a8 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:05.632488 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6cfd9a-58ef-4266-aa2c-ababdf479227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:05.633153 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6cfd9a-58ef-4266-aa2c-ababdf479227 admin admin] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:05.633444 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6cfd9a-58ef-4266-aa2c-ababdf479227 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:05.633729 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6cfd9a-58ef-4266-aa2c-ababdf479227 admin admin] PATH_INFO: `/v3/projects` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:05.634425 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6cfd9a-58ef-4266-aa2c-ababdf479227 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:05.635512 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: WARNING py.warnings [None req-2a6cfd9a-58ef-4266-aa2c-ababdf479227 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 14 17:58:05.635512 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: warnings.warn(msg) Jun 14 17:58:05.635512 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: Jun 14 17:58:05.636705 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6cfd9a-58ef-4266-aa2c-ababdf479227 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:05.679617 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 784/1568] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 14 17:58:05 2022] POST /identity/v3/projects => generated 387 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:58:05.680474 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30714ba-5ede-434e-b169-03fdf0a60cb5 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:05.693366 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:58:05.736785 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 785/1569] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 14 17:58:05 2022] POST /identity/v3/projects => generated 373 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:58:05.740703 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6cfd9a-58ef-4266-aa2c-ababdf479227 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:05.744075 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30714ba-5ede-434e-b169-03fdf0a60cb5 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:05.749625 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:58:05.803484 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e946d3-0530-405f-b43e-b1607560a21f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:05.804164 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6cfd9a-58ef-4266-aa2c-ababdf479227 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:05.804273 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e946d3-0530-405f-b43e-b1607560a21f admin admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:05.804468 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e946d3-0530-405f-b43e-b1607560a21f admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:05.804782 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e946d3-0530-405f-b43e-b1607560a21f admin admin] PATH_INFO: `/v3/projects` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:05.805480 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e946d3-0530-405f-b43e-b1607560a21f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:05.807516 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e946d3-0530-405f-b43e-b1607560a21f admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:05.808684 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca377d3-3fe4-482e-a323-e53b62ec62e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:05.809313 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca377d3-3fe4-482e-a323-e53b62ec62e9 admin admin] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:05.809602 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca377d3-3fe4-482e-a323-e53b62ec62e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:05.809886 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca377d3-3fe4-482e-a323-e53b62ec62e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:05.810939 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca377d3-3fe4-482e-a323-e53b62ec62e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:05.812896 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca377d3-3fe4-482e-a323-e53b62ec62e9 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:05.880176 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 785/1570] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 14 17:58:05 2022] POST /identity/v3/projects => generated 363 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:58:05.881003 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e946d3-0530-405f-b43e-b1607560a21f admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:05.910525 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 786/1571] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 14 17:58:05 2022] POST /identity/v3/projects => generated 379 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:58:05.911436 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca377d3-3fe4-482e-a323-e53b62ec62e9 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:05.948112 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e946d3-0530-405f-b43e-b1607560a21f admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:05.981996 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca377d3-3fe4-482e-a323-e53b62ec62e9 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:05.987158 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618d7edc-7e9f-43a6-890a-5f31220cb799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:05.988098 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618d7edc-7e9f-43a6-890a-5f31220cb799 admin admin] REQUEST_METHOD: `PUT` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:05.988443 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618d7edc-7e9f-43a6-890a-5f31220cb799 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:05.988669 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618d7edc-7e9f-43a6-890a-5f31220cb799 admin admin] PATH_INFO: `/v3/projects/c13307b3a9c44b75a6558dbbee0ee07f/users/53322a6fc323412890fdd3d7d269b59d/roles/9ee80134743f4c2b88525b04df2facba` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:05.999806 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:58:06.005482 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618d7edc-7e9f-43a6-890a-5f31220cb799 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c13307b3a9c44b75a6558dbbee0ee07f, user_id=53322a6fc323412890fdd3d7d269b59d, role_id=9ee80134743f4c2b88525b04df2facba)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:06.006664 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: WARNING py.warnings [None req-618d7edc-7e9f-43a6-890a-5f31220cb799 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 14 17:58:06.006664 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: warnings.warn(msg) Jun 14 17:58:06.006664 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: Jun 14 17:58:06.008879 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618d7edc-7e9f-43a6-890a-5f31220cb799 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:06.009629 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6bc4ee-cc50-4693-a14b-c2849b65652d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:06.010333 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6bc4ee-cc50-4693-a14b-c2849b65652d admin admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:06.010590 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6bc4ee-cc50-4693-a14b-c2849b65652d admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:06.010946 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6bc4ee-cc50-4693-a14b-c2849b65652d admin admin] PATH_INFO: `/v3/projects` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:06.011789 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6bc4ee-cc50-4693-a14b-c2849b65652d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:06.014211 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6bc4ee-cc50-4693-a14b-c2849b65652d admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:06.130714 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 787/1572] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 17:58:05 2022] PUT /identity/v3/projects/c13307b3a9c44b75a6558dbbee0ee07f/users/53322a6fc323412890fdd3d7d269b59d/roles/9ee80134743f4c2b88525b04df2facba => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:58:06.131714 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618d7edc-7e9f-43a6-890a-5f31220cb799 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:06.162835 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 786/1573] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 14 17:58:05 2022] POST /identity/v3/projects => generated 383 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:58:06.168721 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6bc4ee-cc50-4693-a14b-c2849b65652d admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:06.212290 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618d7edc-7e9f-43a6-890a-5f31220cb799 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:06.238075 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6bc4ee-cc50-4693-a14b-c2849b65652d admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:06.240065 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:58:06.242872 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5c8942-bc25-4b6c-a035-f673718c115b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:06.243580 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5c8942-bc25-4b6c-a035-f673718c115b admin admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:06.243869 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5c8942-bc25-4b6c-a035-f673718c115b admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:06.244148 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5c8942-bc25-4b6c-a035-f673718c115b admin admin] PATH_INFO: `/v3/projects` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:06.244837 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5c8942-bc25-4b6c-a035-f673718c115b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:06.246777 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5c8942-bc25-4b6c-a035-f673718c115b admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:06.293331 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dd96b0-1520-48e9-84b2-433b084f2edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:06.294024 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dd96b0-1520-48e9-84b2-433b084f2edb admin admin] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:06.294315 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dd96b0-1520-48e9-84b2-433b084f2edb admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:06.294602 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dd96b0-1520-48e9-84b2-433b084f2edb admin admin] PATH_INFO: `/v3/projects` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:06.295365 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dd96b0-1520-48e9-84b2-433b084f2edb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:06.297589 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dd96b0-1520-48e9-84b2-433b084f2edb admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:06.350185 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 787/1574] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 14 17:58:06 2022] POST /identity/v3/projects => generated 377 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:58:06.350818 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5c8942-bc25-4b6c-a035-f673718c115b admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:06.405542 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 788/1575] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 14 17:58:06 2022] POST /identity/v3/projects => generated 405 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:58:06.405542 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dd96b0-1520-48e9-84b2-433b084f2edb admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:06.414587 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5c8942-bc25-4b6c-a035-f673718c115b admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:06.470104 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dd96b0-1520-48e9-84b2-433b084f2edb admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:06.475093 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb45d438-e19b-4f25-a7ed-5b93f5105c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:06.475672 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4b8ecd-ba40-4729-a47d-5babce2e6da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:06.475806 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb45d438-e19b-4f25-a7ed-5b93f5105c4b admin admin] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:06.476087 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb45d438-e19b-4f25-a7ed-5b93f5105c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:06.476347 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4b8ecd-ba40-4729-a47d-5babce2e6da5 admin admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:06.476463 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb45d438-e19b-4f25-a7ed-5b93f5105c4b admin admin] PATH_INFO: `/v3/users` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:06.476641 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4b8ecd-ba40-4729-a47d-5babce2e6da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:06.476923 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4b8ecd-ba40-4729-a47d-5babce2e6da5 admin admin] PATH_INFO: `/v3/users` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:06.477055 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb45d438-e19b-4f25-a7ed-5b93f5105c4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:06.477608 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4b8ecd-ba40-4729-a47d-5babce2e6da5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:06.478979 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb45d438-e19b-4f25-a7ed-5b93f5105c4b admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:06.479530 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4b8ecd-ba40-4729-a47d-5babce2e6da5 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:06.575642 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:58:06.582032 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 788/1576] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 14 17:58:06 2022] POST /identity/v3/users => generated 294 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:58:06.582997 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4b8ecd-ba40-4729-a47d-5babce2e6da5 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:06.593500 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4b8ecd-ba40-4729-a47d-5babce2e6da5 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:06.598329 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0d6ca7-8308-4cd3-8e21-9b11282cce46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:06.598998 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0d6ca7-8308-4cd3-8e21-9b11282cce46 admin admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:06.599309 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0d6ca7-8308-4cd3-8e21-9b11282cce46 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:06.599609 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0d6ca7-8308-4cd3-8e21-9b11282cce46 admin admin] PATH_INFO: `/v3/users` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:06.600304 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0d6ca7-8308-4cd3-8e21-9b11282cce46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:06.602374 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0d6ca7-8308-4cd3-8e21-9b11282cce46 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:06.610230 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 789/1577] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 14 17:58:06 2022] POST /identity/v3/users => generated 287 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:58:06.611172 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb45d438-e19b-4f25-a7ed-5b93f5105c4b admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:06.621520 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb45d438-e19b-4f25-a7ed-5b93f5105c4b admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:06.627077 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc361d0e-d78b-4c56-9677-4c603a87cda1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:06.627784 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc361d0e-d78b-4c56-9677-4c603a87cda1 admin admin] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:06.628098 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc361d0e-d78b-4c56-9677-4c603a87cda1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:06.628352 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc361d0e-d78b-4c56-9677-4c603a87cda1 admin admin] PATH_INFO: `/v3/users` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:06.629038 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc361d0e-d78b-4c56-9677-4c603a87cda1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:06.630942 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc361d0e-d78b-4c56-9677-4c603a87cda1 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:06.708900 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 789/1578] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 14 17:58:06 2022] POST /identity/v3/users => generated 282 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:58:06.710330 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22ab37c-9cff-41d3-bfb2-d0af7e06ae84 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:06.710626 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22ab37c-9cff-41d3-bfb2-d0af7e06ae84 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:06.710909 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22ab37c-9cff-41d3-bfb2-d0af7e06ae84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:06.738039 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-e22ab37c-9cff-41d3-bfb2-d0af7e06ae84 None None] MFA Rules not processed for user `53322a6fc323412890fdd3d7d269b59d`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:58:06.739213 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-e22ab37c-9cff-41d3-bfb2-d0af7e06ae84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:06.758221 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 790/1579] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 14 17:58:06 2022] POST /identity/v3/users => generated 290 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:58:06.758221 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc361d0e-d78b-4c56-9677-4c603a87cda1 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:06.766487 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc361d0e-d78b-4c56-9677-4c603a87cda1 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:06.771314 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1a357e-3435-47d7-9140-656a5fd35c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:06.772338 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a357e-3435-47d7-9140-656a5fd35c19 admin admin] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:06.772338 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a357e-3435-47d7-9140-656a5fd35c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:06.772644 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a357e-3435-47d7-9140-656a5fd35c19 admin admin] PATH_INFO: `/v3/users` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:06.773341 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1a357e-3435-47d7-9140-656a5fd35c19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:06.775271 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1a357e-3435-47d7-9140-656a5fd35c19 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:06.808631 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 790/1580] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:58:06 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:58:06.809478 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22ab37c-9cff-41d3-bfb2-d0af7e06ae84 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:06.820569 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22ab37c-9cff-41d3-bfb2-d0af7e06ae84 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:06.825228 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60194f6-a39e-4f97-b122-2537402bf60d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:06.825895 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60194f6-a39e-4f97-b122-2537402bf60d admin admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:06.826182 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60194f6-a39e-4f97-b122-2537402bf60d admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:06.826464 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60194f6-a39e-4f97-b122-2537402bf60d admin admin] PATH_INFO: `/v3/users` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:06.827179 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60194f6-a39e-4f97-b122-2537402bf60d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:06.829326 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60194f6-a39e-4f97-b122-2537402bf60d admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:06.868090 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 791/1581] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 14 17:58:06 2022] POST /identity/v3/users => generated 292 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:58:06.868920 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1a357e-3435-47d7-9140-656a5fd35c19 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:06.879243 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1a357e-3435-47d7-9140-656a5fd35c19 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:06.884043 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd3d09b-70ce-48de-99b8-d79ced1e969e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:06.884715 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd3d09b-70ce-48de-99b8-d79ced1e969e admin admin] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:06.885000 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd3d09b-70ce-48de-99b8-d79ced1e969e admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:06.885284 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd3d09b-70ce-48de-99b8-d79ced1e969e admin admin] PATH_INFO: `/v3/users` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:06.885975 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd3d09b-70ce-48de-99b8-d79ced1e969e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:06.887969 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd3d09b-70ce-48de-99b8-d79ced1e969e admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:06.952637 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 791/1582] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 14 17:58:06 2022] POST /identity/v3/users => generated 289 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:58:06.953968 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60194f6-a39e-4f97-b122-2537402bf60d admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:06.963634 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60194f6-a39e-4f97-b122-2537402bf60d admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:06.968749 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b41d79-6fa9-445a-933f-ceaf866aff0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:06.970174 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b41d79-6fa9-445a-933f-ceaf866aff0c admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:06.970454 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b41d79-6fa9-445a-933f-ceaf866aff0c admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:06.970730 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b41d79-6fa9-445a-933f-ceaf866aff0c admin admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:06.971591 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b41d79-6fa9-445a-933f-ceaf866aff0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:06.973203 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b41d79-6fa9-445a-933f-ceaf866aff0c admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:06.983774 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 792/1583] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 17:58:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 17:58:06.988256 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b41d79-6fa9-445a-933f-ceaf866aff0c admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:06.992105 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 792/1584] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 14 17:58:06 2022] POST /identity/v3/users => generated 303 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:58:06.992105 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd3d09b-70ce-48de-99b8-d79ced1e969e admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:06.995789 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b41d79-6fa9-445a-933f-ceaf866aff0c admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:07.001021 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f7cd57-2a7a-46fb-81b6-04e5ded526d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:07.001590 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd3d09b-70ce-48de-99b8-d79ced1e969e admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:07.001702 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f7cd57-2a7a-46fb-81b6-04e5ded526d1 admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:07.001975 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f7cd57-2a7a-46fb-81b6-04e5ded526d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:07.002266 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f7cd57-2a7a-46fb-81b6-04e5ded526d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:07.003036 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f7cd57-2a7a-46fb-81b6-04e5ded526d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:07.004613 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f7cd57-2a7a-46fb-81b6-04e5ded526d1 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:07.006817 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88ee75e-521f-4c9e-a6d5-939eeacf55c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:07.007526 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88ee75e-521f-4c9e-a6d5-939eeacf55c9 admin admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:07.007816 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88ee75e-521f-4c9e-a6d5-939eeacf55c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:07.008127 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88ee75e-521f-4c9e-a6d5-939eeacf55c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:07.008864 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88ee75e-521f-4c9e-a6d5-939eeacf55c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:07.010791 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88ee75e-521f-4c9e-a6d5-939eeacf55c9 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:07.017001 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 793/1585] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 17:58:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 17:58:07.018002 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f7cd57-2a7a-46fb-81b6-04e5ded526d1 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:07.026204 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 793/1586] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 17:58:06 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 17:58:07.026204 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88ee75e-521f-4c9e-a6d5-939eeacf55c9 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:07.031457 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f7cd57-2a7a-46fb-81b6-04e5ded526d1 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:07.036443 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4a5830-f198-49a1-9e7f-b12440fb2fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:07.042419 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4a5830-f198-49a1-9e7f-b12440fb2fd3 admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:07.042419 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4a5830-f198-49a1-9e7f-b12440fb2fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:07.042419 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4a5830-f198-49a1-9e7f-b12440fb2fd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:07.042419 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4a5830-f198-49a1-9e7f-b12440fb2fd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:07.042419 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4a5830-f198-49a1-9e7f-b12440fb2fd3 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:07.051218 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 794/1587] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 17:58:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 17:58:07.055544 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4a5830-f198-49a1-9e7f-b12440fb2fd3 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:07.061140 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=87,keystone:INSERT=13 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:58:07.066281 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4a5830-f198-49a1-9e7f-b12440fb2fd3 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:07.071716 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d834e8-4d03-47ef-9c41-c9494d289d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:07.072444 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d834e8-4d03-47ef-9c41-c9494d289d41 admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:07.072734 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d834e8-4d03-47ef-9c41-c9494d289d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:07.073043 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d834e8-4d03-47ef-9c41-c9494d289d41 admin admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:07.073801 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d834e8-4d03-47ef-9c41-c9494d289d41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:07.075432 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d834e8-4d03-47ef-9c41-c9494d289d41 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:07.084133 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88ee75e-521f-4c9e-a6d5-939eeacf55c9 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:07.086738 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 795/1588] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 17:58:07 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 17:58:07.087615 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d834e8-4d03-47ef-9c41-c9494d289d41 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:07.090195 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8fb8c0-d9ab-460e-a40a-fa604f79dcae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17945e7d72954b8787e0ba09a9903247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:07.091344 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8fb8c0-d9ab-460e-a40a-fa604f79dcae service cinder] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:07.092020 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8fb8c0-d9ab-460e-a40a-fa604f79dcae service cinder] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:07.092979 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8fb8c0-d9ab-460e-a40a-fa604f79dcae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:07.099757 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d834e8-4d03-47ef-9c41-c9494d289d41 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:07.103405 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8fb8c0-d9ab-460e-a40a-fa604f79dcae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:07.104453 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66636d72-51ea-4a93-ad9b-0578a8ffeee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:07.105627 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8fb8c0-d9ab-460e-a40a-fa604f79dcae service cinder] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:07.105755 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66636d72-51ea-4a93-ad9b-0578a8ffeee8 admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:07.105755 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66636d72-51ea-4a93-ad9b-0578a8ffeee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:07.105933 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66636d72-51ea-4a93-ad9b-0578a8ffeee8 admin admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:07.106630 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66636d72-51ea-4a93-ad9b-0578a8ffeee8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:07.108264 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66636d72-51ea-4a93-ad9b-0578a8ffeee8 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:07.115031 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 794/1589] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:58:07 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:58:07.115754 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8fb8c0-d9ab-460e-a40a-fa604f79dcae service cinder] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:07.123897 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 796/1590] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 17:58:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 17:58:07.123897 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66636d72-51ea-4a93-ad9b-0578a8ffeee8 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:07.130977 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8fb8c0-d9ab-460e-a40a-fa604f79dcae service cinder] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:07.132441 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66636d72-51ea-4a93-ad9b-0578a8ffeee8 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:07.138944 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ced776d-6170-491f-afaf-308cd7bf0ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:07.139090 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b8ed95-0442-4d62-b6ec-1b07bd6272be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:07.140040 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ced776d-6170-491f-afaf-308cd7bf0ada admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:07.140288 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b8ed95-0442-4d62-b6ec-1b07bd6272be admin admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:07.140443 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ced776d-6170-491f-afaf-308cd7bf0ada admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:07.140586 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ced776d-6170-491f-afaf-308cd7bf0ada admin admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:07.140775 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b8ed95-0442-4d62-b6ec-1b07bd6272be admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:07.141341 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ced776d-6170-491f-afaf-308cd7bf0ada admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:07.141444 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b8ed95-0442-4d62-b6ec-1b07bd6272be admin admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:07.142100 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b8ed95-0442-4d62-b6ec-1b07bd6272be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:07.143698 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ced776d-6170-491f-afaf-308cd7bf0ada admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:07.145897 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b8ed95-0442-4d62-b6ec-1b07bd6272be admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:07.154249 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 797/1591] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 17:58:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 17:58:07.158592 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ced776d-6170-491f-afaf-308cd7bf0ada admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:07.159473 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 795/1592] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 17:58:07 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 17:58:07.160396 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b8ed95-0442-4d62-b6ec-1b07bd6272be admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:07.174891 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ced776d-6170-491f-afaf-308cd7bf0ada admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:07.177249 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b8ed95-0442-4d62-b6ec-1b07bd6272be admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:07.180148 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c17c434-7593-4da4-ab99-9d491c8a2348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:07.181574 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c17c434-7593-4da4-ab99-9d491c8a2348 admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:07.181933 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c17c434-7593-4da4-ab99-9d491c8a2348 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:07.182062 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c4c9a9-9209-4386-b478-c20bbb59c493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:07.182276 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c17c434-7593-4da4-ab99-9d491c8a2348 admin admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:07.182606 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c4c9a9-9209-4386-b478-c20bbb59c493 admin admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:07.182897 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c4c9a9-9209-4386-b478-c20bbb59c493 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:07.183055 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c17c434-7593-4da4-ab99-9d491c8a2348 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:07.183174 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c4c9a9-9209-4386-b478-c20bbb59c493 admin admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:07.183962 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c4c9a9-9209-4386-b478-c20bbb59c493 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:07.184736 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c17c434-7593-4da4-ab99-9d491c8a2348 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:07.185576 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c4c9a9-9209-4386-b478-c20bbb59c493 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:07.199064 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 798/1593] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 17:58:07 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 17:58:07.199064 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c17c434-7593-4da4-ab99-9d491c8a2348 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:07.207035 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 796/1594] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 17:58:07 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 17:58:07.207035 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c4c9a9-9209-4386-b478-c20bbb59c493 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:07.211234 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c17c434-7593-4da4-ab99-9d491c8a2348 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:07.218139 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e448e01-2ced-415d-9b6d-78da4d1c94ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:07.218926 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c4c9a9-9209-4386-b478-c20bbb59c493 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:07.219907 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e448e01-2ced-415d-9b6d-78da4d1c94ea admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:07.220041 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e448e01-2ced-415d-9b6d-78da4d1c94ea admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:07.220273 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e448e01-2ced-415d-9b6d-78da4d1c94ea admin admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:07.221009 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e448e01-2ced-415d-9b6d-78da4d1c94ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:07.222714 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e448e01-2ced-415d-9b6d-78da4d1c94ea admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:07.225405 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255ac92c-29a3-4140-bdeb-89959ef37bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:07.225873 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255ac92c-29a3-4140-bdeb-89959ef37bda admin admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:07.226460 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255ac92c-29a3-4140-bdeb-89959ef37bda admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:07.226778 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255ac92c-29a3-4140-bdeb-89959ef37bda admin admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:07.227569 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255ac92c-29a3-4140-bdeb-89959ef37bda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:07.229706 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255ac92c-29a3-4140-bdeb-89959ef37bda admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:07.233759 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 799/1595] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 17:58:07 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 17:58:07.235016 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e448e01-2ced-415d-9b6d-78da4d1c94ea admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:07.245793 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 797/1596] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 17:58:07 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 17:58:07.245992 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e448e01-2ced-415d-9b6d-78da4d1c94ea admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:07.246112 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255ac92c-29a3-4140-bdeb-89959ef37bda admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:07.255389 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c87cee-b276-4cbf-afbd-0b4b37d9ecb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:07.256087 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c87cee-b276-4cbf-afbd-0b4b37d9ecb7 admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:07.256383 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c87cee-b276-4cbf-afbd-0b4b37d9ecb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:07.256665 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c87cee-b276-4cbf-afbd-0b4b37d9ecb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:07.257017 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255ac92c-29a3-4140-bdeb-89959ef37bda admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:07.257410 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c87cee-b276-4cbf-afbd-0b4b37d9ecb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:07.259077 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c87cee-b276-4cbf-afbd-0b4b37d9ecb7 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:07.262168 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff881688-14aa-4ddc-8c21-f2da505c7631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:07.262873 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff881688-14aa-4ddc-8c21-f2da505c7631 admin admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:07.263175 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff881688-14aa-4ddc-8c21-f2da505c7631 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:07.263501 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff881688-14aa-4ddc-8c21-f2da505c7631 admin admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:07.264254 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff881688-14aa-4ddc-8c21-f2da505c7631 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:07.266736 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff881688-14aa-4ddc-8c21-f2da505c7631 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:07.274518 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 800/1597] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 17:58:07 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 17:58:07.275843 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c87cee-b276-4cbf-afbd-0b4b37d9ecb7 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:07.279423 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 798/1598] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 17:58:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 17:58:07.280385 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff881688-14aa-4ddc-8c21-f2da505c7631 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:07.289166 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c87cee-b276-4cbf-afbd-0b4b37d9ecb7 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:07.295404 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef2f9a4-6176-47d6-8015-eeeca1a734cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:07.295890 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff881688-14aa-4ddc-8c21-f2da505c7631 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:07.296407 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef2f9a4-6176-47d6-8015-eeeca1a734cf admin admin] REQUEST_METHOD: `PUT` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:07.296700 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef2f9a4-6176-47d6-8015-eeeca1a734cf admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:07.297175 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef2f9a4-6176-47d6-8015-eeeca1a734cf admin admin] PATH_INFO: `/v3/projects/f61b2ba814064d7da5702f0f15d1ba0a/users/0b64d79cbd27413cb9d6064e7b9c88e7/roles/9ee80134743f4c2b88525b04df2facba` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:07.302709 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aad86b-19f2-432d-93ad-4fd228621010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:07.303679 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aad86b-19f2-432d-93ad-4fd228621010 admin admin] REQUEST_METHOD: `PUT` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:07.303969 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aad86b-19f2-432d-93ad-4fd228621010 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:07.304261 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aad86b-19f2-432d-93ad-4fd228621010 admin admin] PATH_INFO: `/v3/projects/d481226324c843ce91b1eae9cce3a87e/users/320bc9f0f2f241d9a6180956613f4509/roles/9ee80134743f4c2b88525b04df2facba` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:07.311170 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:58:07.320566 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef2f9a4-6176-47d6-8015-eeeca1a734cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=f61b2ba814064d7da5702f0f15d1ba0a, user_id=0b64d79cbd27413cb9d6064e7b9c88e7, role_id=9ee80134743f4c2b88525b04df2facba)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:07.328793 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef2f9a4-6176-47d6-8015-eeeca1a734cf admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:07.328969 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aad86b-19f2-432d-93ad-4fd228621010 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d481226324c843ce91b1eae9cce3a87e, user_id=320bc9f0f2f241d9a6180956613f4509, role_id=9ee80134743f4c2b88525b04df2facba)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:07.328969 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aad86b-19f2-432d-93ad-4fd228621010 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:07.432773 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 801/1599] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 17:58:07 2022] PUT /identity/v3/projects/f61b2ba814064d7da5702f0f15d1ba0a/users/0b64d79cbd27413cb9d6064e7b9c88e7/roles/9ee80134743f4c2b88525b04df2facba => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:58:07.434156 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 799/1600] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 17:58:07 2022] PUT /identity/v3/projects/d481226324c843ce91b1eae9cce3a87e/users/320bc9f0f2f241d9a6180956613f4509/roles/9ee80134743f4c2b88525b04df2facba => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:58:07.435054 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aad86b-19f2-432d-93ad-4fd228621010 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:07.440532 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef2f9a4-6176-47d6-8015-eeeca1a734cf admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:07.510692 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aad86b-19f2-432d-93ad-4fd228621010 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:07.516245 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb21b24-372a-4faa-991b-f7ef98616a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:07.517336 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb21b24-372a-4faa-991b-f7ef98616a83 admin admin] REQUEST_METHOD: `PUT` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:07.517458 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef2f9a4-6176-47d6-8015-eeeca1a734cf admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:07.517674 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb21b24-372a-4faa-991b-f7ef98616a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:07.517946 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb21b24-372a-4faa-991b-f7ef98616a83 admin admin] PATH_INFO: `/v3/projects/a58d8bbe6d8a4352bde684e9878ae6ba/users/30552d1e358c41d1b99f22ba59dbd587/roles/9ee80134743f4c2b88525b04df2facba` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:07.522283 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a597b52-2644-49df-b3ed-c88cf7a9eed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:07.523180 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a597b52-2644-49df-b3ed-c88cf7a9eed4 admin admin] REQUEST_METHOD: `PUT` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:07.523632 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a597b52-2644-49df-b3ed-c88cf7a9eed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:07.523918 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a597b52-2644-49df-b3ed-c88cf7a9eed4 admin admin] PATH_INFO: `/v3/projects/0eaf9a10913d4c7390691032b238bb85/users/1967fba1629e416e96416aae2ba147aa/roles/9ee80134743f4c2b88525b04df2facba` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:07.535756 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb21b24-372a-4faa-991b-f7ef98616a83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a58d8bbe6d8a4352bde684e9878ae6ba, user_id=30552d1e358c41d1b99f22ba59dbd587, role_id=9ee80134743f4c2b88525b04df2facba)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:07.539993 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a597b52-2644-49df-b3ed-c88cf7a9eed4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0eaf9a10913d4c7390691032b238bb85, user_id=1967fba1629e416e96416aae2ba147aa, role_id=9ee80134743f4c2b88525b04df2facba)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:07.540713 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb21b24-372a-4faa-991b-f7ef98616a83 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:07.542673 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a597b52-2644-49df-b3ed-c88cf7a9eed4 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:07.623084 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 800/1601] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 17:58:07 2022] PUT /identity/v3/projects/a58d8bbe6d8a4352bde684e9878ae6ba/users/30552d1e358c41d1b99f22ba59dbd587/roles/9ee80134743f4c2b88525b04df2facba => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:58:07.624411 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb21b24-372a-4faa-991b-f7ef98616a83 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:07.652141 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 802/1602] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 17:58:07 2022] PUT /identity/v3/projects/0eaf9a10913d4c7390691032b238bb85/users/1967fba1629e416e96416aae2ba147aa/roles/9ee80134743f4c2b88525b04df2facba => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:58:07.663407 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a597b52-2644-49df-b3ed-c88cf7a9eed4 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:07.681771 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:58:07.694559 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb21b24-372a-4faa-991b-f7ef98616a83 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:07.736100 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a597b52-2644-49df-b3ed-c88cf7a9eed4 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:07.742211 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98ba8b5-170c-4383-8cdb-8bcb0931c455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:07.743126 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98ba8b5-170c-4383-8cdb-8bcb0931c455 admin admin] REQUEST_METHOD: `PUT` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:07.743444 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98ba8b5-170c-4383-8cdb-8bcb0931c455 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:07.743721 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98ba8b5-170c-4383-8cdb-8bcb0931c455 admin admin] PATH_INFO: `/v3/projects/b2bf6c7727884fd98fd7035f04de2da5/users/41680577c34d4b9090270d3097a7e02c/roles/9ee80134743f4c2b88525b04df2facba` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:07.758573 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8ebfe0-1b96-4e5b-a475-7357cab228f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:07.759517 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8ebfe0-1b96-4e5b-a475-7357cab228f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:07.759805 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8ebfe0-1b96-4e5b-a475-7357cab228f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:07.760098 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8ebfe0-1b96-4e5b-a475-7357cab228f5 admin admin] PATH_INFO: `/v3/projects/865c9f495fc24f8fb216d11917309a95/users/9c7ab182f1fd41718376a8e2f03ec87c/roles/9ee80134743f4c2b88525b04df2facba` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:07.760411 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98ba8b5-170c-4383-8cdb-8bcb0931c455 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2bf6c7727884fd98fd7035f04de2da5, user_id=41680577c34d4b9090270d3097a7e02c, role_id=9ee80134743f4c2b88525b04df2facba)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:07.764629 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98ba8b5-170c-4383-8cdb-8bcb0931c455 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:07.776455 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8ebfe0-1b96-4e5b-a475-7357cab228f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=865c9f495fc24f8fb216d11917309a95, user_id=9c7ab182f1fd41718376a8e2f03ec87c, role_id=9ee80134743f4c2b88525b04df2facba)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:07.779182 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8ebfe0-1b96-4e5b-a475-7357cab228f5 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:07.843586 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 803/1603] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 17:58:07 2022] PUT /identity/v3/projects/b2bf6c7727884fd98fd7035f04de2da5/users/41680577c34d4b9090270d3097a7e02c/roles/9ee80134743f4c2b88525b04df2facba => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:58:07.844456 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98ba8b5-170c-4383-8cdb-8bcb0931c455 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:07.885809 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 801/1604] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 17:58:07 2022] PUT /identity/v3/projects/865c9f495fc24f8fb216d11917309a95/users/9c7ab182f1fd41718376a8e2f03ec87c/roles/9ee80134743f4c2b88525b04df2facba => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:58:07.887402 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f1526a-db76-4776-84a0-89b1e1e7f6e1 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:07.887802 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f1526a-db76-4776-84a0-89b1e1e7f6e1 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:07.888298 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f1526a-db76-4776-84a0-89b1e1e7f6e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:07.914459 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:58:07.916261 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-e5f1526a-db76-4776-84a0-89b1e1e7f6e1 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:58:07.917509 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-e5f1526a-db76-4776-84a0-89b1e1e7f6e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:07.919689 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98ba8b5-170c-4383-8cdb-8bcb0931c455 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:07.979650 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16e5577-9ce9-4f78-8c65-2bbe4f2fa1a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:07.980658 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16e5577-9ce9-4f78-8c65-2bbe4f2fa1a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:07.981005 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16e5577-9ce9-4f78-8c65-2bbe4f2fa1a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:07.981287 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16e5577-9ce9-4f78-8c65-2bbe4f2fa1a6 admin admin] PATH_INFO: `/v3/projects/9df506a46ed94f178dd51e177818ffe9/users/7bdd8a079db2443285082d4e2255da84/roles/9ee80134743f4c2b88525b04df2facba` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:07.982753 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 802/1605] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:58:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:58:07.984487 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ac597-ccf2-42ae-887d-1551b94e301a None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:07.984790 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ac597-ccf2-42ae-887d-1551b94e301a None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:07.985075 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ac597-ccf2-42ae-887d-1551b94e301a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:08.001260 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16e5577-9ce9-4f78-8c65-2bbe4f2fa1a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9df506a46ed94f178dd51e177818ffe9, user_id=7bdd8a079db2443285082d4e2255da84, role_id=9ee80134743f4c2b88525b04df2facba)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:08.004513 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16e5577-9ce9-4f78-8c65-2bbe4f2fa1a6 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:08.031551 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-6c3ac597-ccf2-42ae-887d-1551b94e301a None None] MFA Rules not processed for user `320bc9f0f2f241d9a6180956613f4509`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:58:08.032786 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-6c3ac597-ccf2-42ae-887d-1551b94e301a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:08.092193 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 804/1606] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 17:58:07 2022] PUT /identity/v3/projects/9df506a46ed94f178dd51e177818ffe9/users/7bdd8a079db2443285082d4e2255da84/roles/9ee80134743f4c2b88525b04df2facba => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:58:08.104539 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0d26c9-ff6a-478e-9213-998b57a48bdb None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:08.105243 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0d26c9-ff6a-478e-9213-998b57a48bdb None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:08.106309 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0d26c9-ff6a-478e-9213-998b57a48bdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:08.106936 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 803/1607] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:58:07 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:58:08.108526 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873708b2-3acb-40c8-8f20-33f65d5eea7d None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:08.109532 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873708b2-3acb-40c8-8f20-33f65d5eea7d None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:08.110090 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873708b2-3acb-40c8-8f20-33f65d5eea7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:08.139012 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:58:08.140496 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-0a0d26c9-ff6a-478e-9213-998b57a48bdb None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:58:08.141975 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-0a0d26c9-ff6a-478e-9213-998b57a48bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:08.149763 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-873708b2-3acb-40c8-8f20-33f65d5eea7d None None] MFA Rules not processed for user `1967fba1629e416e96416aae2ba147aa`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:58:08.151719 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-873708b2-3acb-40c8-8f20-33f65d5eea7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:08.213593 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 805/1608] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:58:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:58:08.217602 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35a320b-b4c1-4747-a6fe-e805a3922d92 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:08.217602 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35a320b-b4c1-4747-a6fe-e805a3922d92 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:08.217602 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35a320b-b4c1-4747-a6fe-e805a3922d92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:08.237993 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 804/1609] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:58:08 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:58:08.239214 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781c82d4-abe5-4dee-a8f3-cb366ffd558f None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:08.239550 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-b35a320b-b4c1-4747-a6fe-e805a3922d92 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:58:08.239677 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781c82d4-abe5-4dee-a8f3-cb366ffd558f None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:08.240014 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781c82d4-abe5-4dee-a8f3-cb366ffd558f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:08.241074 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-b35a320b-b4c1-4747-a6fe-e805a3922d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:08.251461 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 806/1610] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:58:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:58:08.253120 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35a320b-b4c1-4747-a6fe-e805a3922d92 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:08.259522 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-781c82d4-abe5-4dee-a8f3-cb366ffd558f None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:58:08.260805 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-781c82d4-abe5-4dee-a8f3-cb366ffd558f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:08.272764 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 805/1611] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:58:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:58:08.272764 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b3f821-8cc3-450a-ae47-26f557d64ed2 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:08.272764 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b3f821-8cc3-450a-ae47-26f557d64ed2 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:08.272764 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b3f821-8cc3-450a-ae47-26f557d64ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:08.300460 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-78b3f821-8cc3-450a-ae47-26f557d64ed2 None None] MFA Rules not processed for user `7bdd8a079db2443285082d4e2255da84`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:58:08.301697 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-78b3f821-8cc3-450a-ae47-26f557d64ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:08.340770 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35a320b-b4c1-4747-a6fe-e805a3922d92 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:08.351888 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2604769-068c-4702-b21d-286d78b9bb37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5652329c71cd431fb579d69cef933b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:08.352565 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2604769-068c-4702-b21d-286d78b9bb37 service neutron] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:08.352834 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2604769-068c-4702-b21d-286d78b9bb37 service neutron] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:08.353199 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2604769-068c-4702-b21d-286d78b9bb37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:08.364139 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2604769-068c-4702-b21d-286d78b9bb37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:08.365603 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2604769-068c-4702-b21d-286d78b9bb37 service neutron] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:08.375535 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 806/1612] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:58:08 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:58:08.376448 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 807/1613] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:58:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:58:08.377079 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63770da-c332-4487-897c-0fcfbce77b28 None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:08.377216 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2604769-068c-4702-b21d-286d78b9bb37 service neutron] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:08.377401 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63770da-c332-4487-897c-0fcfbce77b28 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:08.377669 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63770da-c332-4487-897c-0fcfbce77b28 None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:08.379488 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 807/1614] 10.222.0.36 () {54 vars in 961 bytes} [Tue Jun 14 17:58:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:58:08.380646 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63770da-c332-4487-897c-0fcfbce77b28 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:08.393070 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2604769-068c-4702-b21d-286d78b9bb37 service neutron] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:08.394661 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63770da-c332-4487-897c-0fcfbce77b28 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:08.397771 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74f01ce-e2ba-437b-9706-5ca60fdc8421 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5652329c71cd431fb579d69cef933b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:08.398506 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74f01ce-e2ba-437b-9706-5ca60fdc8421 service neutron] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:08.398787 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74f01ce-e2ba-437b-9706-5ca60fdc8421 service neutron] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:08.399125 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74f01ce-e2ba-437b-9706-5ca60fdc8421 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:08.400695 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c0c25c-e1f7-4576-8f45-fc4de53353eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:08.401387 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c0c25c-e1f7-4576-8f45-fc4de53353eb admin admin] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:08.401700 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c0c25c-e1f7-4576-8f45-fc4de53353eb admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:08.401971 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c0c25c-e1f7-4576-8f45-fc4de53353eb admin admin] PATH_INFO: `/v3/projects` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:08.402691 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c0c25c-e1f7-4576-8f45-fc4de53353eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:08.404771 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c0c25c-e1f7-4576-8f45-fc4de53353eb admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:08.411513 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74f01ce-e2ba-437b-9706-5ca60fdc8421 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:08.413170 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74f01ce-e2ba-437b-9706-5ca60fdc8421 service neutron] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:08.424904 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 808/1615] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:58:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:58:08.425797 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74f01ce-e2ba-437b-9706-5ca60fdc8421 service neutron] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:08.434827 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74f01ce-e2ba-437b-9706-5ca60fdc8421 service neutron] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:08.438975 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e70018-a337-4827-8f1c-bb3d57de8b30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5652329c71cd431fb579d69cef933b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:08.439771 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e70018-a337-4827-8f1c-bb3d57de8b30 service neutron] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:08.440059 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e70018-a337-4827-8f1c-bb3d57de8b30 service neutron] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:08.440340 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e70018-a337-4827-8f1c-bb3d57de8b30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:08.448469 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:58:08.451482 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e70018-a337-4827-8f1c-bb3d57de8b30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:08.453165 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e70018-a337-4827-8f1c-bb3d57de8b30 service neutron] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:08.464183 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 809/1616] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:58:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:58:08.465206 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e70018-a337-4827-8f1c-bb3d57de8b30 service neutron] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:08.474436 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e70018-a337-4827-8f1c-bb3d57de8b30 service neutron] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:08.478455 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5775b76-b45c-447b-8ef9-2097c3149d8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5652329c71cd431fb579d69cef933b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:08.479136 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5775b76-b45c-447b-8ef9-2097c3149d8c service neutron] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:08.479468 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5775b76-b45c-447b-8ef9-2097c3149d8c service neutron] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:08.479783 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5775b76-b45c-447b-8ef9-2097c3149d8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:08.490886 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5775b76-b45c-447b-8ef9-2097c3149d8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:08.492504 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5775b76-b45c-447b-8ef9-2097c3149d8c service neutron] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:08.503568 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 810/1617] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:58:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:58:08.504358 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5775b76-b45c-447b-8ef9-2097c3149d8c service neutron] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:08.514097 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5775b76-b45c-447b-8ef9-2097c3149d8c service neutron] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:08.519733 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f53008b-eb0c-4e4a-a72e-55b67e5ef789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:08.520271 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f53008b-eb0c-4e4a-a72e-55b67e5ef789 admin admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:08.520562 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f53008b-eb0c-4e4a-a72e-55b67e5ef789 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:08.520852 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f53008b-eb0c-4e4a-a72e-55b67e5ef789 admin admin] PATH_INFO: `/v3/projects` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:08.521563 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f53008b-eb0c-4e4a-a72e-55b67e5ef789 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:08.523946 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f53008b-eb0c-4e4a-a72e-55b67e5ef789 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:08.556636 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 808/1618] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 14 17:58:08 2022] POST /identity/v3/projects => generated 365 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:58:08.556636 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009b09a2-bca1-470c-baec-eb4f648330b0 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:08.556636 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009b09a2-bca1-470c-baec-eb4f648330b0 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:08.556636 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009b09a2-bca1-470c-baec-eb4f648330b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:08.582154 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-009b09a2-bca1-470c-baec-eb4f648330b0 None None] MFA Rules not processed for user `e4696d396adb495ab300a9a5a5727595`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:58:08.583945 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-009b09a2-bca1-470c-baec-eb4f648330b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:08.646723 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:58:08.662969 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 809/1619] 10.222.0.36 () {58 vars in 1058 bytes} [Tue Jun 14 17:58:08 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:58:08.663957 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009b09a2-bca1-470c-baec-eb4f648330b0 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:08.685877 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 811/1620] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 14 17:58:08 2022] POST /identity/v3/projects => generated 405 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:58:08.687634 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f53008b-eb0c-4e4a-a72e-55b67e5ef789 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:08.739326 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009b09a2-bca1-470c-baec-eb4f648330b0 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:08.798878 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f53008b-eb0c-4e4a-a72e-55b67e5ef789 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:08.805610 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66360062-3c80-49df-ae08-cad896bc5231 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4696d396adb495ab300a9a5a5727595', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:08.806420 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66360062-3c80-49df-ae08-cad896bc5231 service nova] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:08.806846 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66360062-3c80-49df-ae08-cad896bc5231 service nova] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:08.807134 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66360062-3c80-49df-ae08-cad896bc5231 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:08.817967 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106627be-79fa-4db3-9a52-98bb6ad51833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:08.823430 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106627be-79fa-4db3-9a52-98bb6ad51833 admin admin] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:08.823430 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106627be-79fa-4db3-9a52-98bb6ad51833 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:08.823430 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106627be-79fa-4db3-9a52-98bb6ad51833 admin admin] PATH_INFO: `/v3/users` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:08.823430 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106627be-79fa-4db3-9a52-98bb6ad51833 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:08.823430 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106627be-79fa-4db3-9a52-98bb6ad51833 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:08.883075 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66360062-3c80-49df-ae08-cad896bc5231 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:08.884879 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66360062-3c80-49df-ae08-cad896bc5231 service nova] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:08.902044 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 812/1621] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:58:08 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:58:08.906396 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66360062-3c80-49df-ae08-cad896bc5231 service nova] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:08.919605 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66360062-3c80-49df-ae08-cad896bc5231 service nova] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:08.933363 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 810/1622] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 14 17:58:08 2022] POST /identity/v3/users => generated 289 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:58:08.935220 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298cdba8-b27d-4e86-a306-8490da994787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:08.935987 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298cdba8-b27d-4e86-a306-8490da994787 admin admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:08.937983 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106627be-79fa-4db3-9a52-98bb6ad51833 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:08.938727 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298cdba8-b27d-4e86-a306-8490da994787 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:08.938938 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298cdba8-b27d-4e86-a306-8490da994787 admin admin] PATH_INFO: `/v3/users` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:08.939791 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298cdba8-b27d-4e86-a306-8490da994787 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:08.941866 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298cdba8-b27d-4e86-a306-8490da994787 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:08.950369 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106627be-79fa-4db3-9a52-98bb6ad51833 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:08.972138 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17bf864-2e5d-4466-ad4a-5f822b6934b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:08.973382 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17bf864-2e5d-4466-ad4a-5f822b6934b2 admin admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:08.973806 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17bf864-2e5d-4466-ad4a-5f822b6934b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:08.974270 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17bf864-2e5d-4466-ad4a-5f822b6934b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:08.975353 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17bf864-2e5d-4466-ad4a-5f822b6934b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:08.977771 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17bf864-2e5d-4466-ad4a-5f822b6934b2 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:08.991487 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 811/1623] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 17:58:08 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 14 17:58:08.996199 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17bf864-2e5d-4466-ad4a-5f822b6934b2 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:09.008734 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17bf864-2e5d-4466-ad4a-5f822b6934b2 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:09.014326 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed06445c-30ca-4558-9ee9-dd5717ad7974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:09.021350 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed06445c-30ca-4558-9ee9-dd5717ad7974 admin admin] REQUEST_METHOD: `PUT` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:09.021350 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed06445c-30ca-4558-9ee9-dd5717ad7974 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:09.021350 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed06445c-30ca-4558-9ee9-dd5717ad7974 admin admin] PATH_INFO: `/v3/projects/49160b62598a4277be1f2d4b5d513650/users/d0be11a52fde414695b7c0d181a2c7c9/roles/1348580877d04014bfdec4d866b98a74` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:09.036826 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed06445c-30ca-4558-9ee9-dd5717ad7974 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49160b62598a4277be1f2d4b5d513650, user_id=d0be11a52fde414695b7c0d181a2c7c9, role_id=1348580877d04014bfdec4d866b98a74)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:09.050862 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 813/1624] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 14 17:58:08 2022] POST /identity/v3/users => generated 309 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:58:09.051060 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed06445c-30ca-4558-9ee9-dd5717ad7974 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:09.052400 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298cdba8-b27d-4e86-a306-8490da994787 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:09.066709 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298cdba8-b27d-4e86-a306-8490da994787 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:09.073277 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f0ae2d-9e13-4b6a-9a35-97d57111ca7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:09.077673 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f0ae2d-9e13-4b6a-9a35-97d57111ca7a admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:09.077673 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f0ae2d-9e13-4b6a-9a35-97d57111ca7a admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:09.077673 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f0ae2d-9e13-4b6a-9a35-97d57111ca7a admin admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:09.077673 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f0ae2d-9e13-4b6a-9a35-97d57111ca7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:09.078319 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f0ae2d-9e13-4b6a-9a35-97d57111ca7a admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:09.096431 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 814/1625] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 17:58:09 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 17:58:09.097546 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f0ae2d-9e13-4b6a-9a35-97d57111ca7a admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:09.111161 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f0ae2d-9e13-4b6a-9a35-97d57111ca7a admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:09.118508 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12644f6-9fa1-4896-914b-9ffe0371c01e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:09.119988 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12644f6-9fa1-4896-914b-9ffe0371c01e admin admin] REQUEST_METHOD: `PUT` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:09.120526 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12644f6-9fa1-4896-914b-9ffe0371c01e admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:09.120717 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12644f6-9fa1-4896-914b-9ffe0371c01e admin admin] PATH_INFO: `/v3/projects/09eac21772c145209d1111c800a1085a/users/a67d254f0fbf4e07a503c30516825edc/roles/1348580877d04014bfdec4d866b98a74` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:09.145115 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12644f6-9fa1-4896-914b-9ffe0371c01e admin admin] RBAC: Authorizing `identity:create_grant(project_id=09eac21772c145209d1111c800a1085a, user_id=a67d254f0fbf4e07a503c30516825edc, role_id=1348580877d04014bfdec4d866b98a74)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:09.145252 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 812/1626] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 17:58:08 2022] PUT /identity/v3/projects/49160b62598a4277be1f2d4b5d513650/users/d0be11a52fde414695b7c0d181a2c7c9/roles/1348580877d04014bfdec4d866b98a74 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:58:09.149087 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed06445c-30ca-4558-9ee9-dd5717ad7974 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:09.152975 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12644f6-9fa1-4896-914b-9ffe0371c01e admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:09.268651 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:58:09.271519 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 815/1627] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 17:58:09 2022] PUT /identity/v3/projects/09eac21772c145209d1111c800a1085a/users/a67d254f0fbf4e07a503c30516825edc/roles/1348580877d04014bfdec4d866b98a74 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:58:09.274277 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af54248-3b1f-4321-8367-9eeaf10556f1 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:09.274535 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af54248-3b1f-4321-8367-9eeaf10556f1 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:09.274823 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af54248-3b1f-4321-8367-9eeaf10556f1 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:09.276200 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 816/1628] 10.222.0.36 () {54 vars in 912 bytes} [Tue Jun 14 17:58:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:58:09.277185 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af54248-3b1f-4321-8367-9eeaf10556f1 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:09.282346 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed06445c-30ca-4558-9ee9-dd5717ad7974 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:09.293511 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:58:09.398849 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84181e5-dd33-43f8-be19-b39f39d8c349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:09.399706 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84181e5-dd33-43f8-be19-b39f39d8c349 admin admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:09.399998 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84181e5-dd33-43f8-be19-b39f39d8c349 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:09.400284 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84181e5-dd33-43f8-be19-b39f39d8c349 admin admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:09.401034 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84181e5-dd33-43f8-be19-b39f39d8c349 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:09.402638 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84181e5-dd33-43f8-be19-b39f39d8c349 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:09.430929 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 813/1629] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 17:58:09 2022] GET /identity/v3/roles => generated 1420 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 17:58:09.432662 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03274907-7436-4697-8f60-6fdb3d57fb3d None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:09.434761 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03274907-7436-4697-8f60-6fdb3d57fb3d None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:09.437101 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03274907-7436-4697-8f60-6fdb3d57fb3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:09.481909 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-03274907-7436-4697-8f60-6fdb3d57fb3d None None] MFA Rules not processed for user `e4696d396adb495ab300a9a5a5727595`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:58:09.484359 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-03274907-7436-4697-8f60-6fdb3d57fb3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:09.489421 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af54248-3b1f-4321-8367-9eeaf10556f1 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:09.505176 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46bbc4c-2ae8-4939-846f-a7004635775f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:09.506905 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46bbc4c-2ae8-4939-846f-a7004635775f admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:09.507027 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46bbc4c-2ae8-4939-846f-a7004635775f admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:09.507327 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46bbc4c-2ae8-4939-846f-a7004635775f admin admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:09.508332 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46bbc4c-2ae8-4939-846f-a7004635775f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:09.510260 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46bbc4c-2ae8-4939-846f-a7004635775f admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:09.522830 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 817/1630] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 17:58:09 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 17:58:09.523876 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46bbc4c-2ae8-4939-846f-a7004635775f admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:09.537594 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46bbc4c-2ae8-4939-846f-a7004635775f admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:09.545826 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b85dcc-336b-4eb6-8e77-ad3996b779c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:09.547400 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b85dcc-336b-4eb6-8e77-ad3996b779c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:09.547705 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b85dcc-336b-4eb6-8e77-ad3996b779c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:09.547994 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b85dcc-336b-4eb6-8e77-ad3996b779c7 admin admin] PATH_INFO: `/v3/projects/49160b62598a4277be1f2d4b5d513650/users/d0be11a52fde414695b7c0d181a2c7c9/roles/1348580877d04014bfdec4d866b98a74` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:09.550309 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b85dcc-336b-4eb6-8e77-ad3996b779c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49160b62598a4277be1f2d4b5d513650, user_id=d0be11a52fde414695b7c0d181a2c7c9, role_id=1348580877d04014bfdec4d866b98a74)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:09.553366 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b85dcc-336b-4eb6-8e77-ad3996b779c7 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:09.599275 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 818/1631] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 17:58:09 2022] PUT /identity/v3/projects/49160b62598a4277be1f2d4b5d513650/users/d0be11a52fde414695b7c0d181a2c7c9/roles/1348580877d04014bfdec4d866b98a74 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:58:09.599275 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb3a31b-45b9-47b1-854f-1329e6858935 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:09.599275 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb3a31b-45b9-47b1-854f-1329e6858935 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:09.599275 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb3a31b-45b9-47b1-854f-1329e6858935 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:09.599984 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 819/1632] 10.222.0.36 () {54 vars in 961 bytes} [Tue Jun 14 17:58:09 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:58:09.601387 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb3a31b-45b9-47b1-854f-1329e6858935 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:09.620998 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 814/1633] 10.222.0.36 () {58 vars in 1009 bytes} [Tue Jun 14 17:58:09 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:58:09.622302 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a354a-6651-444d-9552-b77947fc0ffe None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:09.622586 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a354a-6651-444d-9552-b77947fc0ffe None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:09.622873 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a354a-6651-444d-9552-b77947fc0ffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:09.662569 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-4a3a354a-6651-444d-9552-b77947fc0ffe None None] MFA Rules not processed for user `e4696d396adb495ab300a9a5a5727595`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:58:09.663882 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-4a3a354a-6651-444d-9552-b77947fc0ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:09.697982 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb3a31b-45b9-47b1-854f-1329e6858935 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:09.703855 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e753bae-88fd-436a-96e8-8a2ee4e9a578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:09.705498 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e753bae-88fd-436a-96e8-8a2ee4e9a578 admin admin] REQUEST_METHOD: `PUT` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:09.706045 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e753bae-88fd-436a-96e8-8a2ee4e9a578 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:09.706538 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e753bae-88fd-436a-96e8-8a2ee4e9a578 admin admin] PATH_INFO: `/v3/projects/09eac21772c145209d1111c800a1085a/users/a67d254f0fbf4e07a503c30516825edc/roles/1348580877d04014bfdec4d866b98a74` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:09.708920 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e753bae-88fd-436a-96e8-8a2ee4e9a578 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09eac21772c145209d1111c800a1085a, user_id=a67d254f0fbf4e07a503c30516825edc, role_id=1348580877d04014bfdec4d866b98a74)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:09.712349 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e753bae-88fd-436a-96e8-8a2ee4e9a578 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:09.735843 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 820/1634] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 17:58:09 2022] PUT /identity/v3/projects/09eac21772c145209d1111c800a1085a/users/a67d254f0fbf4e07a503c30516825edc/roles/1348580877d04014bfdec4d866b98a74 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:58:09.738352 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1231691-40e0-4cef-90f8-5e95392f9051 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:09.738892 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1231691-40e0-4cef-90f8-5e95392f9051 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:09.739416 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1231691-40e0-4cef-90f8-5e95392f9051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:09.750199 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 815/1635] 10.222.0.36 () {58 vars in 1058 bytes} [Tue Jun 14 17:58:09 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:58:09.751209 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3a354a-6651-444d-9552-b77947fc0ffe None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:09.771565 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-c1231691-40e0-4cef-90f8-5e95392f9051 None None] MFA Rules not processed for user `d0be11a52fde414695b7c0d181a2c7c9`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:58:09.773121 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-c1231691-40e0-4cef-90f8-5e95392f9051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:09.783337 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:58:09.817929 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3a354a-6651-444d-9552-b77947fc0ffe None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:09.870163 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 821/1636] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:58:09 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:58:09.871966 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a00578-c491-44d4-95bb-4647835af9e6 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:09.872639 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a00578-c491-44d4-95bb-4647835af9e6 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:09.873047 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a00578-c491-44d4-95bb-4647835af9e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:09.880113 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70cfe08-2aa2-4048-b156-e81ceb1ca4cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17945e7d72954b8787e0ba09a9903247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:09.882686 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70cfe08-2aa2-4048-b156-e81ceb1ca4cb service cinder] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:09.883266 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70cfe08-2aa2-4048-b156-e81ceb1ca4cb service cinder] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:09.883787 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70cfe08-2aa2-4048-b156-e81ceb1ca4cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:09.921832 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-a1a00578-c491-44d4-95bb-4647835af9e6 None None] MFA Rules not processed for user `a67d254f0fbf4e07a503c30516825edc`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:58:09.923061 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-a1a00578-c491-44d4-95bb-4647835af9e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:09.927512 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:58:10.000742 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70cfe08-2aa2-4048-b156-e81ceb1ca4cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:10.002880 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70cfe08-2aa2-4048-b156-e81ceb1ca4cb service cinder] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:10.018821 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 816/1638] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:58:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:58:10.020368 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de0ed2e-6216-4219-96b0-0c197ff5be3b None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:10.020669 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de0ed2e-6216-4219-96b0-0c197ff5be3b None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:10.020955 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de0ed2e-6216-4219-96b0-0c197ff5be3b None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:10.023546 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 817/1639] 10.222.0.36 () {54 vars in 912 bytes} [Tue Jun 14 17:58:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:58:10.024620 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de0ed2e-6216-4219-96b0-0c197ff5be3b None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:10.040562 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 822/1639] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:58:09 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:58:10.040668 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de0ed2e-6216-4219-96b0-0c197ff5be3b None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:10.040749 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9dd324-0d88-4109-b1af-f050fbbba5c4 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:10.043094 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9dd324-0d88-4109-b1af-f050fbbba5c4 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:10.043704 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9dd324-0d88-4109-b1af-f050fbbba5c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:10.045031 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c09034-7e19-4bf1-b210-d86910d0ab1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17945e7d72954b8787e0ba09a9903247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:10.045952 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c09034-7e19-4bf1-b210-d86910d0ab1a service cinder] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:10.046569 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c09034-7e19-4bf1-b210-d86910d0ab1a service cinder] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:10.047130 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c09034-7e19-4bf1-b210-d86910d0ab1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:10.063209 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c09034-7e19-4bf1-b210-d86910d0ab1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:10.065846 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c09034-7e19-4bf1-b210-d86910d0ab1a service cinder] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:10.086326 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 818/1640] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:58:10 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:58:10.091099 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-aa9dd324-0d88-4109-b1af-f050fbbba5c4 None None] MFA Rules not processed for user `e4696d396adb495ab300a9a5a5727595`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:58:10.093060 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-aa9dd324-0d88-4109-b1af-f050fbbba5c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:10.105884 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 823/1641] 10.222.0.36 () {58 vars in 1009 bytes} [Tue Jun 14 17:58:10 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:58:10.251153 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c09034-7e19-4bf1-b210-d86910d0ab1a service cinder] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:10.262162 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c09034-7e19-4bf1-b210-d86910d0ab1a service cinder] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:10.267021 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9ca86d-9a25-4186-afe7-80c6457628ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17945e7d72954b8787e0ba09a9903247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:10.267789 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9ca86d-9a25-4186-afe7-80c6457628ae service cinder] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:10.268072 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9ca86d-9a25-4186-afe7-80c6457628ae service cinder] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:10.268366 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9ca86d-9a25-4186-afe7-80c6457628ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:10.281685 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9ca86d-9a25-4186-afe7-80c6457628ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:10.283197 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9ca86d-9a25-4186-afe7-80c6457628ae service cinder] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:10.297421 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 819/1642] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:58:10 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:58:10.362543 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9dd324-0d88-4109-b1af-f050fbbba5c4 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:10.376559 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9dd324-0d88-4109-b1af-f050fbbba5c4 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:10.381738 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bb1056-80ea-48db-9dd6-0e0a29d66973 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17945e7d72954b8787e0ba09a9903247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:10.382423 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb1056-80ea-48db-9dd6-0e0a29d66973 service cinder] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:10.383746 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb1056-80ea-48db-9dd6-0e0a29d66973 service cinder] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:10.383746 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb1056-80ea-48db-9dd6-0e0a29d66973 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:10.398005 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bb1056-80ea-48db-9dd6-0e0a29d66973 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:10.400220 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bb1056-80ea-48db-9dd6-0e0a29d66973 service cinder] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:10.414540 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 824/1643] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:58:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:58:10.611339 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479255b7-2126-460a-88d8-9d9519d7e855 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:10.611933 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479255b7-2126-460a-88d8-9d9519d7e855 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:10.612379 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479255b7-2126-460a-88d8-9d9519d7e855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:10.687779 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-479255b7-2126-460a-88d8-9d9519d7e855 None None] MFA Rules not processed for user `30552d1e358c41d1b99f22ba59dbd587`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:58:10.691978 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-479255b7-2126-460a-88d8-9d9519d7e855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:10.784902 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:58:10.816286 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 820/1644] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:58:10 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:58:10.828494 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9a0b7b-c481-443b-ae40-1d267cf3979b None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:10.829080 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9a0b7b-c481-443b-ae40-1d267cf3979b None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:10.829382 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9a0b7b-c481-443b-ae40-1d267cf3979b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:10.857247 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-0d9a0b7b-c481-443b-ae40-1d267cf3979b None None] MFA Rules not processed for user `30552d1e358c41d1b99f22ba59dbd587`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:58:10.858525 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-0d9a0b7b-c481-443b-ae40-1d267cf3979b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:10.867725 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 825/1645] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:58:10 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:58:10.886278 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479255b7-2126-460a-88d8-9d9519d7e855 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:10.905491 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479255b7-2126-460a-88d8-9d9519d7e855 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:10.914299 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92658d6-1715-4239-9538-f40d468e97b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4696d396adb495ab300a9a5a5727595', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:10.915085 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92658d6-1715-4239-9538-f40d468e97b3 service nova] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:10.915469 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92658d6-1715-4239-9538-f40d468e97b3 service nova] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:10.915814 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92658d6-1715-4239-9538-f40d468e97b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:10.939048 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92658d6-1715-4239-9538-f40d468e97b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:10.939048 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92658d6-1715-4239-9538-f40d468e97b3 service nova] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:10.971752 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 821/1646] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:58:10 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:58:11.433507 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9a0b7b-c481-443b-ae40-1d267cf3979b None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:11.433507 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9a0b7b-c481-443b-ae40-1d267cf3979b None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:11.433507 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2abe813-7926-4c81-83bf-7c88c43a286d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17945e7d72954b8787e0ba09a9903247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:11.433507 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2abe813-7926-4c81-83bf-7c88c43a286d service cinder] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:11.435830 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2abe813-7926-4c81-83bf-7c88c43a286d service cinder] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:11.435830 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2abe813-7926-4c81-83bf-7c88c43a286d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:11.531066 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2abe813-7926-4c81-83bf-7c88c43a286d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:11.534412 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2abe813-7926-4c81-83bf-7c88c43a286d service cinder] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:11.555643 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 826/1647] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:58:11 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:58:11.559173 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a28a756-6f2c-403a-bdec-be6de906637d None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:11.559694 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a28a756-6f2c-403a-bdec-be6de906637d None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:11.559994 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a28a756-6f2c-403a-bdec-be6de906637d None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:11.561671 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 822/1648] 10.222.0.36 () {54 vars in 912 bytes} [Tue Jun 14 17:58:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:58:11.573500 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b792606-a1b6-41ea-8d7f-ec2e341ec92e None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:11.575628 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b792606-a1b6-41ea-8d7f-ec2e341ec92e None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:11.575628 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b792606-a1b6-41ea-8d7f-ec2e341ec92e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:11.664747 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-8b792606-a1b6-41ea-8d7f-ec2e341ec92e None None] MFA Rules not processed for user `5652329c71cd431fb579d69cef933b37`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:58:11.665325 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-8b792606-a1b6-41ea-8d7f-ec2e341ec92e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:11.739125 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:58:11.750439 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 827/1649] 10.222.0.36 () {58 vars in 1009 bytes} [Tue Jun 14 17:58:11 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 17:58:11.774109 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a28a756-6f2c-403a-bdec-be6de906637d None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:11.790130 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a28a756-6f2c-403a-bdec-be6de906637d None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:11.794964 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e72b4ea-b45d-4b46-a934-ee1bcec43846 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5652329c71cd431fb579d69cef933b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:11.795730 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e72b4ea-b45d-4b46-a934-ee1bcec43846 service neutron] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:11.796031 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e72b4ea-b45d-4b46-a934-ee1bcec43846 service neutron] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:11.796318 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e72b4ea-b45d-4b46-a934-ee1bcec43846 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:11.809752 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e72b4ea-b45d-4b46-a934-ee1bcec43846 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:11.811383 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e72b4ea-b45d-4b46-a934-ee1bcec43846 service neutron] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:11.839445 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 823/1650] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:58:11 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:58:12.182738 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b792606-a1b6-41ea-8d7f-ec2e341ec92e None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:12.317902 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b792606-a1b6-41ea-8d7f-ec2e341ec92e None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:12.329302 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1023cab-59ee-4047-af61-e377e3aa0f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:12.332353 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1023cab-59ee-4047-af61-e377e3aa0f59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:12.333548 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1023cab-59ee-4047-af61-e377e3aa0f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:12.335219 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1023cab-59ee-4047-af61-e377e3aa0f59 admin admin] PATH_INFO: `/v3/users/7bdd8a079db2443285082d4e2255da84` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:12.339074 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1023cab-59ee-4047-af61-e377e3aa0f59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7bdd8a079db2443285082d4e2255da84)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:12.345644 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1023cab-59ee-4047-af61-e377e3aa0f59 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:12.596823 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-c1023cab-59ee-4047-af61-e377e3aa0f59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7bdd8a079db2443285082d4e2255da84'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:12.599850 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-c1023cab-59ee-4047-af61-e377e3aa0f59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7bdd8a079db2443285082d4e2255da84'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:12.602826 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-c1023cab-59ee-4047-af61-e377e3aa0f59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7bdd8a079db2443285082d4e2255da84'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:12.743505 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-c1023cab-59ee-4047-af61-e377e3aa0f59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7bdd8a079db2443285082d4e2255da84'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:12.757267 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-c1023cab-59ee-4047-af61-e377e3aa0f59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7bdd8a079db2443285082d4e2255da84'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:12.800392 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 828/1651] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 14 17:58:12 2022] DELETE /identity/v3/users/7bdd8a079db2443285082d4e2255da84 => generated 0 bytes in 614 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:58:12.801843 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ab46e0-7b4f-4847-a42d-f315d413130c None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:12.802357 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ab46e0-7b4f-4847-a42d-f315d413130c None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:12.802424 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ab46e0-7b4f-4847-a42d-f315d413130c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:12.823519 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-32ab46e0-7b4f-4847-a42d-f315d413130c None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:58:12.824853 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-32ab46e0-7b4f-4847-a42d-f315d413130c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:12.927706 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 824/1652] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:58:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 17:58:12.996890 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1023cab-59ee-4047-af61-e377e3aa0f59 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:13.000343 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-c1023cab-59ee-4047-af61-e377e3aa0f59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:13.004502 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9057b108-82d5-42d0-a523-f5a93808ad3c None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:13.004802 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9057b108-82d5-42d0-a523-f5a93808ad3c None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:13.005093 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9057b108-82d5-42d0-a523-f5a93808ad3c None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:13.006513 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 825/1653] 10.222.0.36 () {54 vars in 960 bytes} [Tue Jun 14 17:58:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:58:13.014857 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fda7226-e827-4335-86f9-f052f8aba032 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:13.015869 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fda7226-e827-4335-86f9-f052f8aba032 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:13.016205 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fda7226-e827-4335-86f9-f052f8aba032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:13.072432 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-3fda7226-e827-4335-86f9-f052f8aba032 None None] MFA Rules not processed for user `6a8049f9c66b4b5185c26084fd8239ab`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:58:13.076484 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-3fda7226-e827-4335-86f9-f052f8aba032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:13.247155 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1023cab-59ee-4047-af61-e377e3aa0f59 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:13.262150 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee08b03-67d4-47ab-ade8-1bc92141c13f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5652329c71cd431fb579d69cef933b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:13.263221 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee08b03-67d4-47ab-ade8-1bc92141c13f service neutron] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:13.266575 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee08b03-67d4-47ab-ade8-1bc92141c13f service neutron] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:13.267099 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee08b03-67d4-47ab-ade8-1bc92141c13f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:13.301123 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee08b03-67d4-47ab-ade8-1bc92141c13f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:13.304590 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee08b03-67d4-47ab-ade8-1bc92141c13f service neutron] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:13.335408 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 829/1654] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:58:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:58:13.338667 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 826/1655] 10.222.0.36 () {58 vars in 1057 bytes} [Tue Jun 14 17:58:13 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 17:58:13.348639 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee08b03-67d4-47ab-ade8-1bc92141c13f service neutron] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:13.366000 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee08b03-67d4-47ab-ade8-1bc92141c13f service neutron] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:13.393806 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c56526f-a5af-4d29-b8df-7b2648fc590c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a8049f9c66b4b5185c26084fd8239ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:13.394617 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c56526f-a5af-4d29-b8df-7b2648fc590c service placement] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:13.395964 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c56526f-a5af-4d29-b8df-7b2648fc590c service placement] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:13.395964 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c56526f-a5af-4d29-b8df-7b2648fc590c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:13.402165 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-2c56526f-a5af-4d29-b8df-7b2648fc590c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:13.474420 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c56526f-a5af-4d29-b8df-7b2648fc590c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:13.477974 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c56526f-a5af-4d29-b8df-7b2648fc590c service placement] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:13.523739 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 830/1656] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:58:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:58:14.825953 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fda7226-e827-4335-86f9-f052f8aba032 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:14.829235 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-3fda7226-e827-4335-86f9-f052f8aba032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:14.847063 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fda7226-e827-4335-86f9-f052f8aba032 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:14.856426 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c802f9e9-321c-49ab-8263-dd883e8d9c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:14.857540 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c802f9e9-321c-49ab-8263-dd883e8d9c5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:14.857835 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c802f9e9-321c-49ab-8263-dd883e8d9c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:14.858176 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c802f9e9-321c-49ab-8263-dd883e8d9c5f admin admin] PATH_INFO: `/v3/projects/9df506a46ed94f178dd51e177818ffe9` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:14.860914 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c802f9e9-321c-49ab-8263-dd883e8d9c5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9df506a46ed94f178dd51e177818ffe9)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:14.863363 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c802f9e9-321c-49ab-8263-dd883e8d9c5f admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:15.099664 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:58:15.109789 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-c802f9e9-321c-49ab-8263-dd883e8d9c5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9df506a46ed94f178dd51e177818ffe9', 'request_id': 'req-c802f9e9-321c-49ab-8263-dd883e8d9c5f'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:15.182856 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-c802f9e9-321c-49ab-8263-dd883e8d9c5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9df506a46ed94f178dd51e177818ffe9', 'request_id': 'req-c802f9e9-321c-49ab-8263-dd883e8d9c5f'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:15.192549 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-c802f9e9-321c-49ab-8263-dd883e8d9c5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9df506a46ed94f178dd51e177818ffe9', 'request_id': 'req-c802f9e9-321c-49ab-8263-dd883e8d9c5f'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:15.227251 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-c802f9e9-321c-49ab-8263-dd883e8d9c5f admin admin] The token cache is being invalidate because project 9df506a46ed94f178dd51e177818ffe9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 17:58:15.227931 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-c802f9e9-321c-49ab-8263-dd883e8d9c5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:15.228948 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-c802f9e9-321c-49ab-8263-dd883e8d9c5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:15.234999 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 827/1657] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 14 17:58:14 2022] DELETE /identity/v3/projects/9df506a46ed94f178dd51e177818ffe9 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:58:15.236813 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c56526f-a5af-4d29-b8df-7b2648fc590c service placement] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:15.251039 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c56526f-a5af-4d29-b8df-7b2648fc590c service placement] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:15.258986 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:58:15.432391 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f03e41-936b-4310-809f-e9cc7f2d535e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:15.433305 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f03e41-936b-4310-809f-e9cc7f2d535e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:15.433598 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f03e41-936b-4310-809f-e9cc7f2d535e admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:15.434196 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f03e41-936b-4310-809f-e9cc7f2d535e admin admin] PATH_INFO: `/v3/users/a67d254f0fbf4e07a503c30516825edc` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:15.438224 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f03e41-936b-4310-809f-e9cc7f2d535e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a67d254f0fbf4e07a503c30516825edc)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:15.440994 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f03e41-936b-4310-809f-e9cc7f2d535e admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:15.534026 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c802f9e9-321c-49ab-8263-dd883e8d9c5f admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:15.536393 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-c802f9e9-321c-49ab-8263-dd883e8d9c5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:15.585117 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c802f9e9-321c-49ab-8263-dd883e8d9c5f admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:15.604844 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9516d09e-a043-4848-8ee0-466a1d552850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:15.606259 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9516d09e-a043-4848-8ee0-466a1d552850 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:15.606727 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9516d09e-a043-4848-8ee0-466a1d552850 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:15.607195 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9516d09e-a043-4848-8ee0-466a1d552850 admin admin] PATH_INFO: `/v3/users/320bc9f0f2f241d9a6180956613f4509` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:15.612870 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9516d09e-a043-4848-8ee0-466a1d552850 admin admin] RBAC: Authorizing `identity:delete_user(user_id=320bc9f0f2f241d9a6180956613f4509)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:15.614533 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: WARNING py.warnings [None req-9516d09e-a043-4848-8ee0-466a1d552850 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 14 17:58:15.614533 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: warnings.warn(msg) Jun 14 17:58:15.614533 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: Jun 14 17:58:15.621022 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9516d09e-a043-4848-8ee0-466a1d552850 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:15.834796 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-88f03e41-936b-4310-809f-e9cc7f2d535e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a67d254f0fbf4e07a503c30516825edc'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:15.835560 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-88f03e41-936b-4310-809f-e9cc7f2d535e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a67d254f0fbf4e07a503c30516825edc'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:15.837710 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-88f03e41-936b-4310-809f-e9cc7f2d535e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a67d254f0fbf4e07a503c30516825edc'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:15.899154 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-9516d09e-a043-4848-8ee0-466a1d552850 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '320bc9f0f2f241d9a6180956613f4509'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:15.905555 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-9516d09e-a043-4848-8ee0-466a1d552850 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '320bc9f0f2f241d9a6180956613f4509'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:15.906824 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-9516d09e-a043-4848-8ee0-466a1d552850 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '320bc9f0f2f241d9a6180956613f4509'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:15.938919 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-88f03e41-936b-4310-809f-e9cc7f2d535e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a67d254f0fbf4e07a503c30516825edc'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:15.947836 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-88f03e41-936b-4310-809f-e9cc7f2d535e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a67d254f0fbf4e07a503c30516825edc'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:15.989319 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 831/1658] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 14 17:58:15 2022] DELETE /identity/v3/users/a67d254f0fbf4e07a503c30516825edc => generated 0 bytes in 752 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:58:16.034696 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-9516d09e-a043-4848-8ee0-466a1d552850 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '320bc9f0f2f241d9a6180956613f4509'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:16.047800 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-9516d09e-a043-4848-8ee0-466a1d552850 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '320bc9f0f2f241d9a6180956613f4509'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:16.109974 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 828/1659] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 14 17:58:15 2022] DELETE /identity/v3/users/320bc9f0f2f241d9a6180956613f4509 => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 17:58:16.115311 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f6541b-b7fa-463c-9487-e2edba71db26 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:16.117742 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f6541b-b7fa-463c-9487-e2edba71db26 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:16.118069 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f6541b-b7fa-463c-9487-e2edba71db26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:16.152303 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-b9f6541b-b7fa-463c-9487-e2edba71db26 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:58:16.154882 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-b9f6541b-b7fa-463c-9487-e2edba71db26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:16.437532 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 832/1660] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:58:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:58:16.614288 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9516d09e-a043-4848-8ee0-466a1d552850 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:16.615929 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-9516d09e-a043-4848-8ee0-466a1d552850 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:16.748293 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9516d09e-a043-4848-8ee0-466a1d552850 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:16.758142 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10946ae-dd53-499d-a4a0-0f7d8fe7b503 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5652329c71cd431fb579d69cef933b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:16.758898 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10946ae-dd53-499d-a4a0-0f7d8fe7b503 service neutron] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:16.759196 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10946ae-dd53-499d-a4a0-0f7d8fe7b503 service neutron] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:16.759493 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10946ae-dd53-499d-a4a0-0f7d8fe7b503 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:16.787994 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10946ae-dd53-499d-a4a0-0f7d8fe7b503 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:16.789684 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10946ae-dd53-499d-a4a0-0f7d8fe7b503 service neutron] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:16.848331 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 829/1661] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:58:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:58:17.126352 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f6541b-b7fa-463c-9487-e2edba71db26 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:17.128481 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-b9f6541b-b7fa-463c-9487-e2edba71db26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:17.155339 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f6541b-b7fa-463c-9487-e2edba71db26 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:17.162408 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4f5dfe-e473-47f8-8be4-ac11c2dcd3e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:17.163627 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4f5dfe-e473-47f8-8be4-ac11c2dcd3e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:17.164063 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4f5dfe-e473-47f8-8be4-ac11c2dcd3e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:17.164654 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4f5dfe-e473-47f8-8be4-ac11c2dcd3e6 admin admin] PATH_INFO: `/v3/projects/09eac21772c145209d1111c800a1085a` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:17.166422 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4f5dfe-e473-47f8-8be4-ac11c2dcd3e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09eac21772c145209d1111c800a1085a)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:17.167656 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: WARNING py.warnings [None req-5f4f5dfe-e473-47f8-8be4-ac11c2dcd3e6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 14 17:58:17.167656 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: warnings.warn(msg) Jun 14 17:58:17.167656 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: Jun 14 17:58:17.170987 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4f5dfe-e473-47f8-8be4-ac11c2dcd3e6 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:17.372367 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:58:17.467941 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10946ae-dd53-499d-a4a0-0f7d8fe7b503 service neutron] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:17.471262 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-d10946ae-dd53-499d-a4a0-0f7d8fe7b503 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:17.484804 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-5f4f5dfe-e473-47f8-8be4-ac11c2dcd3e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09eac21772c145209d1111c800a1085a', 'request_id': 'req-5f4f5dfe-e473-47f8-8be4-ac11c2dcd3e6'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:17.497074 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10946ae-dd53-499d-a4a0-0f7d8fe7b503 service neutron] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:17.565556 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-5f4f5dfe-e473-47f8-8be4-ac11c2dcd3e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09eac21772c145209d1111c800a1085a', 'request_id': 'req-5f4f5dfe-e473-47f8-8be4-ac11c2dcd3e6'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:17.599854 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:58:17.605918 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66a42e9-9a55-4fb9-b7fd-a77f49ba7a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:17.607800 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66a42e9-9a55-4fb9-b7fd-a77f49ba7a0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:17.608720 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66a42e9-9a55-4fb9-b7fd-a77f49ba7a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:17.609752 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66a42e9-9a55-4fb9-b7fd-a77f49ba7a0c admin admin] PATH_INFO: `/v3/users/1967fba1629e416e96416aae2ba147aa` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:17.611644 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-5f4f5dfe-e473-47f8-8be4-ac11c2dcd3e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09eac21772c145209d1111c800a1085a', 'request_id': 'req-5f4f5dfe-e473-47f8-8be4-ac11c2dcd3e6'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:17.612088 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66a42e9-9a55-4fb9-b7fd-a77f49ba7a0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1967fba1629e416e96416aae2ba147aa)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:17.615107 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66a42e9-9a55-4fb9-b7fd-a77f49ba7a0c admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:17.669215 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-5f4f5dfe-e473-47f8-8be4-ac11c2dcd3e6 admin admin] The token cache is being invalidate because project 09eac21772c145209d1111c800a1085a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87019) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 17:58:17.669700 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-5f4f5dfe-e473-47f8-8be4-ac11c2dcd3e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:17.672252 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-5f4f5dfe-e473-47f8-8be4-ac11c2dcd3e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:17.675652 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 833/1662] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 14 17:58:17 2022] DELETE /identity/v3/projects/09eac21772c145209d1111c800a1085a => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:58:17.684597 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22982584-7e40-4b55-8e16-640876ad7065 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:17.685133 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22982584-7e40-4b55-8e16-640876ad7065 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:17.692146 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22982584-7e40-4b55-8e16-640876ad7065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:17.765416 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-22982584-7e40-4b55-8e16-640876ad7065 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:58:17.769752 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-22982584-7e40-4b55-8e16-640876ad7065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:17.805390 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 834/1663] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:58:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 17:58:17.814599 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e40a40a-b8ec-4b3a-86c0-e20436c1ee94 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:17.817088 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e40a40a-b8ec-4b3a-86c0-e20436c1ee94 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:17.817571 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e40a40a-b8ec-4b3a-86c0-e20436c1ee94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:17.867265 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-9e40a40a-b8ec-4b3a-86c0-e20436c1ee94 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:58:17.869151 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-9e40a40a-b8ec-4b3a-86c0-e20436c1ee94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:17.871951 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-f66a42e9-9a55-4fb9-b7fd-a77f49ba7a0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1967fba1629e416e96416aae2ba147aa'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:17.874296 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-f66a42e9-9a55-4fb9-b7fd-a77f49ba7a0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1967fba1629e416e96416aae2ba147aa'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:17.878267 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-f66a42e9-9a55-4fb9-b7fd-a77f49ba7a0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1967fba1629e416e96416aae2ba147aa'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:17.885950 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 835/1664] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:58:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:58:17.887008 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e40a40a-b8ec-4b3a-86c0-e20436c1ee94 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:17.908768 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e40a40a-b8ec-4b3a-86c0-e20436c1ee94 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:17.925312 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570e6b44-e368-4e5a-b6e6-feca559b6962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:17.928929 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570e6b44-e368-4e5a-b6e6-feca559b6962 admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:17.929434 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570e6b44-e368-4e5a-b6e6-feca559b6962 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:17.929831 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570e6b44-e368-4e5a-b6e6-feca559b6962 admin admin] PATH_INFO: `/v3/domains` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:17.932335 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570e6b44-e368-4e5a-b6e6-feca559b6962 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:58:17.933362 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570e6b44-e368-4e5a-b6e6-feca559b6962 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:17.938063 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570e6b44-e368-4e5a-b6e6-feca559b6962 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:18.014402 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 836/1665] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 14 17:58:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:58:18.019491 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570e6b44-e368-4e5a-b6e6-feca559b6962 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:18.033983 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-f66a42e9-9a55-4fb9-b7fd-a77f49ba7a0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1967fba1629e416e96416aae2ba147aa'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:18.051671 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-f66a42e9-9a55-4fb9-b7fd-a77f49ba7a0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1967fba1629e416e96416aae2ba147aa'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:18.068046 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570e6b44-e368-4e5a-b6e6-feca559b6962 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:18.079397 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a06cba2-8ba2-4843-834b-d42abadceac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:18.080091 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a06cba2-8ba2-4843-834b-d42abadceac2 admin admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:18.080382 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a06cba2-8ba2-4843-834b-d42abadceac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:18.080667 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a06cba2-8ba2-4843-834b-d42abadceac2 admin admin] PATH_INFO: `/v3/projects` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:18.090981 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a06cba2-8ba2-4843-834b-d42abadceac2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:18.094334 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a06cba2-8ba2-4843-834b-d42abadceac2 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:18.111085 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 830/1666] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 14 17:58:17 2022] DELETE /identity/v3/users/1967fba1629e416e96416aae2ba147aa => generated 0 bytes in 644 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:58:18.116706 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fc14d1-5468-4a89-b3df-65e13f472607 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:18.119768 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fc14d1-5468-4a89-b3df-65e13f472607 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:18.120669 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fc14d1-5468-4a89-b3df-65e13f472607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:18.192561 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-85fc14d1-5468-4a89-b3df-65e13f472607 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:58:18.194319 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-85fc14d1-5468-4a89-b3df-65e13f472607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:18.291280 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 837/1667] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 14 17:58:18 2022] POST /identity/v3/projects => generated 363 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:58:18.297844 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a06cba2-8ba2-4843-834b-d42abadceac2 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:18.325268 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 831/1668] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:58:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:58:18.411513 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a06cba2-8ba2-4843-834b-d42abadceac2 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:18.418966 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96130034-3076-485f-a78b-f81512989af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:18.420124 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96130034-3076-485f-a78b-f81512989af8 admin admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:18.420419 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96130034-3076-485f-a78b-f81512989af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:18.420716 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96130034-3076-485f-a78b-f81512989af8 admin admin] PATH_INFO: `/v3/users` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:18.421545 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96130034-3076-485f-a78b-f81512989af8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:18.425406 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96130034-3076-485f-a78b-f81512989af8 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:18.464341 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fc14d1-5468-4a89-b3df-65e13f472607 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:18.466511 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-85fc14d1-5468-4a89-b3df-65e13f472607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:18.552442 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 838/1669] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 14 17:58:18 2022] POST /identity/v3/users => generated 282 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:58:18.556285 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96130034-3076-485f-a78b-f81512989af8 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:18.637688 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96130034-3076-485f-a78b-f81512989af8 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:18.664494 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fc14d1-5468-4a89-b3df-65e13f472607 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:18.667469 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfc5881-77fc-4b7d-a09e-7363ec3bb2e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:18.668214 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfc5881-77fc-4b7d-a09e-7363ec3bb2e9 admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:18.668511 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfc5881-77fc-4b7d-a09e-7363ec3bb2e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:18.668799 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfc5881-77fc-4b7d-a09e-7363ec3bb2e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:18.669568 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfc5881-77fc-4b7d-a09e-7363ec3bb2e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:18.674707 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfc5881-77fc-4b7d-a09e-7363ec3bb2e9 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:18.712974 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 839/1670] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 17:58:18 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 14 17:58:18.713992 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfc5881-77fc-4b7d-a09e-7363ec3bb2e9 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:18.731021 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfc5881-77fc-4b7d-a09e-7363ec3bb2e9 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:18.737593 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3eb519-cb00-438f-b110-21dabd4e7376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:18.738293 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3eb519-cb00-438f-b110-21dabd4e7376 admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:18.738585 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3eb519-cb00-438f-b110-21dabd4e7376 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:18.738875 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3eb519-cb00-438f-b110-21dabd4e7376 admin admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:18.740300 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3eb519-cb00-438f-b110-21dabd4e7376 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:18.758608 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3eb519-cb00-438f-b110-21dabd4e7376 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:18.805525 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 840/1671] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 17:58:18 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 17:58:18.810577 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3eb519-cb00-438f-b110-21dabd4e7376 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:18.827924 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae95a42d-436e-45cd-940d-20d3514805a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5652329c71cd431fb579d69cef933b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:18.828894 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae95a42d-436e-45cd-940d-20d3514805a9 service neutron] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:18.829353 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae95a42d-436e-45cd-940d-20d3514805a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:18.829645 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae95a42d-436e-45cd-940d-20d3514805a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:18.849218 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae95a42d-436e-45cd-940d-20d3514805a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:18.849775 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3eb519-cb00-438f-b110-21dabd4e7376 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:18.850979 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae95a42d-436e-45cd-940d-20d3514805a9 service neutron] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:18.864442 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 832/1672] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:58:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 17:58:18.870915 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0bc546-3b72-47c2-b4b6-49d43d5027a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:18.872103 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0bc546-3b72-47c2-b4b6-49d43d5027a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:18.872572 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0bc546-3b72-47c2-b4b6-49d43d5027a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:18.873047 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0bc546-3b72-47c2-b4b6-49d43d5027a5 admin admin] PATH_INFO: `/v3/projects/554c9349f0cd4f6b8ea93270092d0b97/users/7a62cc0f17e0416cb69efa58dbd2df1f/roles/9ee80134743f4c2b88525b04df2facba` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:18.880874 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e4af78-64b3-4b10-8df6-b9a1e80f99b9 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:18.881350 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e4af78-64b3-4b10-8df6-b9a1e80f99b9 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:18.881484 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e4af78-64b3-4b10-8df6-b9a1e80f99b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:18.926670 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0bc546-3b72-47c2-b4b6-49d43d5027a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=554c9349f0cd4f6b8ea93270092d0b97, user_id=7a62cc0f17e0416cb69efa58dbd2df1f, role_id=9ee80134743f4c2b88525b04df2facba)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:18.929405 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0bc546-3b72-47c2-b4b6-49d43d5027a5 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:18.940327 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-a0e4af78-64b3-4b10-8df6-b9a1e80f99b9 None None] MFA Rules not processed for user `f1e32638fe5c4d2d8d3e2e4ea8250aaa`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:58:18.946810 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-a0e4af78-64b3-4b10-8df6-b9a1e80f99b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:19.060423 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 841/1673] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 17:58:18 2022] PUT /identity/v3/projects/554c9349f0cd4f6b8ea93270092d0b97/users/7a62cc0f17e0416cb69efa58dbd2df1f/roles/9ee80134743f4c2b88525b04df2facba => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:58:19.061897 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0bc546-3b72-47c2-b4b6-49d43d5027a5 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:19.065234 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-1f0bc546-3b72-47c2-b4b6-49d43d5027a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:19.163656 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 833/1674] 10.222.0.36 () {58 vars in 1009 bytes} [Tue Jun 14 17:58:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 17:58:19.165594 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2a0a83-21bf-4520-bd10-3c584a0b1d1a None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:19.165893 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2a0a83-21bf-4520-bd10-3c584a0b1d1a None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:19.166636 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2a0a83-21bf-4520-bd10-3c584a0b1d1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:19.210122 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0bc546-3b72-47c2-b4b6-49d43d5027a5 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:19.221459 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668f7c3d-0626-4c67-a440-da1b877f62f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:19.227627 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668f7c3d-0626-4c67-a440-da1b877f62f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:19.227951 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668f7c3d-0626-4c67-a440-da1b877f62f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:19.228246 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668f7c3d-0626-4c67-a440-da1b877f62f7 admin admin] PATH_INFO: `/v3/projects/d481226324c843ce91b1eae9cce3a87e` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:19.230671 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-4d2a0a83-21bf-4520-bd10-3c584a0b1d1a None None] MFA Rules not processed for user `7a62cc0f17e0416cb69efa58dbd2df1f`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:58:19.231956 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668f7c3d-0626-4c67-a440-da1b877f62f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d481226324c843ce91b1eae9cce3a87e)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:19.232438 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-4d2a0a83-21bf-4520-bd10-3c584a0b1d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:19.238446 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668f7c3d-0626-4c67-a440-da1b877f62f7 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:19.415160 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 834/1675] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:58:19 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:58:19.415926 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2a0a83-21bf-4520-bd10-3c584a0b1d1a None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:19.438199 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2a0a83-21bf-4520-bd10-3c584a0b1d1a None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:19.468233 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-668f7c3d-0626-4c67-a440-da1b877f62f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd481226324c843ce91b1eae9cce3a87e', 'request_id': 'req-668f7c3d-0626-4c67-a440-da1b877f62f7'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:19.578282 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=88,keystone:DELETE=6,keystone:INSERT=6 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:58:19.580504 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-668f7c3d-0626-4c67-a440-da1b877f62f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd481226324c843ce91b1eae9cce3a87e', 'request_id': 'req-668f7c3d-0626-4c67-a440-da1b877f62f7'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:19.592061 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-668f7c3d-0626-4c67-a440-da1b877f62f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd481226324c843ce91b1eae9cce3a87e', 'request_id': 'req-668f7c3d-0626-4c67-a440-da1b877f62f7'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:19.635185 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-668f7c3d-0626-4c67-a440-da1b877f62f7 admin admin] The token cache is being invalidate because project d481226324c843ce91b1eae9cce3a87e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87019) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 17:58:19.636226 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-668f7c3d-0626-4c67-a440-da1b877f62f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:19.637759 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-668f7c3d-0626-4c67-a440-da1b877f62f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:19.644993 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 842/1676] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 14 17:58:19 2022] DELETE /identity/v3/projects/d481226324c843ce91b1eae9cce3a87e => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:58:19.650544 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8364bf8f-3f34-4842-8e0b-1a9ec0f8e5cc None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:19.650846 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8364bf8f-3f34-4842-8e0b-1a9ec0f8e5cc None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:19.651129 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8364bf8f-3f34-4842-8e0b-1a9ec0f8e5cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:19.659492 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55ab196-0e6a-41e2-848d-c7912a7f71a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:19.660197 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55ab196-0e6a-41e2-848d-c7912a7f71a2 admin admin] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:19.660482 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55ab196-0e6a-41e2-848d-c7912a7f71a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:19.660778 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55ab196-0e6a-41e2-848d-c7912a7f71a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:19.672845 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55ab196-0e6a-41e2-848d-c7912a7f71a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:19.672845 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55ab196-0e6a-41e2-848d-c7912a7f71a2 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:19.724608 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-8364bf8f-3f34-4842-8e0b-1a9ec0f8e5cc None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:58:19.725273 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:58:19.725910 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-8364bf8f-3f34-4842-8e0b-1a9ec0f8e5cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:19.756039 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 843/1677] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:58:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:58:19.757090 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8364bf8f-3f34-4842-8e0b-1a9ec0f8e5cc None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:19.763885 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-8364bf8f-3f34-4842-8e0b-1a9ec0f8e5cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:19.834215 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 835/1678] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 14 17:58:19 2022] POST /identity/v3/projects => generated 365 bytes in 417 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 17:58:19.834215 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64db0d3f-f924-436d-ace0-b10b02cab4ca None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:19.834215 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64db0d3f-f924-436d-ace0-b10b02cab4ca None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:19.834215 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64db0d3f-f924-436d-ace0-b10b02cab4ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:19.880517 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-64db0d3f-f924-436d-ace0-b10b02cab4ca None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:58:19.881580 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-64db0d3f-f924-436d-ace0-b10b02cab4ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:19.983723 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8364bf8f-3f34-4842-8e0b-1a9ec0f8e5cc None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:20.090758 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 836/1679] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:58:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:58:20.094631 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64db0d3f-f924-436d-ace0-b10b02cab4ca None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:20.098172 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-64db0d3f-f924-436d-ace0-b10b02cab4ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:20.141803 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64db0d3f-f924-436d-ace0-b10b02cab4ca None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:20.151771 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86046ac9-c4e5-4644-be35-43b89870fa23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:20.152482 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86046ac9-c4e5-4644-be35-43b89870fa23 admin admin] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:20.152778 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86046ac9-c4e5-4644-be35-43b89870fa23 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:20.153911 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86046ac9-c4e5-4644-be35-43b89870fa23 admin admin] PATH_INFO: `/v3/users` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:20.154825 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86046ac9-c4e5-4644-be35-43b89870fa23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:20.161756 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86046ac9-c4e5-4644-be35-43b89870fa23 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:20.185971 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2753b744-bd14-47fd-914e-ed0ddc2a52d2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba38b47a31b14526be0aa2054841881b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:20.189188 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2753b744-bd14-47fd-914e-ed0ddc2a52d2 service swift] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:20.190688 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2753b744-bd14-47fd-914e-ed0ddc2a52d2 service swift] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:20.190875 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2753b744-bd14-47fd-914e-ed0ddc2a52d2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:20.197430 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-2753b744-bd14-47fd-914e-ed0ddc2a52d2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:20.305375 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 837/1680] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 14 17:58:20 2022] POST /identity/v3/users => generated 289 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:58:20.306096 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86046ac9-c4e5-4644-be35-43b89870fa23 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:20.322594 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2753b744-bd14-47fd-914e-ed0ddc2a52d2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:20.325365 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2753b744-bd14-47fd-914e-ed0ddc2a52d2 service swift] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:20.332407 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86046ac9-c4e5-4644-be35-43b89870fa23 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:20.338371 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 844/1681] 10.222.0.36 () {60 vars in 1384 bytes} [Tue Jun 14 17:58:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 582 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 14 17:58:20.340971 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2753b744-bd14-47fd-914e-ed0ddc2a52d2 service swift] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:20.344970 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2313af-0c71-46b5-ac99-e2229d673648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:20.345808 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2313af-0c71-46b5-ac99-e2229d673648 admin admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:20.348007 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2313af-0c71-46b5-ac99-e2229d673648 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:20.348007 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2313af-0c71-46b5-ac99-e2229d673648 admin admin] PATH_INFO: `/v3/domains` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:20.349004 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2313af-0c71-46b5-ac99-e2229d673648 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:58:20.349329 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2313af-0c71-46b5-ac99-e2229d673648 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:20.353989 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2313af-0c71-46b5-ac99-e2229d673648 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:20.393063 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2753b744-bd14-47fd-914e-ed0ddc2a52d2 service swift] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:20.414373 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 838/1682] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 14 17:58:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:58:20.416525 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf768b57-a238-4187-b1f8-9685c7adf8b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:20.417971 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf768b57-a238-4187-b1f8-9685c7adf8b2 admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:20.418218 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2313af-0c71-46b5-ac99-e2229d673648 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:20.418734 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf768b57-a238-4187-b1f8-9685c7adf8b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:20.419385 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf768b57-a238-4187-b1f8-9685c7adf8b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:20.420641 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf768b57-a238-4187-b1f8-9685c7adf8b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:20.426571 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf768b57-a238-4187-b1f8-9685c7adf8b2 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:20.461905 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2313af-0c71-46b5-ac99-e2229d673648 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:20.479597 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 845/1683] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 17:58:20 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 17:58:20.486789 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23348440-3c81-427a-85c0-957c958b4543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:20.487623 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23348440-3c81-427a-85c0-957c958b4543 admin admin] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:20.487914 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23348440-3c81-427a-85c0-957c958b4543 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:20.488196 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23348440-3c81-427a-85c0-957c958b4543 admin admin] PATH_INFO: `/v3/projects` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:20.488907 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23348440-3c81-427a-85c0-957c958b4543 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:20.498405 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23348440-3c81-427a-85c0-957c958b4543 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:20.500801 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf768b57-a238-4187-b1f8-9685c7adf8b2 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:20.534807 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf768b57-a238-4187-b1f8-9685c7adf8b2 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:20.547703 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de07014c-7f06-4756-8ed9-0c2ce002543c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:20.548700 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de07014c-7f06-4756-8ed9-0c2ce002543c admin admin] REQUEST_METHOD: `PUT` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:20.549463 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de07014c-7f06-4756-8ed9-0c2ce002543c admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:20.549463 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de07014c-7f06-4756-8ed9-0c2ce002543c admin admin] PATH_INFO: `/v3/projects/ed37a42296a44f848c349b1c39f240b3/users/1cfd3e8118994142a2d9bb8c652bcd7a/roles/1348580877d04014bfdec4d866b98a74` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:20.592304 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de07014c-7f06-4756-8ed9-0c2ce002543c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed37a42296a44f848c349b1c39f240b3, user_id=1cfd3e8118994142a2d9bb8c652bcd7a, role_id=1348580877d04014bfdec4d866b98a74)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:20.605285 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de07014c-7f06-4756-8ed9-0c2ce002543c admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:20.700542 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 839/1684] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 14 17:58:20 2022] POST /identity/v3/projects => generated 373 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:58:20.701726 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23348440-3c81-427a-85c0-957c958b4543 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:20.738758 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 846/1685] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 17:58:20 2022] PUT /identity/v3/projects/ed37a42296a44f848c349b1c39f240b3/users/1cfd3e8118994142a2d9bb8c652bcd7a/roles/1348580877d04014bfdec4d866b98a74 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:58:20.742690 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de07014c-7f06-4756-8ed9-0c2ce002543c admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:20.895466 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:58:20.936461 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23348440-3c81-427a-85c0-957c958b4543 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:20.987447 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de07014c-7f06-4756-8ed9-0c2ce002543c admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:20.994996 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e83ca6-719e-4051-8e63-10be1c0ce518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:20.996332 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e83ca6-719e-4051-8e63-10be1c0ce518 admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:20.996889 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e83ca6-719e-4051-8e63-10be1c0ce518 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:20.997389 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e83ca6-719e-4051-8e63-10be1c0ce518 admin admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:20.999351 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e83ca6-719e-4051-8e63-10be1c0ce518 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:21.002993 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e83ca6-719e-4051-8e63-10be1c0ce518 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:21.012997 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:58:21.047932 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 847/1686] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 17:58:20 2022] GET /identity/v3/roles => generated 1420 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 17:58:21.052918 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e83ca6-719e-4051-8e63-10be1c0ce518 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:21.082057 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e83ca6-719e-4051-8e63-10be1c0ce518 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:21.099205 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3789079e-e4b3-4c0f-894e-89e7aae37d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:21.100812 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3789079e-e4b3-4c0f-894e-89e7aae37d0b admin admin] REQUEST_METHOD: `PUT` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:21.100812 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3789079e-e4b3-4c0f-894e-89e7aae37d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:21.100812 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3789079e-e4b3-4c0f-894e-89e7aae37d0b admin admin] PATH_INFO: `/v3/projects/ed37a42296a44f848c349b1c39f240b3/users/1cfd3e8118994142a2d9bb8c652bcd7a/roles/1348580877d04014bfdec4d866b98a74` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:21.106750 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3789079e-e4b3-4c0f-894e-89e7aae37d0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed37a42296a44f848c349b1c39f240b3, user_id=1cfd3e8118994142a2d9bb8c652bcd7a, role_id=1348580877d04014bfdec4d866b98a74)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:21.112476 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3789079e-e4b3-4c0f-894e-89e7aae37d0b admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:21.146595 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 848/1687] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 17:58:21 2022] PUT /identity/v3/projects/ed37a42296a44f848c349b1c39f240b3/users/1cfd3e8118994142a2d9bb8c652bcd7a/roles/1348580877d04014bfdec4d866b98a74 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:58:21.157779 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf5f4e9-8a89-43d8-bea4-e0a73d8ff3bc None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:21.158225 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf5f4e9-8a89-43d8-bea4-e0a73d8ff3bc None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:21.158576 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf5f4e9-8a89-43d8-bea4-e0a73d8ff3bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:21.217434 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4baa8f-c226-4eaf-95f0-66201abac4c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:21.219968 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4baa8f-c226-4eaf-95f0-66201abac4c8 admin admin] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:21.221354 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4baa8f-c226-4eaf-95f0-66201abac4c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:21.223492 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4baa8f-c226-4eaf-95f0-66201abac4c8 admin admin] PATH_INFO: `/v3/users` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:21.227899 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4baa8f-c226-4eaf-95f0-66201abac4c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:21.240446 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4baa8f-c226-4eaf-95f0-66201abac4c8 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:21.249531 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-5bf5f4e9-8a89-43d8-bea4-e0a73d8ff3bc None None] MFA Rules not processed for user `1cfd3e8118994142a2d9bb8c652bcd7a`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:58:21.251002 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:58:21.251161 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-5bf5f4e9-8a89-43d8-bea4-e0a73d8ff3bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:21.388467 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 840/1688] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 14 17:58:20 2022] POST /identity/v3/users => generated 287 bytes in 687 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:58:21.394596 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4baa8f-c226-4eaf-95f0-66201abac4c8 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:21.417133 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4baa8f-c226-4eaf-95f0-66201abac4c8 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:21.481607 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 849/1689] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:58:21 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:58:21.505194 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf5f4e9-8a89-43d8-bea4-e0a73d8ff3bc None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:21.506703 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-5bf5f4e9-8a89-43d8-bea4-e0a73d8ff3bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:21.657109 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e551ed-1042-4330-8e0a-92afc99a4d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:21.662660 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e551ed-1042-4330-8e0a-92afc99a4d7e admin admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:21.663243 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e551ed-1042-4330-8e0a-92afc99a4d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:21.663719 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e551ed-1042-4330-8e0a-92afc99a4d7e admin admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:21.670038 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e551ed-1042-4330-8e0a-92afc99a4d7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:21.670038 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e551ed-1042-4330-8e0a-92afc99a4d7e admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:21.699797 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 841/1690] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 17:58:21 2022] GET /identity/v3/roles => generated 1420 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 14 17:58:21.703977 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e551ed-1042-4330-8e0a-92afc99a4d7e admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:21.738746 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e551ed-1042-4330-8e0a-92afc99a4d7e admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:21.744470 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf5f4e9-8a89-43d8-bea4-e0a73d8ff3bc None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:21.752901 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70acfd2-faa1-4323-9890-b05329dcce97 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17945e7d72954b8787e0ba09a9903247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:21.753681 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70acfd2-faa1-4323-9890-b05329dcce97 service cinder] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:21.754212 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70acfd2-faa1-4323-9890-b05329dcce97 service cinder] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:21.754582 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70acfd2-faa1-4323-9890-b05329dcce97 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:21.769669 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70acfd2-faa1-4323-9890-b05329dcce97 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:21.770840 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f63d7f-bf35-4c5c-84b4-69bd5c4afc16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:21.771459 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70acfd2-faa1-4323-9890-b05329dcce97 service cinder] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:21.772389 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f63d7f-bf35-4c5c-84b4-69bd5c4afc16 admin admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:21.777029 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f63d7f-bf35-4c5c-84b4-69bd5c4afc16 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:21.779480 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f63d7f-bf35-4c5c-84b4-69bd5c4afc16 admin admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:21.780692 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f63d7f-bf35-4c5c-84b4-69bd5c4afc16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:21.787406 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f63d7f-bf35-4c5c-84b4-69bd5c4afc16 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:21.805235 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 850/1691] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:58:21 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 17:58:21.827563 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 842/1692] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 17:58:21 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 17:58:21.833361 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70acfd2-faa1-4323-9890-b05329dcce97 service cinder] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:21.853392 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70acfd2-faa1-4323-9890-b05329dcce97 service cinder] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:21.868406 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61be90fe-cf22-4516-ad6f-abf9602468d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:21.869435 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61be90fe-cf22-4516-ad6f-abf9602468d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:21.869727 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61be90fe-cf22-4516-ad6f-abf9602468d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:21.870059 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61be90fe-cf22-4516-ad6f-abf9602468d5 admin admin] PATH_INFO: `/v3/projects/eece3051a652463590f6752a0034585c/users/6621a49c8b1d42a885552b8acb18cdfd/roles/9ee80134743f4c2b88525b04df2facba` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:21.956607 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61be90fe-cf22-4516-ad6f-abf9602468d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eece3051a652463590f6752a0034585c, user_id=6621a49c8b1d42a885552b8acb18cdfd, role_id=9ee80134743f4c2b88525b04df2facba)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:21.974886 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61be90fe-cf22-4516-ad6f-abf9602468d5 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:22.299620 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f63d7f-bf35-4c5c-84b4-69bd5c4afc16 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:22.303242 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-37f63d7f-bf35-4c5c-84b4-69bd5c4afc16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:22.384053 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f63d7f-bf35-4c5c-84b4-69bd5c4afc16 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:22.417101 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca6c9bb-6086-42f7-9b29-bbe358f20e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:22.424107 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca6c9bb-6086-42f7-9b29-bbe358f20e2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:22.424921 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca6c9bb-6086-42f7-9b29-bbe358f20e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:22.426512 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca6c9bb-6086-42f7-9b29-bbe358f20e2b admin admin] PATH_INFO: `/v3/users/53322a6fc323412890fdd3d7d269b59d` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:22.440350 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca6c9bb-6086-42f7-9b29-bbe358f20e2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=53322a6fc323412890fdd3d7d269b59d)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:22.450388 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca6c9bb-6086-42f7-9b29-bbe358f20e2b admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:22.454369 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 851/1693] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 17:58:21 2022] PUT /identity/v3/projects/eece3051a652463590f6752a0034585c/users/6621a49c8b1d42a885552b8acb18cdfd/roles/9ee80134743f4c2b88525b04df2facba => generated 0 bytes in 610 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:58:22.458665 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189475a8-7477-40a6-a9ae-c8058b9e78b4 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:22.458986 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189475a8-7477-40a6-a9ae-c8058b9e78b4 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:22.459276 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189475a8-7477-40a6-a9ae-c8058b9e78b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:22.486666 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:58:22.583149 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-189475a8-7477-40a6-a9ae-c8058b9e78b4 None None] MFA Rules not processed for user `6621a49c8b1d42a885552b8acb18cdfd`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:58:22.584570 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-189475a8-7477-40a6-a9ae-c8058b9e78b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:22.746476 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 852/1694] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:58:22 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:58:22.753832 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189475a8-7477-40a6-a9ae-c8058b9e78b4 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:22.763709 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-189475a8-7477-40a6-a9ae-c8058b9e78b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:22.791532 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-0ca6c9bb-6086-42f7-9b29-bbe358f20e2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53322a6fc323412890fdd3d7d269b59d'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:22.793401 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-0ca6c9bb-6086-42f7-9b29-bbe358f20e2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53322a6fc323412890fdd3d7d269b59d'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:22.795735 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-0ca6c9bb-6086-42f7-9b29-bbe358f20e2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53322a6fc323412890fdd3d7d269b59d'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:22.892378 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-0ca6c9bb-6086-42f7-9b29-bbe358f20e2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53322a6fc323412890fdd3d7d269b59d'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:22.916696 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-0ca6c9bb-6086-42f7-9b29-bbe358f20e2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53322a6fc323412890fdd3d7d269b59d'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:22.957882 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189475a8-7477-40a6-a9ae-c8058b9e78b4 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:22.971715 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 843/1695] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 14 17:58:22 2022] DELETE /identity/v3/users/53322a6fc323412890fdd3d7d269b59d => generated 0 bytes in 673 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:58:22.971715 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d7eb55-95ce-4330-87e5-617039711ada None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:22.971715 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d7eb55-95ce-4330-87e5-617039711ada None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:22.972035 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d7eb55-95ce-4330-87e5-617039711ada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:22.990435 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d3562f-8774-4c8a-b928-f697e0e119ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:22.991639 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d3562f-8774-4c8a-b928-f697e0e119ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:22.992069 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d3562f-8774-4c8a-b928-f697e0e119ce admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:22.992381 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d3562f-8774-4c8a-b928-f697e0e119ce admin admin] PATH_INFO: `/v3/projects/0eaf9a10913d4c7390691032b238bb85` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:22.994005 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d3562f-8774-4c8a-b928-f697e0e119ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=0eaf9a10913d4c7390691032b238bb85)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:22.996276 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d3562f-8774-4c8a-b928-f697e0e119ce admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:23.002475 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-15d7eb55-95ce-4330-87e5-617039711ada None None] MFA Rules not processed for user `5652329c71cd431fb579d69cef933b37`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:58:23.004305 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-15d7eb55-95ce-4330-87e5-617039711ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:23.069693 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:58:23.148297 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 844/1696] 10.222.0.62 () {58 vars in 1015 bytes} [Tue Jun 14 17:58:22 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:58:23.149257 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d7eb55-95ce-4330-87e5-617039711ada None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:23.151008 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-15d7eb55-95ce-4330-87e5-617039711ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:23.240778 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-c8d3562f-8774-4c8a-b928-f697e0e119ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0eaf9a10913d4c7390691032b238bb85', 'request_id': 'req-c8d3562f-8774-4c8a-b928-f697e0e119ce'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:23.330890 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-c8d3562f-8774-4c8a-b928-f697e0e119ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0eaf9a10913d4c7390691032b238bb85', 'request_id': 'req-c8d3562f-8774-4c8a-b928-f697e0e119ce'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:23.341592 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-c8d3562f-8774-4c8a-b928-f697e0e119ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0eaf9a10913d4c7390691032b238bb85', 'request_id': 'req-c8d3562f-8774-4c8a-b928-f697e0e119ce'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:23.367878 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-c8d3562f-8774-4c8a-b928-f697e0e119ce admin admin] The token cache is being invalidate because project 0eaf9a10913d4c7390691032b238bb85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87019) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 17:58:23.368301 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-c8d3562f-8774-4c8a-b928-f697e0e119ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:23.370859 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-c8d3562f-8774-4c8a-b928-f697e0e119ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:23.375357 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 853/1697] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 14 17:58:22 2022] DELETE /identity/v3/projects/0eaf9a10913d4c7390691032b238bb85 => generated 0 bytes in 628 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:58:23.376724 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86af64b7-01ac-4816-b8ba-dc3c0549f9c2 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:23.377018 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86af64b7-01ac-4816-b8ba-dc3c0549f9c2 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:23.377301 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86af64b7-01ac-4816-b8ba-dc3c0549f9c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:23.392878 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d7eb55-95ce-4330-87e5-617039711ada None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:23.435150 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-86af64b7-01ac-4816-b8ba-dc3c0549f9c2 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:58:23.437854 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-86af64b7-01ac-4816-b8ba-dc3c0549f9c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:23.541110 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e083ed5-b32d-4024-9441-48dd6283f033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:23.542166 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e083ed5-b32d-4024-9441-48dd6283f033 admin admin] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:23.542674 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e083ed5-b32d-4024-9441-48dd6283f033 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:23.543159 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e083ed5-b32d-4024-9441-48dd6283f033 admin admin] PATH_INFO: `/v3/projects` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:23.544496 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e083ed5-b32d-4024-9441-48dd6283f033 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:23.550747 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 854/1698] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:58:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:58:23.551965 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86af64b7-01ac-4816-b8ba-dc3c0549f9c2 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:23.552099 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e083ed5-b32d-4024-9441-48dd6283f033 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:23.554393 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-86af64b7-01ac-4816-b8ba-dc3c0549f9c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:23.638620 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86af64b7-01ac-4816-b8ba-dc3c0549f9c2 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:23.646404 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111e5488-eb96-490e-895e-13a1b6e69636 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5652329c71cd431fb579d69cef933b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:23.656684 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111e5488-eb96-490e-895e-13a1b6e69636 service neutron] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:23.657337 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111e5488-eb96-490e-895e-13a1b6e69636 service neutron] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:23.657839 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111e5488-eb96-490e-895e-13a1b6e69636 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:23.661393 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-111e5488-eb96-490e-895e-13a1b6e69636 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:23.680434 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111e5488-eb96-490e-895e-13a1b6e69636 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:23.682594 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111e5488-eb96-490e-895e-13a1b6e69636 service neutron] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:23.698766 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 845/1699] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 14 17:58:23 2022] POST /identity/v3/projects => generated 373 bytes in 550 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:58:23.702153 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e083ed5-b32d-4024-9441-48dd6283f033 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:23.707925 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-2e083ed5-b32d-4024-9441-48dd6283f033 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:23.717403 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 855/1700] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:58:23 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:58:23.727644 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111e5488-eb96-490e-895e-13a1b6e69636 service neutron] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:23.760297 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:58:23.773729 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111e5488-eb96-490e-895e-13a1b6e69636 service neutron] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:23.877287 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e083ed5-b32d-4024-9441-48dd6283f033 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:23.884674 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7b8292-3bde-4b04-bf20-76cede3454a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5652329c71cd431fb579d69cef933b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:23.885787 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7b8292-3bde-4b04-bf20-76cede3454a4 service neutron] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:23.886260 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7b8292-3bde-4b04-bf20-76cede3454a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:23.886555 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7b8292-3bde-4b04-bf20-76cede3454a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:23.894207 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe8129c-5719-430d-b63e-4a946736a358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:23.895384 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe8129c-5719-430d-b63e-4a946736a358 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:23.895778 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe8129c-5719-430d-b63e-4a946736a358 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:23.896216 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe8129c-5719-430d-b63e-4a946736a358 admin admin] PATH_INFO: `/v3/users/d0be11a52fde414695b7c0d181a2c7c9` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:23.897736 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe8129c-5719-430d-b63e-4a946736a358 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0be11a52fde414695b7c0d181a2c7c9)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:23.899908 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe8129c-5719-430d-b63e-4a946736a358 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:23.916966 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7b8292-3bde-4b04-bf20-76cede3454a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:23.918987 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7b8292-3bde-4b04-bf20-76cede3454a4 service neutron] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:23.935851 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 856/1701] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:58:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:58:23.939258 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d32c2b7-88e4-4583-813e-b8f809c0a58c None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:23.942520 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d32c2b7-88e4-4583-813e-b8f809c0a58c None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:23.942520 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d32c2b7-88e4-4583-813e-b8f809c0a58c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:24.027885 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-7d32c2b7-88e4-4583-813e-b8f809c0a58c None None] MFA Rules not processed for user `0b64d79cbd27413cb9d6064e7b9c88e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:58:24.044130 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-7d32c2b7-88e4-4583-813e-b8f809c0a58c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:24.150943 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-dbe8129c-5719-430d-b63e-4a946736a358 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0be11a52fde414695b7c0d181a2c7c9'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:24.153847 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-dbe8129c-5719-430d-b63e-4a946736a358 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0be11a52fde414695b7c0d181a2c7c9'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:24.154291 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-dbe8129c-5719-430d-b63e-4a946736a358 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0be11a52fde414695b7c0d181a2c7c9'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:24.184794 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 857/1702] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:58:23 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:58:24.189382 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d32c2b7-88e4-4583-813e-b8f809c0a58c None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:24.211552 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-7d32c2b7-88e4-4583-813e-b8f809c0a58c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:24.225456 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d32c2b7-88e4-4583-813e-b8f809c0a58c None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:24.228592 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-dbe8129c-5719-430d-b63e-4a946736a358 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0be11a52fde414695b7c0d181a2c7c9'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:24.239804 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-dbe8129c-5719-430d-b63e-4a946736a358 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0be11a52fde414695b7c0d181a2c7c9'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:24.251320 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9afee1a-66ca-4cd6-8e8f-0ca9802d1110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:24.255042 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9afee1a-66ca-4cd6-8e8f-0ca9802d1110 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:24.255578 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9afee1a-66ca-4cd6-8e8f-0ca9802d1110 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:24.255868 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9afee1a-66ca-4cd6-8e8f-0ca9802d1110 admin admin] PATH_INFO: `/v3/users/7a62cc0f17e0416cb69efa58dbd2df1f` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:24.261845 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9afee1a-66ca-4cd6-8e8f-0ca9802d1110 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a62cc0f17e0416cb69efa58dbd2df1f)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:24.268322 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9afee1a-66ca-4cd6-8e8f-0ca9802d1110 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:24.288183 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 846/1703] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 14 17:58:23 2022] DELETE /identity/v3/users/d0be11a52fde414695b7c0d181a2c7c9 => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:58:24.298159 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe8129c-5719-430d-b63e-4a946736a358 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:24.298159 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-dbe8129c-5719-430d-b63e-4a946736a358 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:24.344494 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:58:24.412542 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe8129c-5719-430d-b63e-4a946736a358 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:24.418380 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fe21b6-43dc-4750-8f0f-c2ad5696d5d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:24.419433 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fe21b6-43dc-4750-8f0f-c2ad5696d5d6 admin admin] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:24.419861 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fe21b6-43dc-4750-8f0f-c2ad5696d5d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:24.422948 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fe21b6-43dc-4750-8f0f-c2ad5696d5d6 admin admin] PATH_INFO: `/v3/users` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:24.424025 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fe21b6-43dc-4750-8f0f-c2ad5696d5d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:24.426411 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fe21b6-43dc-4750-8f0f-c2ad5696d5d6 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:24.523709 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 847/1704] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 14 17:58:24 2022] POST /identity/v3/users => generated 293 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:58:24.524736 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fe21b6-43dc-4750-8f0f-c2ad5696d5d6 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:24.526116 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-f9afee1a-66ca-4cd6-8e8f-0ca9802d1110 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a62cc0f17e0416cb69efa58dbd2df1f'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:24.528282 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-f9afee1a-66ca-4cd6-8e8f-0ca9802d1110 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a62cc0f17e0416cb69efa58dbd2df1f'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:24.528773 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-97fe21b6-43dc-4750-8f0f-c2ad5696d5d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:24.533883 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-f9afee1a-66ca-4cd6-8e8f-0ca9802d1110 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a62cc0f17e0416cb69efa58dbd2df1f'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:24.651258 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-f9afee1a-66ca-4cd6-8e8f-0ca9802d1110 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a62cc0f17e0416cb69efa58dbd2df1f'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:24.662714 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-f9afee1a-66ca-4cd6-8e8f-0ca9802d1110 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a62cc0f17e0416cb69efa58dbd2df1f'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:24.696001 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 858/1705] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 14 17:58:24 2022] DELETE /identity/v3/users/7a62cc0f17e0416cb69efa58dbd2df1f => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:58:24.697357 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9afee1a-66ca-4cd6-8e8f-0ca9802d1110 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:24.698854 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-f9afee1a-66ca-4cd6-8e8f-0ca9802d1110 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:24.726708 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fe21b6-43dc-4750-8f0f-c2ad5696d5d6 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:24.760638 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:58:24.848167 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9afee1a-66ca-4cd6-8e8f-0ca9802d1110 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:24.861193 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26e9ec1-9bed-4d32-aac0-510721d66eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:24.866462 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26e9ec1-9bed-4d32-aac0-510721d66eaa admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:24.866462 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26e9ec1-9bed-4d32-aac0-510721d66eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:24.866462 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26e9ec1-9bed-4d32-aac0-510721d66eaa admin admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:24.868656 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26e9ec1-9bed-4d32-aac0-510721d66eaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:24.873598 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26e9ec1-9bed-4d32-aac0-510721d66eaa admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:24.915703 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 859/1706] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 17:58:24 2022] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 17:58:24.917893 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f82f8a4-79c5-4e25-afb0-f52e3f418dd9 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:24.918306 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f82f8a4-79c5-4e25-afb0-f52e3f418dd9 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:24.919115 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f82f8a4-79c5-4e25-afb0-f52e3f418dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:24.947852 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311fd1de-d87f-4c39-8abf-25611b31aad6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4696d396adb495ab300a9a5a5727595', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:24.948565 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311fd1de-d87f-4c39-8abf-25611b31aad6 service nova] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:24.948860 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311fd1de-d87f-4c39-8abf-25611b31aad6 service nova] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:24.949190 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311fd1de-d87f-4c39-8abf-25611b31aad6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:24.955408 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-311fd1de-d87f-4c39-8abf-25611b31aad6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:24.957567 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-1f82f8a4-79c5-4e25-afb0-f52e3f418dd9 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:58:24.959215 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-1f82f8a4-79c5-4e25-afb0-f52e3f418dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:24.971986 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 860/1707] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:58:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:58:24.973410 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f82f8a4-79c5-4e25-afb0-f52e3f418dd9 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:24.987197 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f82f8a4-79c5-4e25-afb0-f52e3f418dd9 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:24.993560 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c9d997-87ee-4dcd-92af-cbda38682886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:24.995634 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c9d997-87ee-4dcd-92af-cbda38682886 admin admin] REQUEST_METHOD: `PUT` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:24.996486 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c9d997-87ee-4dcd-92af-cbda38682886 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:24.996923 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c9d997-87ee-4dcd-92af-cbda38682886 admin admin] PATH_INFO: `/v3/projects/63930faef8184edc9c3d17e479e274f1/users/0d104225eeb8478085689f5fdf52e8d7/roles/1348580877d04014bfdec4d866b98a74` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:25.019961 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c9d997-87ee-4dcd-92af-cbda38682886 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63930faef8184edc9c3d17e479e274f1, user_id=0d104225eeb8478085689f5fdf52e8d7, role_id=1348580877d04014bfdec4d866b98a74)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:25.023644 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c9d997-87ee-4dcd-92af-cbda38682886 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:25.141791 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 861/1708] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 17:58:24 2022] PUT /identity/v3/projects/63930faef8184edc9c3d17e479e274f1/users/0d104225eeb8478085689f5fdf52e8d7/roles/1348580877d04014bfdec4d866b98a74 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:58:25.141791 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c9d997-87ee-4dcd-92af-cbda38682886 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:25.160193 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-c7c9d997-87ee-4dcd-92af-cbda38682886 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:25.168237 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311fd1de-d87f-4c39-8abf-25611b31aad6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:25.171168 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311fd1de-d87f-4c39-8abf-25611b31aad6 service nova] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:25.205309 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 848/1709] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:58:24 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 681 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:58:25.207118 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311fd1de-d87f-4c39-8abf-25611b31aad6 service nova] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:25.233504 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311fd1de-d87f-4c39-8abf-25611b31aad6 service nova] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:25.400238 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c9d997-87ee-4dcd-92af-cbda38682886 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:25.432040 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dac875-d1a0-46d2-99b9-65806ea7e5be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5652329c71cd431fb579d69cef933b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:25.433790 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dac875-d1a0-46d2-99b9-65806ea7e5be service neutron] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:25.435002 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dac875-d1a0-46d2-99b9-65806ea7e5be service neutron] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:25.438618 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dac875-d1a0-46d2-99b9-65806ea7e5be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:25.507172 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bb43ee-5b63-42eb-9f83-eccc0bae584f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:25.513435 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bb43ee-5b63-42eb-9f83-eccc0bae584f admin admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:25.515041 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bb43ee-5b63-42eb-9f83-eccc0bae584f admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:25.516540 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bb43ee-5b63-42eb-9f83-eccc0bae584f admin admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:25.518068 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bb43ee-5b63-42eb-9f83-eccc0bae584f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:25.522720 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bb43ee-5b63-42eb-9f83-eccc0bae584f admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:25.562774 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 849/1710] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 17:58:25 2022] GET /identity/v3/roles => generated 1420 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 17:58:25.566666 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bb43ee-5b63-42eb-9f83-eccc0bae584f admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:25.599809 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bb43ee-5b63-42eb-9f83-eccc0bae584f admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:25.613574 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958bc345-2f1d-499a-b0a4-9175f38ba5e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:25.615051 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958bc345-2f1d-499a-b0a4-9175f38ba5e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:25.616449 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958bc345-2f1d-499a-b0a4-9175f38ba5e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:25.616893 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958bc345-2f1d-499a-b0a4-9175f38ba5e5 admin admin] PATH_INFO: `/v3/projects/63930faef8184edc9c3d17e479e274f1/users/0d104225eeb8478085689f5fdf52e8d7/roles/1348580877d04014bfdec4d866b98a74` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:25.622331 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958bc345-2f1d-499a-b0a4-9175f38ba5e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63930faef8184edc9c3d17e479e274f1, user_id=0d104225eeb8478085689f5fdf52e8d7, role_id=1348580877d04014bfdec4d866b98a74)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:25.635369 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958bc345-2f1d-499a-b0a4-9175f38ba5e5 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:25.701483 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 850/1711] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 17:58:25 2022] PUT /identity/v3/projects/63930faef8184edc9c3d17e479e274f1/users/0d104225eeb8478085689f5fdf52e8d7/roles/1348580877d04014bfdec4d866b98a74 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:58:25.709491 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dac875-d1a0-46d2-99b9-65806ea7e5be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:25.712794 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acbb32e-1c6f-49d4-bd3e-badb97ea67b7 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:25.713152 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acbb32e-1c6f-49d4-bd3e-badb97ea67b7 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:25.713451 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acbb32e-1c6f-49d4-bd3e-badb97ea67b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:25.715776 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dac875-d1a0-46d2-99b9-65806ea7e5be service neutron] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:25.744099 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 862/1712] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:58:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 604 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:58:25.825968 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-8acbb32e-1c6f-49d4-bd3e-badb97ea67b7 None None] MFA Rules not processed for user `0d104225eeb8478085689f5fdf52e8d7`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:58:25.828005 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-8acbb32e-1c6f-49d4-bd3e-badb97ea67b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:26.072662 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 851/1713] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:58:25 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 361 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 17:58:26.093325 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dac875-d1a0-46d2-99b9-65806ea7e5be service neutron] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:26.098286 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-27dac875-d1a0-46d2-99b9-65806ea7e5be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:26.217197 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:58:26.220054 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dac875-d1a0-46d2-99b9-65806ea7e5be service neutron] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:26.438670 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878738f9-5009-4abb-ac83-a74c41fc94fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17945e7d72954b8787e0ba09a9903247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:26.441000 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878738f9-5009-4abb-ac83-a74c41fc94fe service cinder] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:26.442939 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878738f9-5009-4abb-ac83-a74c41fc94fe service cinder] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:26.443635 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878738f9-5009-4abb-ac83-a74c41fc94fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:26.450983 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:58:26.501956 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878738f9-5009-4abb-ac83-a74c41fc94fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:26.507487 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878738f9-5009-4abb-ac83-a74c41fc94fe service cinder] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:26.573674 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 863/1714] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:58:26 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:58:26.899727 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acbb32e-1c6f-49d4-bd3e-badb97ea67b7 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:26.901356 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-8acbb32e-1c6f-49d4-bd3e-badb97ea67b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:26.951388 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e0d362-940e-4b19-bc7c-0799d19c45ae None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:26.951833 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e0d362-940e-4b19-bc7c-0799d19c45ae None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:26.952123 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e0d362-940e-4b19-bc7c-0799d19c45ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:27.122915 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-96e0d362-940e-4b19-bc7c-0799d19c45ae None None] MFA Rules not processed for user `9c7ab182f1fd41718376a8e2f03ec87c`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:58:27.135090 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-96e0d362-940e-4b19-bc7c-0799d19c45ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:27.276521 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acbb32e-1c6f-49d4-bd3e-badb97ea67b7 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:27.294278 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc279a6-9e8f-4302-8367-562cace42545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:27.303751 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc279a6-9e8f-4302-8367-562cace42545 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:27.304289 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc279a6-9e8f-4302-8367-562cace42545 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:27.305204 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc279a6-9e8f-4302-8367-562cace42545 admin admin] PATH_INFO: `/v3/projects/c13307b3a9c44b75a6558dbbee0ee07f` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:27.311149 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc279a6-9e8f-4302-8367-562cace42545 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c13307b3a9c44b75a6558dbbee0ee07f)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:27.317415 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc279a6-9e8f-4302-8367-562cace42545 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:27.424134 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 864/1715] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:58:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 474 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:58:27.427571 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e0d362-940e-4b19-bc7c-0799d19c45ae None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:27.452119 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e0d362-940e-4b19-bc7c-0799d19c45ae None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:27.463154 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7100a4-db6a-4afc-aa72-4a8e1f66fd9d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17945e7d72954b8787e0ba09a9903247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:27.465159 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7100a4-db6a-4afc-aa72-4a8e1f66fd9d service cinder] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:27.465480 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7100a4-db6a-4afc-aa72-4a8e1f66fd9d service cinder] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:27.465829 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7100a4-db6a-4afc-aa72-4a8e1f66fd9d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:27.473836 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-2d7100a4-db6a-4afc-aa72-4a8e1f66fd9d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:27.560660 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-0dc279a6-9e8f-4302-8367-562cace42545 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c13307b3a9c44b75a6558dbbee0ee07f', 'request_id': 'req-0dc279a6-9e8f-4302-8367-562cace42545'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:27.658369 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-0dc279a6-9e8f-4302-8367-562cace42545 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c13307b3a9c44b75a6558dbbee0ee07f', 'request_id': 'req-0dc279a6-9e8f-4302-8367-562cace42545'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:27.671072 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-0dc279a6-9e8f-4302-8367-562cace42545 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c13307b3a9c44b75a6558dbbee0ee07f', 'request_id': 'req-0dc279a6-9e8f-4302-8367-562cace42545'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:27.690064 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-0dc279a6-9e8f-4302-8367-562cace42545 admin admin] The token cache is being invalidate because project c13307b3a9c44b75a6558dbbee0ee07f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 17:58:27.690371 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-0dc279a6-9e8f-4302-8367-562cace42545 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:27.691283 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-0dc279a6-9e8f-4302-8367-562cace42545 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:27.697859 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 852/1716] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 14 17:58:26 2022] DELETE /identity/v3/projects/c13307b3a9c44b75a6558dbbee0ee07f => generated 0 bytes in 795 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:58:27.698529 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7100a4-db6a-4afc-aa72-4a8e1f66fd9d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:27.701387 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7100a4-db6a-4afc-aa72-4a8e1f66fd9d service cinder] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:27.724111 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc279a6-9e8f-4302-8367-562cace42545 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:27.729603 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-0dc279a6-9e8f-4302-8367-562cace42545 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:27.757256 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 865/1717] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:58:27 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:58:27.763947 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9dbb2e-e967-4e80-beac-9bd3712f2d15 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:27.764253 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9dbb2e-e967-4e80-beac-9bd3712f2d15 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:27.764539 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9dbb2e-e967-4e80-beac-9bd3712f2d15 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:27.766532 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 866/1718] 10.222.0.36 () {54 vars in 921 bytes} [Tue Jun 14 17:58:27 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:58:27.777657 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9dbb2e-e967-4e80-beac-9bd3712f2d15 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:27.786833 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-1e9dbb2e-e967-4e80-beac-9bd3712f2d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:27.924380 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc279a6-9e8f-4302-8367-562cace42545 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:27.927749 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66454f6e-7739-4968-8f10-f21572c09cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:27.929550 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66454f6e-7739-4968-8f10-f21572c09cd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:27.929854 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66454f6e-7739-4968-8f10-f21572c09cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:27.930143 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66454f6e-7739-4968-8f10-f21572c09cd5 admin admin] PATH_INFO: `/v3/projects/49160b62598a4277be1f2d4b5d513650` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:27.931505 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66454f6e-7739-4968-8f10-f21572c09cd5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49160b62598a4277be1f2d4b5d513650)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:27.933731 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66454f6e-7739-4968-8f10-f21572c09cd5 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:27.996552 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9dbb2e-e967-4e80-beac-9bd3712f2d15 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:28.005988 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02ab150-2b6a-46e3-bc40-cf418cf70abe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4696d396adb495ab300a9a5a5727595', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:28.006848 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ab150-2b6a-46e3-bc40-cf418cf70abe service nova] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:28.006848 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ab150-2b6a-46e3-bc40-cf418cf70abe service nova] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:28.007407 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ab150-2b6a-46e3-bc40-cf418cf70abe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:28.010202 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-e02ab150-2b6a-46e3-bc40-cf418cf70abe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:28.011929 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:58:28.094702 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-66454f6e-7739-4968-8f10-f21572c09cd5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49160b62598a4277be1f2d4b5d513650', 'request_id': 'req-66454f6e-7739-4968-8f10-f21572c09cd5'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:28.163267 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:58:28.185597 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-66454f6e-7739-4968-8f10-f21572c09cd5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49160b62598a4277be1f2d4b5d513650', 'request_id': 'req-66454f6e-7739-4968-8f10-f21572c09cd5'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:28.205046 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-66454f6e-7739-4968-8f10-f21572c09cd5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49160b62598a4277be1f2d4b5d513650', 'request_id': 'req-66454f6e-7739-4968-8f10-f21572c09cd5'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:28.209493 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02ab150-2b6a-46e3-bc40-cf418cf70abe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:28.217867 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02ab150-2b6a-46e3-bc40-cf418cf70abe service nova] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:28.245942 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 867/1719] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:58:27 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:58:28.247041 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02ab150-2b6a-46e3-bc40-cf418cf70abe service nova] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:28.248197 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-66454f6e-7739-4968-8f10-f21572c09cd5 admin admin] The token cache is being invalidate because project 49160b62598a4277be1f2d4b5d513650 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 17:58:28.249018 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-e02ab150-2b6a-46e3-bc40-cf418cf70abe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:28.249405 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-66454f6e-7739-4968-8f10-f21572c09cd5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:28.252089 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-66454f6e-7739-4968-8f10-f21572c09cd5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:28.255690 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 853/1720] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 14 17:58:27 2022] DELETE /identity/v3/projects/49160b62598a4277be1f2d4b5d513650 => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:58:28.257393 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4410c0ba-2da1-498c-935f-932d626ca39b None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:28.257690 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4410c0ba-2da1-498c-935f-932d626ca39b None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:28.258050 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4410c0ba-2da1-498c-935f-932d626ca39b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:28.296012 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-4410c0ba-2da1-498c-935f-932d626ca39b None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:58:28.312363 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02ab150-2b6a-46e3-bc40-cf418cf70abe service nova] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:28.333168 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-4410c0ba-2da1-498c-935f-932d626ca39b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:28.500438 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ade219-6608-4630-8de9-f00affa99cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:28.504985 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ade219-6608-4630-8de9-f00affa99cce admin admin] REQUEST_METHOD: `DELETE` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:28.505320 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ade219-6608-4630-8de9-f00affa99cce admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:28.505704 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ade219-6608-4630-8de9-f00affa99cce admin admin] PATH_INFO: `/v3/projects/554c9349f0cd4f6b8ea93270092d0b97` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:28.508671 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ade219-6608-4630-8de9-f00affa99cce admin admin] RBAC: Authorizing `identity:delete_project(project_id=554c9349f0cd4f6b8ea93270092d0b97)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:28.519433 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ade219-6608-4630-8de9-f00affa99cce admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:28.559384 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 854/1721] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:58:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:58:28.563085 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533706d6-bd2c-4704-8273-7b7d0b861409 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:28.566859 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533706d6-bd2c-4704-8273-7b7d0b861409 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:28.567318 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533706d6-bd2c-4704-8273-7b7d0b861409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:28.649010 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-533706d6-bd2c-4704-8273-7b7d0b861409 None None] MFA Rules not processed for user `e4696d396adb495ab300a9a5a5727595`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:58:28.650426 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-533706d6-bd2c-4704-8273-7b7d0b861409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:28.774195 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-09ade219-6608-4630-8de9-f00affa99cce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '554c9349f0cd4f6b8ea93270092d0b97', 'request_id': 'req-09ade219-6608-4630-8de9-f00affa99cce'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:28.851874 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-09ade219-6608-4630-8de9-f00affa99cce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '554c9349f0cd4f6b8ea93270092d0b97', 'request_id': 'req-09ade219-6608-4630-8de9-f00affa99cce'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:28.860791 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-09ade219-6608-4630-8de9-f00affa99cce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '554c9349f0cd4f6b8ea93270092d0b97', 'request_id': 'req-09ade219-6608-4630-8de9-f00affa99cce'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:28.886874 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 855/1722] 10.222.0.36 () {58 vars in 1018 bytes} [Tue Jun 14 17:58:28 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:58:28.891279 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f142188e-9b5d-4a90-af11-02140cad013c None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:28.895575 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f142188e-9b5d-4a90-af11-02140cad013c None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:28.895575 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f142188e-9b5d-4a90-af11-02140cad013c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:28.908590 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-09ade219-6608-4630-8de9-f00affa99cce admin admin] The token cache is being invalidate because project 554c9349f0cd4f6b8ea93270092d0b97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87019) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 17:58:28.908895 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-09ade219-6608-4630-8de9-f00affa99cce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:28.909764 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-09ade219-6608-4630-8de9-f00affa99cce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:28.934714 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 868/1723] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 14 17:58:28 2022] DELETE /identity/v3/projects/554c9349f0cd4f6b8ea93270092d0b97 => generated 0 bytes in 679 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:58:28.934714 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a098cc-d04f-4f75-b698-cf0142eae7a4 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:28.934714 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a098cc-d04f-4f75-b698-cf0142eae7a4 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:28.934714 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a098cc-d04f-4f75-b698-cf0142eae7a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:28.955962 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-f142188e-9b5d-4a90-af11-02140cad013c None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:58:28.958009 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-f142188e-9b5d-4a90-af11-02140cad013c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:28.994807 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-28a098cc-d04f-4f75-b698-cf0142eae7a4 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:58:28.996071 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-28a098cc-d04f-4f75-b698-cf0142eae7a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:29.138399 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 856/1724] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:58:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:58:29.147084 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f142188e-9b5d-4a90-af11-02140cad013c None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:29.148790 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-f142188e-9b5d-4a90-af11-02140cad013c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:29.154546 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:58:29.167505 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 869/1725] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:58:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:58:29.169601 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a098cc-d04f-4f75-b698-cf0142eae7a4 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:29.182252 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-28a098cc-d04f-4f75-b698-cf0142eae7a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:29.189012 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f142188e-9b5d-4a90-af11-02140cad013c None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:29.194488 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab0fcc8-a025-4951-b1c1-4a77dfd28cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:29.195548 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab0fcc8-a025-4951-b1c1-4a77dfd28cdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:29.195910 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab0fcc8-a025-4951-b1c1-4a77dfd28cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:29.196261 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab0fcc8-a025-4951-b1c1-4a77dfd28cdd admin admin] PATH_INFO: `/v3/users/1cfd3e8118994142a2d9bb8c652bcd7a` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:29.201832 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab0fcc8-a025-4951-b1c1-4a77dfd28cdd admin admin] RBAC: Authorizing `identity:delete_user(user_id=1cfd3e8118994142a2d9bb8c652bcd7a)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:29.207555 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab0fcc8-a025-4951-b1c1-4a77dfd28cdd admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:29.358563 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a098cc-d04f-4f75-b698-cf0142eae7a4 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:29.375957 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f643211f-1252-4330-93b1-3b2a304bded4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4696d396adb495ab300a9a5a5727595', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:29.379085 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f643211f-1252-4330-93b1-3b2a304bded4 service nova] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:29.379544 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f643211f-1252-4330-93b1-3b2a304bded4 service nova] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:29.379908 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f643211f-1252-4330-93b1-3b2a304bded4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:29.383538 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-f643211f-1252-4330-93b1-3b2a304bded4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:29.428762 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:58:29.433295 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f643211f-1252-4330-93b1-3b2a304bded4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:29.435690 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f643211f-1252-4330-93b1-3b2a304bded4 service nova] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:29.456577 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 870/1726] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:58:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:58:29.458360 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460b4efe-4486-4b35-bae0-f497b51861ec None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:29.458748 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460b4efe-4486-4b35-bae0-f497b51861ec None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:29.459140 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460b4efe-4486-4b35-bae0-f497b51861ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:29.466500 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-fab0fcc8-a025-4951-b1c1-4a77dfd28cdd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1cfd3e8118994142a2d9bb8c652bcd7a'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:29.474662 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-fab0fcc8-a025-4951-b1c1-4a77dfd28cdd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1cfd3e8118994142a2d9bb8c652bcd7a'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:29.474662 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-fab0fcc8-a025-4951-b1c1-4a77dfd28cdd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1cfd3e8118994142a2d9bb8c652bcd7a'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:29.529492 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-460b4efe-4486-4b35-bae0-f497b51861ec None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:58:29.533033 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-460b4efe-4486-4b35-bae0-f497b51861ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:29.570818 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 871/1727] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:58:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:58:29.573379 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460b4efe-4486-4b35-bae0-f497b51861ec None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:29.580881 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-460b4efe-4486-4b35-bae0-f497b51861ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:29.583030 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-fab0fcc8-a025-4951-b1c1-4a77dfd28cdd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1cfd3e8118994142a2d9bb8c652bcd7a'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:29.596829 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-fab0fcc8-a025-4951-b1c1-4a77dfd28cdd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1cfd3e8118994142a2d9bb8c652bcd7a'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:29.622066 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460b4efe-4486-4b35-bae0-f497b51861ec None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:29.636741 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5256c9c-8c36-4bfe-bc22-dfd97d15efee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:29.638395 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5256c9c-8c36-4bfe-bc22-dfd97d15efee admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:29.642353 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5256c9c-8c36-4bfe-bc22-dfd97d15efee admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:29.643528 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5256c9c-8c36-4bfe-bc22-dfd97d15efee admin admin] PATH_INFO: `/v3/domains` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:29.645413 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5256c9c-8c36-4bfe-bc22-dfd97d15efee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:58:29.648082 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5256c9c-8c36-4bfe-bc22-dfd97d15efee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:29.659164 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5256c9c-8c36-4bfe-bc22-dfd97d15efee admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:29.700494 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 872/1728] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 14 17:58:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:58:29.704696 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5256c9c-8c36-4bfe-bc22-dfd97d15efee admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:29.723315 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 857/1729] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 14 17:58:29 2022] DELETE /identity/v3/users/1cfd3e8118994142a2d9bb8c652bcd7a => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:58:29.724610 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab0fcc8-a025-4951-b1c1-4a77dfd28cdd admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:29.741135 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5256c9c-8c36-4bfe-bc22-dfd97d15efee admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:29.805050 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:58:29.960842 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab0fcc8-a025-4951-b1c1-4a77dfd28cdd admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:29.962094 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:58:29.982587 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adabd565-d78a-441c-b1fa-e9379246c856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:29.994068 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adabd565-d78a-441c-b1fa-e9379246c856 admin admin] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:29.994971 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adabd565-d78a-441c-b1fa-e9379246c856 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:29.995579 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adabd565-d78a-441c-b1fa-e9379246c856 admin admin] PATH_INFO: `/v3/projects` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:29.996830 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adabd565-d78a-441c-b1fa-e9379246c856 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:30.001414 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8411a6bf-60d1-43c2-a321-07cea9f091f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:30.001857 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adabd565-d78a-441c-b1fa-e9379246c856 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:30.002398 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8411a6bf-60d1-43c2-a321-07cea9f091f6 admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:30.002707 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8411a6bf-60d1-43c2-a321-07cea9f091f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:30.002982 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8411a6bf-60d1-43c2-a321-07cea9f091f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:30.007838 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8411a6bf-60d1-43c2-a321-07cea9f091f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:58:30.008740 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8411a6bf-60d1-43c2-a321-07cea9f091f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:30.012810 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8411a6bf-60d1-43c2-a321-07cea9f091f6 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:30.061611 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 873/1730] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 14 17:58:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:58:30.064162 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8411a6bf-60d1-43c2-a321-07cea9f091f6 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:30.089025 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8411a6bf-60d1-43c2-a321-07cea9f091f6 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:30.097905 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7ec9d7-a0e0-4992-8fa2-618298a28283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:30.099419 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7ec9d7-a0e0-4992-8fa2-618298a28283 admin admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:30.099953 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7ec9d7-a0e0-4992-8fa2-618298a28283 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:30.101002 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7ec9d7-a0e0-4992-8fa2-618298a28283 admin admin] PATH_INFO: `/v3/projects` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:30.102125 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7ec9d7-a0e0-4992-8fa2-618298a28283 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:30.104400 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7ec9d7-a0e0-4992-8fa2-618298a28283 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:30.174724 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 858/1731] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 14 17:58:29 2022] POST /identity/v3/projects => generated 371 bytes in 454 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:58:30.190414 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adabd565-d78a-441c-b1fa-e9379246c856 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:30.313446 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 874/1732] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 14 17:58:30 2022] POST /identity/v3/projects => generated 367 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:58:30.319974 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7ec9d7-a0e0-4992-8fa2-618298a28283 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:30.438727 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adabd565-d78a-441c-b1fa-e9379246c856 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:30.517535 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:58:30.661594 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b846b2-2ac9-45c4-b075-f117f43086c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:30.667353 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b846b2-2ac9-45c4-b075-f117f43086c2 admin admin] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:30.667353 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b846b2-2ac9-45c4-b075-f117f43086c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:30.667353 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b846b2-2ac9-45c4-b075-f117f43086c2 admin admin] PATH_INFO: `/v3/users` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:30.667353 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b846b2-2ac9-45c4-b075-f117f43086c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:30.667852 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7ec9d7-a0e0-4992-8fa2-618298a28283 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:30.667937 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b846b2-2ac9-45c4-b075-f117f43086c2 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:30.685815 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8ea95d-4350-4e87-9093-f1419094226c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:30.691063 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8ea95d-4350-4e87-9093-f1419094226c admin admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:30.691420 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8ea95d-4350-4e87-9093-f1419094226c admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:30.695257 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8ea95d-4350-4e87-9093-f1419094226c admin admin] PATH_INFO: `/v3/users` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:30.701046 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8ea95d-4350-4e87-9093-f1419094226c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:30.704885 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8ea95d-4350-4e87-9093-f1419094226c admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:30.820298 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 859/1733] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 14 17:58:30 2022] POST /identity/v3/users => generated 286 bytes in 632 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:58:30.824082 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fd5ddc-f0d7-45fe-aec1-93217746989c None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:30.824458 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fd5ddc-f0d7-45fe-aec1-93217746989c None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:30.824825 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fd5ddc-f0d7-45fe-aec1-93217746989c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:30.903283 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-72fd5ddc-f0d7-45fe-aec1-93217746989c None None] MFA Rules not processed for user `41680577c34d4b9090270d3097a7e02c`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:58:30.908165 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-72fd5ddc-f0d7-45fe-aec1-93217746989c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:30.915289 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 875/1734] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 14 17:58:30 2022] POST /identity/v3/users => generated 284 bytes in 597 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:58:30.922084 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8ea95d-4350-4e87-9093-f1419094226c admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:31.018540 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8ea95d-4350-4e87-9093-f1419094226c admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:31.045026 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fe17dd-3aff-4b3d-ac82-14af68373c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:31.045745 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fe17dd-3aff-4b3d-ac82-14af68373c20 admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:31.046036 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fe17dd-3aff-4b3d-ac82-14af68373c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:31.046328 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fe17dd-3aff-4b3d-ac82-14af68373c20 admin admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:31.047243 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fe17dd-3aff-4b3d-ac82-14af68373c20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:31.055046 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fe17dd-3aff-4b3d-ac82-14af68373c20 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:31.102076 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 876/1735] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 17:58:30 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 17:58:31.104612 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fe17dd-3aff-4b3d-ac82-14af68373c20 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:31.138013 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fe17dd-3aff-4b3d-ac82-14af68373c20 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:31.151487 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c2a90d-b9f6-4b7f-9019-40f776ed4956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:31.152290 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c2a90d-b9f6-4b7f-9019-40f776ed4956 admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:31.152659 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c2a90d-b9f6-4b7f-9019-40f776ed4956 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:31.153038 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c2a90d-b9f6-4b7f-9019-40f776ed4956 admin admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:31.153860 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c2a90d-b9f6-4b7f-9019-40f776ed4956 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:31.157266 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c2a90d-b9f6-4b7f-9019-40f776ed4956 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:31.170981 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 860/1736] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:58:30 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:58:31.172429 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fd5ddc-f0d7-45fe-aec1-93217746989c None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:31.214028 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fd5ddc-f0d7-45fe-aec1-93217746989c None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:31.216257 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 877/1737] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 17:58:31 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 17:58:31.217251 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c2a90d-b9f6-4b7f-9019-40f776ed4956 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:31.223743 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-e1c2a90d-b9f6-4b7f-9019-40f776ed4956 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:31.225019 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d90058b-a507-470e-9ba8-b553126a4447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:31.255600 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d90058b-a507-470e-9ba8-b553126a4447 admin admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:31.256137 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d90058b-a507-470e-9ba8-b553126a4447 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:31.258050 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d90058b-a507-470e-9ba8-b553126a4447 admin admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:31.263933 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d90058b-a507-470e-9ba8-b553126a4447 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:31.272520 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d90058b-a507-470e-9ba8-b553126a4447 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:31.295461 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 861/1738] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 17:58:31 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 17:58:31.297528 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d90058b-a507-470e-9ba8-b553126a4447 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:31.325589 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d90058b-a507-470e-9ba8-b553126a4447 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:31.334350 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b999ee-c75e-4e18-92b5-e5913f177a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:31.335626 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b999ee-c75e-4e18-92b5-e5913f177a69 admin admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:31.336887 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b999ee-c75e-4e18-92b5-e5913f177a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:31.337421 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b999ee-c75e-4e18-92b5-e5913f177a69 admin admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:31.338485 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b999ee-c75e-4e18-92b5-e5913f177a69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:31.344378 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b999ee-c75e-4e18-92b5-e5913f177a69 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:31.370704 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 862/1739] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 17:58:31 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 17:58:31.372418 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b999ee-c75e-4e18-92b5-e5913f177a69 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:31.387632 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b999ee-c75e-4e18-92b5-e5913f177a69 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:31.395259 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec462ab-5fab-4df6-be9b-851d967a5e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:31.399144 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec462ab-5fab-4df6-be9b-851d967a5e16 admin admin] REQUEST_METHOD: `PUT` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:31.399144 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec462ab-5fab-4df6-be9b-851d967a5e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:31.399144 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec462ab-5fab-4df6-be9b-851d967a5e16 admin admin] PATH_INFO: `/v3/projects/124e06b7e0224b6faaad98d11982e713/users/62057896b631456eb8514c288e5a4273/roles/9ee80134743f4c2b88525b04df2facba` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:31.446739 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:58:31.450391 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec462ab-5fab-4df6-be9b-851d967a5e16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=124e06b7e0224b6faaad98d11982e713, user_id=62057896b631456eb8514c288e5a4273, role_id=9ee80134743f4c2b88525b04df2facba)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:31.456374 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec462ab-5fab-4df6-be9b-851d967a5e16 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:31.536838 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c2a90d-b9f6-4b7f-9019-40f776ed4956 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:31.545199 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5e570b-b102-4a1e-bb01-4bfa8fc3dfbb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4696d396adb495ab300a9a5a5727595', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:31.546341 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5e570b-b102-4a1e-bb01-4bfa8fc3dfbb service nova] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:31.551289 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5e570b-b102-4a1e-bb01-4bfa8fc3dfbb service nova] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:31.551864 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5e570b-b102-4a1e-bb01-4bfa8fc3dfbb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:31.555557 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 863/1740] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 17:58:31 2022] PUT /identity/v3/projects/124e06b7e0224b6faaad98d11982e713/users/62057896b631456eb8514c288e5a4273/roles/9ee80134743f4c2b88525b04df2facba => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:58:31.557042 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec462ab-5fab-4df6-be9b-851d967a5e16 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:31.571863 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5e570b-b102-4a1e-bb01-4bfa8fc3dfbb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:31.573766 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5e570b-b102-4a1e-bb01-4bfa8fc3dfbb service nova] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:31.610339 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 878/1741] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:58:31 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:58:31.612003 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4fdff3-bc13-4f24-9136-6e17ee100e83 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:31.615175 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4fdff3-bc13-4f24-9136-6e17ee100e83 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:31.615701 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4fdff3-bc13-4f24-9136-6e17ee100e83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:31.689010 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-6e4fdff3-bc13-4f24-9136-6e17ee100e83 None None] MFA Rules not processed for user `62057896b631456eb8514c288e5a4273`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:58:31.692200 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-6e4fdff3-bc13-4f24-9136-6e17ee100e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:31.775452 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec462ab-5fab-4df6-be9b-851d967a5e16 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:31.796027 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9d65f2-e988-4894-8592-bb9a5840caeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:31.799641 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9d65f2-e988-4894-8592-bb9a5840caeb admin admin] REQUEST_METHOD: `PUT` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:31.801368 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9d65f2-e988-4894-8592-bb9a5840caeb admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:31.802140 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9d65f2-e988-4894-8592-bb9a5840caeb admin admin] PATH_INFO: `/v3/projects/b75212185ace4ce8a3a52854a7bb9403/users/01d1ce7eb1924b7da0789c6c0346d900/roles/9ee80134743f4c2b88525b04df2facba` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:31.853757 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9d65f2-e988-4894-8592-bb9a5840caeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=b75212185ace4ce8a3a52854a7bb9403, user_id=01d1ce7eb1924b7da0789c6c0346d900, role_id=9ee80134743f4c2b88525b04df2facba)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:31.863743 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9d65f2-e988-4894-8592-bb9a5840caeb admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:31.896356 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 879/1742] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:58:31 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:58:31.902682 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4fdff3-bc13-4f24-9136-6e17ee100e83 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:31.905212 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-6e4fdff3-bc13-4f24-9136-6e17ee100e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:32.003432 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 864/1743] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 17:58:31 2022] PUT /identity/v3/projects/b75212185ace4ce8a3a52854a7bb9403/users/01d1ce7eb1924b7da0789c6c0346d900/roles/9ee80134743f4c2b88525b04df2facba => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:58:32.028082 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34663e1e-a635-4261-a5f1-d7b705325e8d None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:32.028726 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34663e1e-a635-4261-a5f1-d7b705325e8d None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:32.030100 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34663e1e-a635-4261-a5f1-d7b705325e8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:32.042813 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:58:32.116130 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4fdff3-bc13-4f24-9136-6e17ee100e83 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:32.186946 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-34663e1e-a635-4261-a5f1-d7b705325e8d None None] MFA Rules not processed for user `01d1ce7eb1924b7da0789c6c0346d900`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:58:32.191533 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-34663e1e-a635-4261-a5f1-d7b705325e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:32.314143 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5de3e05-52e2-45b2-bec9-104001c1db14 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4696d396adb495ab300a9a5a5727595', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:32.314950 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5de3e05-52e2-45b2-bec9-104001c1db14 service nova] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:32.315284 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5de3e05-52e2-45b2-bec9-104001c1db14 service nova] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:32.315705 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5de3e05-52e2-45b2-bec9-104001c1db14 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:32.451853 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 865/1744] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:58:32 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 432 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:58:32.454541 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34663e1e-a635-4261-a5f1-d7b705325e8d None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:32.459944 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-34663e1e-a635-4261-a5f1-d7b705325e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:32.463002 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5de3e05-52e2-45b2-bec9-104001c1db14 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:32.475093 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5de3e05-52e2-45b2-bec9-104001c1db14 service nova] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:32.505485 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 880/1745] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:58:31 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 604 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:58:32.513049 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5de3e05-52e2-45b2-bec9-104001c1db14 service nova] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:32.642494 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:58:32.670878 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5de3e05-52e2-45b2-bec9-104001c1db14 service nova] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:32.688431 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4af2a66-14c7-472f-82af-39df2f8cb56f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:32.691663 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4af2a66-14c7-472f-82af-39df2f8cb56f admin admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:32.692239 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4af2a66-14c7-472f-82af-39df2f8cb56f admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:32.692679 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4af2a66-14c7-472f-82af-39df2f8cb56f admin admin] PATH_INFO: `/v3/projects` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:32.695593 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4af2a66-14c7-472f-82af-39df2f8cb56f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:32.701431 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4af2a66-14c7-472f-82af-39df2f8cb56f admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:32.726376 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:58:32.841402 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 881/1746] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 14 17:58:32 2022] POST /identity/v3/projects => generated 367 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:58:32.852398 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4af2a66-14c7-472f-82af-39df2f8cb56f admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:32.969369 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34663e1e-a635-4261-a5f1-d7b705325e8d None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:33.136964 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4af2a66-14c7-472f-82af-39df2f8cb56f admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:33.161359 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06583a59-9057-4d03-8435-9cf2bdd739de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:33.164729 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06583a59-9057-4d03-8435-9cf2bdd739de admin admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:33.166030 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06583a59-9057-4d03-8435-9cf2bdd739de admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:33.166891 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06583a59-9057-4d03-8435-9cf2bdd739de admin admin] PATH_INFO: `/v3/users` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:33.168381 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06583a59-9057-4d03-8435-9cf2bdd739de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:33.177882 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06583a59-9057-4d03-8435-9cf2bdd739de admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:33.290843 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 882/1747] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 14 17:58:32 2022] POST /identity/v3/users => generated 290 bytes in 439 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:58:33.292329 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06583a59-9057-4d03-8435-9cf2bdd739de admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:33.324245 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06583a59-9057-4d03-8435-9cf2bdd739de admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:33.332876 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb0ab25-9fb5-4e6c-9cb0-ed452435edfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:33.338256 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb0ab25-9fb5-4e6c-9cb0-ed452435edfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:33.338555 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb0ab25-9fb5-4e6c-9cb0-ed452435edfd admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:33.338847 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb0ab25-9fb5-4e6c-9cb0-ed452435edfd admin admin] PATH_INFO: `/v3/projects/ed37a42296a44f848c349b1c39f240b3` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:33.346302 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb0ab25-9fb5-4e6c-9cb0-ed452435edfd admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed37a42296a44f848c349b1c39f240b3)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:33.349643 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6480061c-ce72-4cde-afce-17092a459d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:33.350902 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6480061c-ce72-4cde-afce-17092a459d22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:33.351484 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6480061c-ce72-4cde-afce-17092a459d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:33.352054 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6480061c-ce72-4cde-afce-17092a459d22 admin admin] PATH_INFO: `/v3/users/62057896b631456eb8514c288e5a4273` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:33.368577 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6480061c-ce72-4cde-afce-17092a459d22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62057896b631456eb8514c288e5a4273)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:33.370596 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb0ab25-9fb5-4e6c-9cb0-ed452435edfd admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:33.382739 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6480061c-ce72-4cde-afce-17092a459d22 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:33.520518 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:58:33.606432 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:58:33.743925 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-6480061c-ce72-4cde-afce-17092a459d22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62057896b631456eb8514c288e5a4273'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:33.747773 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-6480061c-ce72-4cde-afce-17092a459d22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62057896b631456eb8514c288e5a4273'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:33.748512 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-6480061c-ce72-4cde-afce-17092a459d22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62057896b631456eb8514c288e5a4273'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:33.764304 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-ccb0ab25-9fb5-4e6c-9cb0-ed452435edfd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed37a42296a44f848c349b1c39f240b3', 'request_id': 'req-ccb0ab25-9fb5-4e6c-9cb0-ed452435edfd'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:33.851712 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-6480061c-ce72-4cde-afce-17092a459d22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62057896b631456eb8514c288e5a4273'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:33.866589 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-6480061c-ce72-4cde-afce-17092a459d22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62057896b631456eb8514c288e5a4273'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:33.907293 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 883/1748] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 14 17:58:33 2022] DELETE /identity/v3/users/62057896b631456eb8514c288e5a4273 => generated 0 bytes in 615 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:58:33.908467 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6480061c-ce72-4cde-afce-17092a459d22 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:33.911042 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-6480061c-ce72-4cde-afce-17092a459d22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:33.920246 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-ccb0ab25-9fb5-4e6c-9cb0-ed452435edfd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed37a42296a44f848c349b1c39f240b3', 'request_id': 'req-ccb0ab25-9fb5-4e6c-9cb0-ed452435edfd'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:33.930465 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-ccb0ab25-9fb5-4e6c-9cb0-ed452435edfd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed37a42296a44f848c349b1c39f240b3', 'request_id': 'req-ccb0ab25-9fb5-4e6c-9cb0-ed452435edfd'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:33.961921 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-ccb0ab25-9fb5-4e6c-9cb0-ed452435edfd admin admin] The token cache is being invalidate because project ed37a42296a44f848c349b1c39f240b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 17:58:33.962328 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-ccb0ab25-9fb5-4e6c-9cb0-ed452435edfd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:33.966570 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-ccb0ab25-9fb5-4e6c-9cb0-ed452435edfd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:33.979522 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 866/1749] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 14 17:58:32 2022] DELETE /identity/v3/projects/ed37a42296a44f848c349b1c39f240b3 => generated 0 bytes in 1524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:58:33.984397 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5dce36-ba86-4528-b9cf-f2558a48d755 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:33.984608 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5dce36-ba86-4528-b9cf-f2558a48d755 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:33.986075 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5dce36-ba86-4528-b9cf-f2558a48d755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:34.037950 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-7b5dce36-ba86-4528-b9cf-f2558a48d755 None None] MFA Rules not processed for user `0b64d79cbd27413cb9d6064e7b9c88e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:58:34.039995 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-7b5dce36-ba86-4528-b9cf-f2558a48d755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:34.157739 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6480061c-ce72-4cde-afce-17092a459d22 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:34.175886 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b603f3fc-1345-410c-9ad0-46c610211861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:34.178232 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b603f3fc-1345-410c-9ad0-46c610211861 admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:34.178232 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b603f3fc-1345-410c-9ad0-46c610211861 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:34.178232 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b603f3fc-1345-410c-9ad0-46c610211861 admin admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:34.178232 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b603f3fc-1345-410c-9ad0-46c610211861 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:34.196697 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 867/1750] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:58:33 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:58:34.199634 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce639965-d677-4b5c-ac6c-833c894c04d8 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:34.200450 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce639965-d677-4b5c-ac6c-833c894c04d8 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:34.203855 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce639965-d677-4b5c-ac6c-833c894c04d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:34.204954 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b603f3fc-1345-410c-9ad0-46c610211861 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:34.246141 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 884/1751] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 17:58:33 2022] GET /identity/v3/roles => generated 1420 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 17:58:34.254374 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7935e771-1738-4534-974e-31829cc1d08f None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:34.257085 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7935e771-1738-4534-974e-31829cc1d08f None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:34.257423 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7935e771-1738-4534-974e-31829cc1d08f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:34.282852 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-ce639965-d677-4b5c-ac6c-833c894c04d8 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:58:34.313367 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-ce639965-d677-4b5c-ac6c-833c894c04d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:34.315929 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-7935e771-1738-4534-974e-31829cc1d08f None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:58:34.320734 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-7935e771-1738-4534-974e-31829cc1d08f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:34.338892 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 868/1752] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:58:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:58:34.347157 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce639965-d677-4b5c-ac6c-833c894c04d8 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:34.356388 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-ce639965-d677-4b5c-ac6c-833c894c04d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:34.387716 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 885/1753] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:58:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:58:34.391604 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce639965-d677-4b5c-ac6c-833c894c04d8 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:34.391760 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7935e771-1738-4534-974e-31829cc1d08f None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:34.393510 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-7935e771-1738-4534-974e-31829cc1d08f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:34.428192 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17041d4-7a2d-4a99-be3e-d9bf9f32db79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:34.429170 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17041d4-7a2d-4a99-be3e-d9bf9f32db79 admin admin] REQUEST_METHOD: `PUT` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:34.429429 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17041d4-7a2d-4a99-be3e-d9bf9f32db79 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:34.429717 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17041d4-7a2d-4a99-be3e-d9bf9f32db79 admin admin] PATH_INFO: `/v3/projects/63de3848590646cd918c32a317718ddd/users/35a6820cbf104062b535665e257f4c47/roles/1348580877d04014bfdec4d866b98a74` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:34.474077 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17041d4-7a2d-4a99-be3e-d9bf9f32db79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63de3848590646cd918c32a317718ddd, user_id=35a6820cbf104062b535665e257f4c47, role_id=1348580877d04014bfdec4d866b98a74)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:34.476863 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17041d4-7a2d-4a99-be3e-d9bf9f32db79 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:34.596459 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 869/1754] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 17:58:34 2022] PUT /identity/v3/projects/63de3848590646cd918c32a317718ddd/users/35a6820cbf104062b535665e257f4c47/roles/1348580877d04014bfdec4d866b98a74 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:58:34.598950 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e13501-d406-447b-bf2a-5eb6f6ad0d37 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:34.598950 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e13501-d406-447b-bf2a-5eb6f6ad0d37 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:34.598950 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e13501-d406-447b-bf2a-5eb6f6ad0d37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:34.615347 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7935e771-1738-4534-974e-31829cc1d08f None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:34.676516 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-92e13501-d406-447b-bf2a-5eb6f6ad0d37 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:58:34.678079 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-92e13501-d406-447b-bf2a-5eb6f6ad0d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:34.737168 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264f7b4b-74f0-4632-8a40-bf4ca6f90fb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5652329c71cd431fb579d69cef933b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:34.737859 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264f7b4b-74f0-4632-8a40-bf4ca6f90fb0 service neutron] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:34.738644 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264f7b4b-74f0-4632-8a40-bf4ca6f90fb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:34.738959 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264f7b4b-74f0-4632-8a40-bf4ca6f90fb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:34.751229 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:58:34.929290 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 870/1755] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:58:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:58:34.929290 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e13501-d406-447b-bf2a-5eb6f6ad0d37 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:34.963123 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e13501-d406-447b-bf2a-5eb6f6ad0d37 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:34.984921 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892b614a-efd6-4baa-8d45-3f8f0ee4f3bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:34.988105 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892b614a-efd6-4baa-8d45-3f8f0ee4f3bd admin admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:34.988105 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892b614a-efd6-4baa-8d45-3f8f0ee4f3bd admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:34.988105 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892b614a-efd6-4baa-8d45-3f8f0ee4f3bd admin admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:34.988105 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892b614a-efd6-4baa-8d45-3f8f0ee4f3bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:34.994427 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264f7b4b-74f0-4632-8a40-bf4ca6f90fb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:34.995966 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264f7b4b-74f0-4632-8a40-bf4ca6f90fb0 service neutron] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:35.000264 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892b614a-efd6-4baa-8d45-3f8f0ee4f3bd admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:35.040275 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 871/1756] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 17:58:34 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 17:58:35.040275 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892b614a-efd6-4baa-8d45-3f8f0ee4f3bd admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:35.040546 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 886/1757] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:58:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 651 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:58:35.041669 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264f7b4b-74f0-4632-8a40-bf4ca6f90fb0 service neutron] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:35.057032 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264f7b4b-74f0-4632-8a40-bf4ca6f90fb0 service neutron] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:35.073060 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b08dc9-3aac-4bb9-b8a5-72b51d078cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:35.074180 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b08dc9-3aac-4bb9-b8a5-72b51d078cf5 admin admin] REQUEST_METHOD: `PUT` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:35.074739 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b08dc9-3aac-4bb9-b8a5-72b51d078cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:35.075185 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b08dc9-3aac-4bb9-b8a5-72b51d078cf5 admin admin] PATH_INFO: `/v3/projects/63de3848590646cd918c32a317718ddd/users/35a6820cbf104062b535665e257f4c47/roles/1348580877d04014bfdec4d866b98a74` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:35.078169 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892b614a-efd6-4baa-8d45-3f8f0ee4f3bd admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:35.081348 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b08dc9-3aac-4bb9-b8a5-72b51d078cf5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63de3848590646cd918c32a317718ddd, user_id=35a6820cbf104062b535665e257f4c47, role_id=1348580877d04014bfdec4d866b98a74)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:35.083911 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76af1bf3-4dc7-4fa0-ab76-60fe5320e8cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:35.085678 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76af1bf3-4dc7-4fa0-ab76-60fe5320e8cc admin admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:35.086336 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76af1bf3-4dc7-4fa0-ab76-60fe5320e8cc admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:35.087039 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76af1bf3-4dc7-4fa0-ab76-60fe5320e8cc admin admin] PATH_INFO: `/v3/domains` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:35.087525 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b08dc9-3aac-4bb9-b8a5-72b51d078cf5 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:35.089156 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76af1bf3-4dc7-4fa0-ab76-60fe5320e8cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:58:35.097093 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76af1bf3-4dc7-4fa0-ab76-60fe5320e8cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:35.097093 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76af1bf3-4dc7-4fa0-ab76-60fe5320e8cc admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:35.114946 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:58:35.118404 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 887/1758] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 17:58:35 2022] PUT /identity/v3/projects/63de3848590646cd918c32a317718ddd/users/35a6820cbf104062b535665e257f4c47/roles/1348580877d04014bfdec4d866b98a74 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 17:58:35.136707 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dcbcde-c658-4fcc-87fa-6f14fb385fba None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:35.137002 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dcbcde-c658-4fcc-87fa-6f14fb385fba None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:35.137207 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dcbcde-c658-4fcc-87fa-6f14fb385fba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:35.141616 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 872/1759] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 14 17:58:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:58:35.149082 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76af1bf3-4dc7-4fa0-ab76-60fe5320e8cc admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:35.178480 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76af1bf3-4dc7-4fa0-ab76-60fe5320e8cc admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:35.223374 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-c7dcbcde-c658-4fcc-87fa-6f14fb385fba None None] MFA Rules not processed for user `35a6820cbf104062b535665e257f4c47`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:58:35.225035 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-c7dcbcde-c658-4fcc-87fa-6f14fb385fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:35.373023 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b17df71-de16-4a06-8a83-06fc652ec7c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:35.373779 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b17df71-de16-4a06-8a83-06fc652ec7c6 admin admin] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:35.375963 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b17df71-de16-4a06-8a83-06fc652ec7c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:35.376281 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b17df71-de16-4a06-8a83-06fc652ec7c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:35.380037 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b17df71-de16-4a06-8a83-06fc652ec7c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:35.384868 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b17df71-de16-4a06-8a83-06fc652ec7c6 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:35.397493 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 888/1760] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:58:35 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 17:58:35.410037 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dcbcde-c658-4fcc-87fa-6f14fb385fba None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:35.411885 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-c7dcbcde-c658-4fcc-87fa-6f14fb385fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:35.552681 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dcbcde-c658-4fcc-87fa-6f14fb385fba None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:35.566680 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddea37a-b208-45c2-bf7f-208e2cdfbb51 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17945e7d72954b8787e0ba09a9903247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:35.569520 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddea37a-b208-45c2-bf7f-208e2cdfbb51 service cinder] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:35.570682 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddea37a-b208-45c2-bf7f-208e2cdfbb51 service cinder] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:35.570984 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddea37a-b208-45c2-bf7f-208e2cdfbb51 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:35.601067 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 873/1761] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 14 17:58:35 2022] POST /identity/v3/projects => generated 391 bytes in 456 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:58:35.604720 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddea37a-b208-45c2-bf7f-208e2cdfbb51 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:35.605684 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b17df71-de16-4a06-8a83-06fc652ec7c6 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:35.606184 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddea37a-b208-45c2-bf7f-208e2cdfbb51 service cinder] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:35.621076 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 889/1762] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:58:35 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 17:58:35.738825 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b17df71-de16-4a06-8a83-06fc652ec7c6 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:35.746937 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503a79c5-279c-4a8d-8989-189fc8cb78c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:35.752182 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a79c5-279c-4a8d-8989-189fc8cb78c9 admin admin] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:35.752548 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a79c5-279c-4a8d-8989-189fc8cb78c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:35.753014 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a79c5-279c-4a8d-8989-189fc8cb78c9 admin admin] PATH_INFO: `/v3/users` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:35.753831 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503a79c5-279c-4a8d-8989-189fc8cb78c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:35.756391 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503a79c5-279c-4a8d-8989-189fc8cb78c9 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:35.853547 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 874/1763] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 14 17:58:35 2022] POST /identity/v3/users => generated 296 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:58:35.857372 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddea37a-b208-45c2-bf7f-208e2cdfbb51 service cinder] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:35.889982 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddea37a-b208-45c2-bf7f-208e2cdfbb51 service cinder] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:35.907778 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e755ca-604d-4450-adb1-3574939ad986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:35.908488 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e755ca-604d-4450-adb1-3574939ad986 admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:35.908775 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e755ca-604d-4450-adb1-3574939ad986 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:35.909058 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e755ca-604d-4450-adb1-3574939ad986 admin admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:35.909797 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e755ca-604d-4450-adb1-3574939ad986 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:35.911447 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e755ca-604d-4450-adb1-3574939ad986 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:35.933617 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 890/1764] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 17:58:35 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 17:58:35.934887 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503a79c5-279c-4a8d-8989-189fc8cb78c9 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:35.953471 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503a79c5-279c-4a8d-8989-189fc8cb78c9 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:35.960448 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b004f22-b731-4561-b43f-741ab04b1783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:35.961397 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b004f22-b731-4561-b43f-741ab04b1783 admin admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:35.961397 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b004f22-b731-4561-b43f-741ab04b1783 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:35.961700 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b004f22-b731-4561-b43f-741ab04b1783 admin admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:35.962441 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b004f22-b731-4561-b43f-741ab04b1783 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:35.967839 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b004f22-b731-4561-b43f-741ab04b1783 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:35.992588 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 875/1765] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 17:58:35 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 17:58:35.995252 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e755ca-604d-4450-adb1-3574939ad986 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:36.006347 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ce8a82-fb71-4b32-a00a-5258de9a14d3 None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:36.006646 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ce8a82-fb71-4b32-a00a-5258de9a14d3 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:36.007532 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ce8a82-fb71-4b32-a00a-5258de9a14d3 None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:36.016527 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e755ca-604d-4450-adb1-3574939ad986 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:36.018381 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 876/1766] 10.222.0.36 () {54 vars in 912 bytes} [Tue Jun 14 17:58:36 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:58:36.026085 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aec4e7-7315-4481-a6ae-c201bd00320c None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:36.027045 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aec4e7-7315-4481-a6ae-c201bd00320c None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:36.039041 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aec4e7-7315-4481-a6ae-c201bd00320c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:36.051425 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2b6f8f-06ce-4656-859c-546da81827d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:36.052687 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2b6f8f-06ce-4656-859c-546da81827d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:36.052985 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2b6f8f-06ce-4656-859c-546da81827d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:36.053274 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2b6f8f-06ce-4656-859c-546da81827d2 admin admin] PATH_INFO: `/v3/projects/11cde5e430c0406c9bcf214c14882af2/users/616674116d0841afb108ca8e6a560233/roles/9ee80134743f4c2b88525b04df2facba` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:36.097671 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-d3aec4e7-7315-4481-a6ae-c201bd00320c None None] MFA Rules not processed for user `5652329c71cd431fb579d69cef933b37`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:58:36.099116 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-d3aec4e7-7315-4481-a6ae-c201bd00320c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:36.101394 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2b6f8f-06ce-4656-859c-546da81827d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11cde5e430c0406c9bcf214c14882af2, user_id=616674116d0841afb108ca8e6a560233, role_id=9ee80134743f4c2b88525b04df2facba)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:36.108506 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2b6f8f-06ce-4656-859c-546da81827d2 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:36.196106 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:58:36.197003 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 891/1767] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 17:58:35 2022] PUT /identity/v3/projects/11cde5e430c0406c9bcf214c14882af2/users/616674116d0841afb108ca8e6a560233/roles/9ee80134743f4c2b88525b04df2facba => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:58:36.198012 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2b6f8f-06ce-4656-859c-546da81827d2 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:36.209715 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-2e2b6f8f-06ce-4656-859c-546da81827d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:36.243727 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 877/1768] 10.222.0.36 () {58 vars in 1009 bytes} [Tue Jun 14 17:58:36 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:58:36.245173 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b6c03d-ad35-4447-be03-73d9be908106 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:36.249375 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b6c03d-ad35-4447-be03-73d9be908106 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:36.250797 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b6c03d-ad35-4447-be03-73d9be908106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:36.307084 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-d6b6c03d-ad35-4447-be03-73d9be908106 None None] MFA Rules not processed for user `616674116d0841afb108ca8e6a560233`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:58:36.309110 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-d6b6c03d-ad35-4447-be03-73d9be908106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:36.328714 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2b6f8f-06ce-4656-859c-546da81827d2 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:36.335109 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3706ac28-007e-4ddc-b515-0eaa83edf631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:36.337831 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3706ac28-007e-4ddc-b515-0eaa83edf631 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:36.338279 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3706ac28-007e-4ddc-b515-0eaa83edf631 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:36.338741 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3706ac28-007e-4ddc-b515-0eaa83edf631 admin admin] PATH_INFO: `/v3/projects/124e06b7e0224b6faaad98d11982e713` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:36.340452 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3706ac28-007e-4ddc-b515-0eaa83edf631 admin admin] RBAC: Authorizing `identity:delete_project(project_id=124e06b7e0224b6faaad98d11982e713)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:36.343686 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3706ac28-007e-4ddc-b515-0eaa83edf631 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:36.527993 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:58:36.555654 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 878/1769] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:58:36 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:58:36.557241 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b6c03d-ad35-4447-be03-73d9be908106 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:36.558974 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-d6b6c03d-ad35-4447-be03-73d9be908106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:36.577572 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-3706ac28-007e-4ddc-b515-0eaa83edf631 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '124e06b7e0224b6faaad98d11982e713', 'request_id': 'req-3706ac28-007e-4ddc-b515-0eaa83edf631'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:36.667499 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b6c03d-ad35-4447-be03-73d9be908106 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:36.720489 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-3706ac28-007e-4ddc-b515-0eaa83edf631 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '124e06b7e0224b6faaad98d11982e713', 'request_id': 'req-3706ac28-007e-4ddc-b515-0eaa83edf631'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:36.735861 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-3706ac28-007e-4ddc-b515-0eaa83edf631 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '124e06b7e0224b6faaad98d11982e713', 'request_id': 'req-3706ac28-007e-4ddc-b515-0eaa83edf631'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:36.773514 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-3706ac28-007e-4ddc-b515-0eaa83edf631 admin admin] The token cache is being invalidate because project 124e06b7e0224b6faaad98d11982e713 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87019) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 17:58:36.773907 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-3706ac28-007e-4ddc-b515-0eaa83edf631 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:36.775994 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-3706ac28-007e-4ddc-b515-0eaa83edf631 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:36.781918 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 892/1770] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 14 17:58:36 2022] DELETE /identity/v3/projects/124e06b7e0224b6faaad98d11982e713 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:58:36.783767 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3706ac28-007e-4ddc-b515-0eaa83edf631 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:36.785542 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-3706ac28-007e-4ddc-b515-0eaa83edf631 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:36.806461 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4331971-b833-4aad-8606-4ab36a4178e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5652329c71cd431fb579d69cef933b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:36.807514 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4331971-b833-4aad-8606-4ab36a4178e4 service neutron] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:36.808007 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4331971-b833-4aad-8606-4ab36a4178e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:36.811573 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4331971-b833-4aad-8606-4ab36a4178e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:36.811573 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-e4331971-b833-4aad-8606-4ab36a4178e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:36.824379 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4331971-b833-4aad-8606-4ab36a4178e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:36.826612 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4331971-b833-4aad-8606-4ab36a4178e4 service neutron] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:36.855513 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 879/1771] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:58:36 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:58:36.857929 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ab30a3-0e21-40c0-a21e-6d02dfc75368 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:36.858748 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ab30a3-0e21-40c0-a21e-6d02dfc75368 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:36.858748 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ab30a3-0e21-40c0-a21e-6d02dfc75368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:36.912122 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-07ab30a3-0e21-40c0-a21e-6d02dfc75368 None None] MFA Rules not processed for user `9c7ab182f1fd41718376a8e2f03ec87c`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:58:36.962437 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-07ab30a3-0e21-40c0-a21e-6d02dfc75368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:36.962763 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3706ac28-007e-4ddc-b515-0eaa83edf631 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:36.962763 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b99ebc-ecfe-4e69-8f83-277f50a5b4cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:36.962763 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b99ebc-ecfe-4e69-8f83-277f50a5b4cb admin admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:36.962763 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b99ebc-ecfe-4e69-8f83-277f50a5b4cb admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:36.963081 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b99ebc-ecfe-4e69-8f83-277f50a5b4cb admin admin] PATH_INFO: `/v3/projects` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:36.963081 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b99ebc-ecfe-4e69-8f83-277f50a5b4cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:36.963081 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b99ebc-ecfe-4e69-8f83-277f50a5b4cb admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:36.996744 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 880/1772] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:58:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:58:37.005540 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4997fbac-537f-4b2b-97e6-11a543d46631 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:37.005849 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4997fbac-537f-4b2b-97e6-11a543d46631 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:37.006257 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4997fbac-537f-4b2b-97e6-11a543d46631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:37.049109 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-4997fbac-537f-4b2b-97e6-11a543d46631 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:58:37.050611 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-4997fbac-537f-4b2b-97e6-11a543d46631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:37.072887 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 881/1773] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:58:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:58:37.074813 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374dbca8-a66d-45f4-b960-1d56484e0727 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:37.075543 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374dbca8-a66d-45f4-b960-1d56484e0727 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:37.075897 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374dbca8-a66d-45f4-b960-1d56484e0727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:37.096949 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-374dbca8-a66d-45f4-b960-1d56484e0727 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:58:37.099478 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-374dbca8-a66d-45f4-b960-1d56484e0727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:37.116655 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 882/1774] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:58:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:58:37.141180 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374dbca8-a66d-45f4-b960-1d56484e0727 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:37.156487 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374dbca8-a66d-45f4-b960-1d56484e0727 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:37.178399 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1cb240-0fa0-44eb-8f04-708034052f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:37.179541 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1cb240-0fa0-44eb-8f04-708034052f0e admin admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:37.179783 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1cb240-0fa0-44eb-8f04-708034052f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:37.180357 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1cb240-0fa0-44eb-8f04-708034052f0e admin admin] PATH_INFO: `/v3/domains` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:37.181345 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1cb240-0fa0-44eb-8f04-708034052f0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:58:37.181658 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1cb240-0fa0-44eb-8f04-708034052f0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:37.184015 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1cb240-0fa0-44eb-8f04-708034052f0e admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:37.208070 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 893/1775] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 14 17:58:36 2022] POST /identity/v3/projects => generated 393 bytes in 425 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:58:37.209231 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b99ebc-ecfe-4e69-8f83-277f50a5b4cb admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:37.209794 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 883/1776] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 14 17:58:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:58:37.211611 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1cb240-0fa0-44eb-8f04-708034052f0e admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:37.226867 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1cb240-0fa0-44eb-8f04-708034052f0e admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:37.373984 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb37ac63-71d2-47a6-ba61-f59bd3a2e4e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:37.374753 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb37ac63-71d2-47a6-ba61-f59bd3a2e4e5 admin admin] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:37.375663 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb37ac63-71d2-47a6-ba61-f59bd3a2e4e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:37.376197 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb37ac63-71d2-47a6-ba61-f59bd3a2e4e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:37.382189 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb37ac63-71d2-47a6-ba61-f59bd3a2e4e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:37.382189 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb37ac63-71d2-47a6-ba61-f59bd3a2e4e5 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:37.446870 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b99ebc-ecfe-4e69-8f83-277f50a5b4cb admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:37.466567 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e1a40b-4282-4ad5-8c7b-f359de78ca33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:37.468030 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e1a40b-4282-4ad5-8c7b-f359de78ca33 admin admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:37.469065 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e1a40b-4282-4ad5-8c7b-f359de78ca33 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:37.470874 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e1a40b-4282-4ad5-8c7b-f359de78ca33 admin admin] PATH_INFO: `/v3/users` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:37.472227 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e1a40b-4282-4ad5-8c7b-f359de78ca33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:37.475216 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e1a40b-4282-4ad5-8c7b-f359de78ca33 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:37.583199 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 884/1777] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 14 17:58:37 2022] POST /identity/v3/projects => generated 405 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:58:37.587482 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb37ac63-71d2-47a6-ba61-f59bd3a2e4e5 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:37.615805 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 894/1778] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 14 17:58:37 2022] POST /identity/v3/users => generated 303 bytes in 407 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:58:37.619146 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e1a40b-4282-4ad5-8c7b-f359de78ca33 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:37.653146 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e1a40b-4282-4ad5-8c7b-f359de78ca33 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:37.774905 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb37ac63-71d2-47a6-ba61-f59bd3a2e4e5 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:37.787423 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:58:37.795173 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c441cb31-1c34-46e8-93cf-9552df2a007f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:37.796264 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c441cb31-1c34-46e8-93cf-9552df2a007f admin admin] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:37.798318 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c441cb31-1c34-46e8-93cf-9552df2a007f admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:37.802615 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c441cb31-1c34-46e8-93cf-9552df2a007f admin admin] PATH_INFO: `/v3/users` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:37.804686 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c441cb31-1c34-46e8-93cf-9552df2a007f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:37.808877 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c441cb31-1c34-46e8-93cf-9552df2a007f admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:37.908144 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2832577e-b5e1-444b-88b1-7ace834d0e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:37.909141 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2832577e-b5e1-444b-88b1-7ace834d0e52 admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:37.909576 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2832577e-b5e1-444b-88b1-7ace834d0e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:37.910019 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2832577e-b5e1-444b-88b1-7ace834d0e52 admin admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:37.911145 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2832577e-b5e1-444b-88b1-7ace834d0e52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:37.913054 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2832577e-b5e1-444b-88b1-7ace834d0e52 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:37.957021 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 885/1779] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 14 17:58:37 2022] POST /identity/v3/users => generated 303 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:58:37.959004 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c441cb31-1c34-46e8-93cf-9552df2a007f admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:37.982343 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 895/1780] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 17:58:37 2022] GET /identity/v3/roles => generated 1420 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 17:58:37.990621 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2832577e-b5e1-444b-88b1-7ace834d0e52 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:38.014612 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2832577e-b5e1-444b-88b1-7ace834d0e52 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:38.018862 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:58:38.026499 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e13939-54b3-41d0-8293-4a3259bda7b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:38.027883 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e13939-54b3-41d0-8293-4a3259bda7b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:38.028402 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e13939-54b3-41d0-8293-4a3259bda7b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:38.034375 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c441cb31-1c34-46e8-93cf-9552df2a007f admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:38.035727 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e13939-54b3-41d0-8293-4a3259bda7b9 admin admin] PATH_INFO: `/v3/projects/d52364e0e5284912bdccd4430fd1e09a/users/982b81f3b5a94f5584a71c34f86f33de/roles/1348580877d04014bfdec4d866b98a74` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:38.059764 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b92cc96-26fe-46e3-a6c9-8805452c193d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:38.060452 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b92cc96-26fe-46e3-a6c9-8805452c193d admin admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:38.060904 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b92cc96-26fe-46e3-a6c9-8805452c193d admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:38.061382 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b92cc96-26fe-46e3-a6c9-8805452c193d admin admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:38.062881 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b92cc96-26fe-46e3-a6c9-8805452c193d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:38.064696 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b92cc96-26fe-46e3-a6c9-8805452c193d admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:38.073412 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e13939-54b3-41d0-8293-4a3259bda7b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d52364e0e5284912bdccd4430fd1e09a, user_id=982b81f3b5a94f5584a71c34f86f33de, role_id=1348580877d04014bfdec4d866b98a74)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:38.073412 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e13939-54b3-41d0-8293-4a3259bda7b9 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:38.121513 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 886/1781] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 17:58:37 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 17:58:38.126176 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b92cc96-26fe-46e3-a6c9-8805452c193d admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:38.173020 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b92cc96-26fe-46e3-a6c9-8805452c193d admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:38.193139 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafdec11-43bb-4ae0-a6b8-56e507b1e109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:38.196038 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafdec11-43bb-4ae0-a6b8-56e507b1e109 admin admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:38.196575 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafdec11-43bb-4ae0-a6b8-56e507b1e109 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:38.199521 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafdec11-43bb-4ae0-a6b8-56e507b1e109 admin admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:38.205056 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafdec11-43bb-4ae0-a6b8-56e507b1e109 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:38.207519 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafdec11-43bb-4ae0-a6b8-56e507b1e109 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:38.221495 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 896/1782] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 17:58:37 2022] PUT /identity/v3/projects/d52364e0e5284912bdccd4430fd1e09a/users/982b81f3b5a94f5584a71c34f86f33de/roles/1348580877d04014bfdec4d866b98a74 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:58:38.226392 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e13939-54b3-41d0-8293-4a3259bda7b9 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:38.239715 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 887/1783] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 17:58:38 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 17:58:38.242610 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafdec11-43bb-4ae0-a6b8-56e507b1e109 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:38.274006 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafdec11-43bb-4ae0-a6b8-56e507b1e109 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:38.353169 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:58:38.482283 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c479fe5a-b3ed-41a1-8bcd-532faad75df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:38.483053 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e13939-54b3-41d0-8293-4a3259bda7b9 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:38.483855 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479fe5a-b3ed-41a1-8bcd-532faad75df1 admin admin] REQUEST_METHOD: `PUT` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:38.486292 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479fe5a-b3ed-41a1-8bcd-532faad75df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:38.486836 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479fe5a-b3ed-41a1-8bcd-532faad75df1 admin admin] PATH_INFO: `/v3/projects/36a0c5fed0574ecea06addafa12a9e0e/users/34ed72772964438e8f35d1a8f468ad19/roles/9ee80134743f4c2b88525b04df2facba` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:38.495546 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930a112a-49a9-43fc-82ad-6b4213f12d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:38.498180 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930a112a-49a9-43fc-82ad-6b4213f12d71 admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:38.498625 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930a112a-49a9-43fc-82ad-6b4213f12d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:38.502313 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930a112a-49a9-43fc-82ad-6b4213f12d71 admin admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:38.503390 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930a112a-49a9-43fc-82ad-6b4213f12d71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:38.509707 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930a112a-49a9-43fc-82ad-6b4213f12d71 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:38.533239 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c479fe5a-b3ed-41a1-8bcd-532faad75df1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36a0c5fed0574ecea06addafa12a9e0e, user_id=34ed72772964438e8f35d1a8f468ad19, role_id=9ee80134743f4c2b88525b04df2facba)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:38.539665 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c479fe5a-b3ed-41a1-8bcd-532faad75df1 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:38.573413 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 897/1784] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 17:58:38 2022] GET /identity/v3/roles => generated 1420 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 17:58:38.576177 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930a112a-49a9-43fc-82ad-6b4213f12d71 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:38.612627 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930a112a-49a9-43fc-82ad-6b4213f12d71 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:38.618567 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df4d195-b39b-4280-92bb-1b5364c018f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:38.619731 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df4d195-b39b-4280-92bb-1b5364c018f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:38.620073 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df4d195-b39b-4280-92bb-1b5364c018f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:38.620382 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df4d195-b39b-4280-92bb-1b5364c018f2 admin admin] PATH_INFO: `/v3/projects/d52364e0e5284912bdccd4430fd1e09a/users/982b81f3b5a94f5584a71c34f86f33de/roles/1348580877d04014bfdec4d866b98a74` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:38.622788 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df4d195-b39b-4280-92bb-1b5364c018f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d52364e0e5284912bdccd4430fd1e09a, user_id=982b81f3b5a94f5584a71c34f86f33de, role_id=1348580877d04014bfdec4d866b98a74)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:38.626239 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df4d195-b39b-4280-92bb-1b5364c018f2 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:38.652242 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 898/1785] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 17:58:38 2022] PUT /identity/v3/projects/d52364e0e5284912bdccd4430fd1e09a/users/982b81f3b5a94f5584a71c34f86f33de/roles/1348580877d04014bfdec4d866b98a74 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:58:38.657156 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42440f48-52e7-4ec3-aaaa-22241f07a432 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:38.657469 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42440f48-52e7-4ec3-aaaa-22241f07a432 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:38.657779 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42440f48-52e7-4ec3-aaaa-22241f07a432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:38.688359 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 888/1786] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 17:58:38 2022] PUT /identity/v3/projects/36a0c5fed0574ecea06addafa12a9e0e/users/34ed72772964438e8f35d1a8f468ad19/roles/9ee80134743f4c2b88525b04df2facba => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:58:38.695694 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b48653-5fa3-41a5-a8c9-a4464ada56af None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:38.696217 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b48653-5fa3-41a5-a8c9-a4464ada56af None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:38.696829 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b48653-5fa3-41a5-a8c9-a4464ada56af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:38.714847 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-42440f48-52e7-4ec3-aaaa-22241f07a432 None None] MFA Rules not processed for user `982b81f3b5a94f5584a71c34f86f33de`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:58:38.716263 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-42440f48-52e7-4ec3-aaaa-22241f07a432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:38.743691 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-03b48653-5fa3-41a5-a8c9-a4464ada56af None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:58:38.745016 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-03b48653-5fa3-41a5-a8c9-a4464ada56af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:38.949239 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 889/1787] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:58:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:58:38.964511 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b48653-5fa3-41a5-a8c9-a4464ada56af None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:38.970385 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-03b48653-5fa3-41a5-a8c9-a4464ada56af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:38.993516 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 899/1788] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:58:38 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:58:39.008166 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42440f48-52e7-4ec3-aaaa-22241f07a432 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:39.010366 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-42440f48-52e7-4ec3-aaaa-22241f07a432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:39.119906 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b48653-5fa3-41a5-a8c9-a4464ada56af None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:39.135898 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f147a8f-7832-4cec-bfbe-e085bc325ab6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5652329c71cd431fb579d69cef933b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:39.136680 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f147a8f-7832-4cec-bfbe-e085bc325ab6 service neutron] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:39.137066 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f147a8f-7832-4cec-bfbe-e085bc325ab6 service neutron] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:39.138208 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f147a8f-7832-4cec-bfbe-e085bc325ab6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:39.164984 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f147a8f-7832-4cec-bfbe-e085bc325ab6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:39.166232 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42440f48-52e7-4ec3-aaaa-22241f07a432 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:39.167889 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f147a8f-7832-4cec-bfbe-e085bc325ab6 service neutron] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:39.179631 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed29ec3-2709-4cbd-8cc6-780b87813c08 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17945e7d72954b8787e0ba09a9903247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:39.180449 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed29ec3-2709-4cbd-8cc6-780b87813c08 service cinder] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:39.180833 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed29ec3-2709-4cbd-8cc6-780b87813c08 service cinder] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:39.182978 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed29ec3-2709-4cbd-8cc6-780b87813c08 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:39.228758 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 890/1789] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:58:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 17:58:39.233730 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed29ec3-2709-4cbd-8cc6-780b87813c08 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:39.236006 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed29ec3-2709-4cbd-8cc6-780b87813c08 service cinder] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:39.259689 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 900/1790] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:58:39 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 17:58:39.274553 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:58:39.447009 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:58:39.455618 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f147a8f-7832-4cec-bfbe-e085bc325ab6 service neutron] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:39.466909 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f147a8f-7832-4cec-bfbe-e085bc325ab6 service neutron] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:39.473376 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcc6806-48a1-4109-8b42-457ea8cc2195 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17945e7d72954b8787e0ba09a9903247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:39.474636 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcc6806-48a1-4109-8b42-457ea8cc2195 service cinder] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:39.475240 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcc6806-48a1-4109-8b42-457ea8cc2195 service cinder] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:39.475837 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcc6806-48a1-4109-8b42-457ea8cc2195 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:39.478083 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-abcc6806-48a1-4109-8b42-457ea8cc2195 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:39.565187 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcc6806-48a1-4109-8b42-457ea8cc2195 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:39.566817 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcc6806-48a1-4109-8b42-457ea8cc2195 service cinder] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:39.577160 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 891/1791] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:58:39 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 17:58:39.701635 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d39e4e-2900-4930-8da4-d0e4019879ef None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:39.704334 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d39e4e-2900-4930-8da4-d0e4019879ef None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:39.704334 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d39e4e-2900-4930-8da4-d0e4019879ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:39.748018 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-87d39e4e-2900-4930-8da4-d0e4019879ef None None] MFA Rules not processed for user `41680577c34d4b9090270d3097a7e02c`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:58:39.749264 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-87d39e4e-2900-4930-8da4-d0e4019879ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:39.827115 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 901/1792] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:58:39 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:58:41.495829 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86b06a5-aa8f-4230-87ed-5a413b9c61e0 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:41.496740 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86b06a5-aa8f-4230-87ed-5a413b9c61e0 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:41.497276 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86b06a5-aa8f-4230-87ed-5a413b9c61e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:41.530092 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d39e4e-2900-4930-8da4-d0e4019879ef None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:41.533580 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-87d39e4e-2900-4930-8da4-d0e4019879ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:41.551972 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d39e4e-2900-4930-8da4-d0e4019879ef None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:41.557470 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689e0eb0-1ec7-4c9a-a2a0-3271c873bc1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:41.559065 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689e0eb0-1ec7-4c9a-a2a0-3271c873bc1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:41.559792 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689e0eb0-1ec7-4c9a-a2a0-3271c873bc1c admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:41.559978 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-f86b06a5-aa8f-4230-87ed-5a413b9c61e0 None None] MFA Rules not processed for user `34ed72772964438e8f35d1a8f468ad19`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:58:41.560635 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689e0eb0-1ec7-4c9a-a2a0-3271c873bc1c admin admin] PATH_INFO: `/v3/users/01d1ce7eb1924b7da0789c6c0346d900` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:41.562896 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689e0eb0-1ec7-4c9a-a2a0-3271c873bc1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=01d1ce7eb1924b7da0789c6c0346d900)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:41.566607 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-f86b06a5-aa8f-4230-87ed-5a413b9c61e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:41.571096 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689e0eb0-1ec7-4c9a-a2a0-3271c873bc1c admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:41.679591 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 892/1793] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:58:41 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:58:41.680531 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86b06a5-aa8f-4230-87ed-5a413b9c61e0 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:41.698971 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86b06a5-aa8f-4230-87ed-5a413b9c61e0 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:41.706759 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bf8499-39d1-4643-8160-0498df646a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:41.707926 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bf8499-39d1-4643-8160-0498df646a7b admin admin] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:41.708412 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bf8499-39d1-4643-8160-0498df646a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:41.708747 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bf8499-39d1-4643-8160-0498df646a7b admin admin] PATH_INFO: `/v3/projects` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:41.709684 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bf8499-39d1-4643-8160-0498df646a7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:41.712294 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bf8499-39d1-4643-8160-0498df646a7b admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:41.849175 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-689e0eb0-1ec7-4c9a-a2a0-3271c873bc1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01d1ce7eb1924b7da0789c6c0346d900'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:41.849901 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-689e0eb0-1ec7-4c9a-a2a0-3271c873bc1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01d1ce7eb1924b7da0789c6c0346d900'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:41.850514 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-689e0eb0-1ec7-4c9a-a2a0-3271c873bc1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01d1ce7eb1924b7da0789c6c0346d900'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:41.872985 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 893/1794] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 14 17:58:41 2022] POST /identity/v3/projects => generated 405 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:58:41.877015 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bf8499-39d1-4643-8160-0498df646a7b admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:41.878734 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-15bf8499-39d1-4643-8160-0498df646a7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:41.959067 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bf8499-39d1-4643-8160-0498df646a7b admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:41.966096 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6307abb4-692e-4e45-9ce2-4dc96cfcd41d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:41.966096 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6307abb4-692e-4e45-9ce2-4dc96cfcd41d admin admin] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:41.966096 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6307abb4-692e-4e45-9ce2-4dc96cfcd41d admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:41.966096 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6307abb4-692e-4e45-9ce2-4dc96cfcd41d admin admin] PATH_INFO: `/v3/users` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:41.967191 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6307abb4-692e-4e45-9ce2-4dc96cfcd41d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:41.968091 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6307abb4-692e-4e45-9ce2-4dc96cfcd41d admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:41.998538 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-689e0eb0-1ec7-4c9a-a2a0-3271c873bc1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01d1ce7eb1924b7da0789c6c0346d900'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:42.011760 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-689e0eb0-1ec7-4c9a-a2a0-3271c873bc1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01d1ce7eb1924b7da0789c6c0346d900'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:42.052603 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 902/1795] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 14 17:58:41 2022] DELETE /identity/v3/users/01d1ce7eb1924b7da0789c6c0346d900 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:58:42.058092 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e596c51-01bb-457f-9676-82d621a23269 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:42.058623 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e596c51-01bb-457f-9676-82d621a23269 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:42.059170 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e596c51-01bb-457f-9676-82d621a23269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:42.085728 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-1e596c51-01bb-457f-9676-82d621a23269 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:58:42.087054 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-1e596c51-01bb-457f-9676-82d621a23269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:42.116060 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:58:42.123912 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 894/1796] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 14 17:58:41 2022] POST /identity/v3/users => generated 309 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 17:58:42.127983 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6307abb4-692e-4e45-9ce2-4dc96cfcd41d admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:42.160855 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6307abb4-692e-4e45-9ce2-4dc96cfcd41d admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:42.242062 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b86063-bf14-464a-8dc2-ccae5fd69025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:42.242809 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b86063-bf14-464a-8dc2-ccae5fd69025 admin admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:42.243151 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b86063-bf14-464a-8dc2-ccae5fd69025 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:42.243491 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b86063-bf14-464a-8dc2-ccae5fd69025 admin admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:42.244902 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b86063-bf14-464a-8dc2-ccae5fd69025 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:42.246564 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b86063-bf14-464a-8dc2-ccae5fd69025 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:42.260643 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 895/1797] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 17:58:42 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 17:58:42.267445 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b86063-bf14-464a-8dc2-ccae5fd69025 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:42.281304 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b86063-bf14-464a-8dc2-ccae5fd69025 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:42.281550 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 903/1798] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:58:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:58:42.291554 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce939058-59b1-46b1-99db-b444be611a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:42.292643 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce939058-59b1-46b1-99db-b444be611a39 admin admin] REQUEST_METHOD: `PUT` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:42.293055 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce939058-59b1-46b1-99db-b444be611a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:42.293389 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce939058-59b1-46b1-99db-b444be611a39 admin admin] PATH_INFO: `/v3/projects/2278350373f44922a3b4690b18f92dc7/users/a504d802f1624eb8be000fd95e7dd8ad/roles/1348580877d04014bfdec4d866b98a74` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:42.304261 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e596c51-01bb-457f-9676-82d621a23269 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:42.309096 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-1e596c51-01bb-457f-9676-82d621a23269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:42.316988 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce939058-59b1-46b1-99db-b444be611a39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2278350373f44922a3b4690b18f92dc7, user_id=a504d802f1624eb8be000fd95e7dd8ad, role_id=1348580877d04014bfdec4d866b98a74)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:42.321077 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce939058-59b1-46b1-99db-b444be611a39 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:42.396186 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e596c51-01bb-457f-9676-82d621a23269 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:42.403738 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2525806-4021-44fb-a519-79b29c64858d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5652329c71cd431fb579d69cef933b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:42.404917 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2525806-4021-44fb-a519-79b29c64858d service neutron] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:42.405274 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2525806-4021-44fb-a519-79b29c64858d service neutron] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:42.405546 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2525806-4021-44fb-a519-79b29c64858d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:42.410638 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 896/1799] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 17:58:42 2022] PUT /identity/v3/projects/2278350373f44922a3b4690b18f92dc7/users/a504d802f1624eb8be000fd95e7dd8ad/roles/1348580877d04014bfdec4d866b98a74 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:58:42.412189 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce939058-59b1-46b1-99db-b444be611a39 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:42.418602 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2525806-4021-44fb-a519-79b29c64858d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:42.420124 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2525806-4021-44fb-a519-79b29c64858d service neutron] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:42.429512 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:58:42.447967 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 904/1800] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:58:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:58:42.510960 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce939058-59b1-46b1-99db-b444be611a39 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:42.517152 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ae4e38-469a-46bf-aed9-b5e02f26a58a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:42.517839 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ae4e38-469a-46bf-aed9-b5e02f26a58a admin admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:42.518129 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ae4e38-469a-46bf-aed9-b5e02f26a58a admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:42.518415 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ae4e38-469a-46bf-aed9-b5e02f26a58a admin admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:42.519158 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ae4e38-469a-46bf-aed9-b5e02f26a58a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:42.520839 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ae4e38-469a-46bf-aed9-b5e02f26a58a admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:42.532031 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 897/1801] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 17:58:42 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 17:58:42.536352 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2525806-4021-44fb-a519-79b29c64858d service neutron] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:42.547291 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2525806-4021-44fb-a519-79b29c64858d service neutron] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:42.552876 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66c386a-eca4-4407-bacc-974c3b2ee574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:42.553815 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66c386a-eca4-4407-bacc-974c3b2ee574 admin admin] REQUEST_METHOD: `PUT` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:42.554106 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66c386a-eca4-4407-bacc-974c3b2ee574 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:42.554393 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66c386a-eca4-4407-bacc-974c3b2ee574 admin admin] PATH_INFO: `/v3/projects/2278350373f44922a3b4690b18f92dc7/users/a504d802f1624eb8be000fd95e7dd8ad/roles/1348580877d04014bfdec4d866b98a74` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:42.556526 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66c386a-eca4-4407-bacc-974c3b2ee574 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2278350373f44922a3b4690b18f92dc7, user_id=a504d802f1624eb8be000fd95e7dd8ad, role_id=1348580877d04014bfdec4d866b98a74)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:42.559210 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66c386a-eca4-4407-bacc-974c3b2ee574 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:42.591841 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 905/1802] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 17:58:42 2022] PUT /identity/v3/projects/2278350373f44922a3b4690b18f92dc7/users/a504d802f1624eb8be000fd95e7dd8ad/roles/1348580877d04014bfdec4d866b98a74 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:58:43.305329 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ae4e38-469a-46bf-aed9-b5e02f26a58a admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:43.307367 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-15ae4e38-469a-46bf-aed9-b5e02f26a58a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:43.340483 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ae4e38-469a-46bf-aed9-b5e02f26a58a admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:43.436216 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573ffdf5-8236-4124-8aee-63df92b80a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:43.439262 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573ffdf5-8236-4124-8aee-63df92b80a12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:43.441604 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573ffdf5-8236-4124-8aee-63df92b80a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:43.442123 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573ffdf5-8236-4124-8aee-63df92b80a12 admin admin] PATH_INFO: `/v3/projects/b75212185ace4ce8a3a52854a7bb9403` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:43.446623 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573ffdf5-8236-4124-8aee-63df92b80a12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b75212185ace4ce8a3a52854a7bb9403)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:43.449839 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573ffdf5-8236-4124-8aee-63df92b80a12 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:43.688879 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-573ffdf5-8236-4124-8aee-63df92b80a12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b75212185ace4ce8a3a52854a7bb9403', 'request_id': 'req-573ffdf5-8236-4124-8aee-63df92b80a12'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:43.805973 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-573ffdf5-8236-4124-8aee-63df92b80a12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b75212185ace4ce8a3a52854a7bb9403', 'request_id': 'req-573ffdf5-8236-4124-8aee-63df92b80a12'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:43.817762 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-573ffdf5-8236-4124-8aee-63df92b80a12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b75212185ace4ce8a3a52854a7bb9403', 'request_id': 'req-573ffdf5-8236-4124-8aee-63df92b80a12'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:43.855103 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-573ffdf5-8236-4124-8aee-63df92b80a12 admin admin] The token cache is being invalidate because project b75212185ace4ce8a3a52854a7bb9403 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 17:58:43.855453 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-573ffdf5-8236-4124-8aee-63df92b80a12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:43.856219 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-573ffdf5-8236-4124-8aee-63df92b80a12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:43.866037 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 898/1803] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 14 17:58:43 2022] DELETE /identity/v3/projects/b75212185ace4ce8a3a52854a7bb9403 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:58:43.867770 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66c386a-eca4-4407-bacc-974c3b2ee574 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:43.869837 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-c66c386a-eca4-4407-bacc-974c3b2ee574 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:43.895452 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66c386a-eca4-4407-bacc-974c3b2ee574 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:44.122268 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723c3c0e-1131-4d11-88c7-9b2430e58dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:44.122268 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723c3c0e-1131-4d11-88c7-9b2430e58dc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:44.122268 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723c3c0e-1131-4d11-88c7-9b2430e58dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:44.122268 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723c3c0e-1131-4d11-88c7-9b2430e58dc3 admin admin] PATH_INFO: `/v3/users/35a6820cbf104062b535665e257f4c47` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:44.122685 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723c3c0e-1131-4d11-88c7-9b2430e58dc3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35a6820cbf104062b535665e257f4c47)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:44.122685 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723c3c0e-1131-4d11-88c7-9b2430e58dc3 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:44.396842 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-723c3c0e-1131-4d11-88c7-9b2430e58dc3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35a6820cbf104062b535665e257f4c47'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:44.397516 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-723c3c0e-1131-4d11-88c7-9b2430e58dc3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35a6820cbf104062b535665e257f4c47'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:44.398141 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-723c3c0e-1131-4d11-88c7-9b2430e58dc3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35a6820cbf104062b535665e257f4c47'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:44.549410 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-723c3c0e-1131-4d11-88c7-9b2430e58dc3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35a6820cbf104062b535665e257f4c47'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:44.557952 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-723c3c0e-1131-4d11-88c7-9b2430e58dc3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35a6820cbf104062b535665e257f4c47'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:44.581881 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 906/1804] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 14 17:58:43 2022] DELETE /identity/v3/users/35a6820cbf104062b535665e257f4c47 => generated 0 bytes in 715 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:58:44.712435 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:58:45.064987 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:58:45.141955 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac16fd0-6f9e-44ba-983f-f7fcc50f1a9d None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:45.142653 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac16fd0-6f9e-44ba-983f-f7fcc50f1a9d None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:45.143565 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac16fd0-6f9e-44ba-983f-f7fcc50f1a9d None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:45.145591 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 899/1805] 10.222.0.36 () {54 vars in 921 bytes} [Tue Jun 14 17:58:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:58:45.160327 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43da10c-2323-4b2b-9c29-aa55830b298b None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:45.160654 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43da10c-2323-4b2b-9c29-aa55830b298b None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:45.160946 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43da10c-2323-4b2b-9c29-aa55830b298b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:45.186696 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-e43da10c-2323-4b2b-9c29-aa55830b298b None None] MFA Rules not processed for user `e4696d396adb495ab300a9a5a5727595`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:58:45.189454 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-e43da10c-2323-4b2b-9c29-aa55830b298b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:45.293384 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 907/1806] 10.222.0.36 () {58 vars in 1018 bytes} [Tue Jun 14 17:58:45 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:58:45.351973 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac16fd0-6f9e-44ba-983f-f7fcc50f1a9d None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:45.357514 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-6ac16fd0-6f9e-44ba-983f-f7fcc50f1a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:45.408861 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac16fd0-6f9e-44ba-983f-f7fcc50f1a9d None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:45.420533 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ec9e03-6ad4-4749-bed7-4c32b22b9d3d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4696d396adb495ab300a9a5a5727595', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:45.423109 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ec9e03-6ad4-4749-bed7-4c32b22b9d3d service nova] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:45.431754 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ec9e03-6ad4-4749-bed7-4c32b22b9d3d service nova] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:45.432125 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ec9e03-6ad4-4749-bed7-4c32b22b9d3d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:45.453609 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ec9e03-6ad4-4749-bed7-4c32b22b9d3d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:45.453609 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ec9e03-6ad4-4749-bed7-4c32b22b9d3d service nova] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:45.466081 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 900/1807] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:58:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:58:45.743184 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43da10c-2323-4b2b-9c29-aa55830b298b None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:45.753274 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-e43da10c-2323-4b2b-9c29-aa55830b298b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:45.934707 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43da10c-2323-4b2b-9c29-aa55830b298b None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:45.934707 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaa9e3d-2ac7-44f6-84f1-5e10f045960a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:45.934707 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa9e3d-2ac7-44f6-84f1-5e10f045960a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:45.934707 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa9e3d-2ac7-44f6-84f1-5e10f045960a admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:45.936509 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa9e3d-2ac7-44f6-84f1-5e10f045960a admin admin] PATH_INFO: `/v3/projects/63de3848590646cd918c32a317718ddd` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:45.936509 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaa9e3d-2ac7-44f6-84f1-5e10f045960a admin admin] RBAC: Authorizing `identity:delete_project(project_id=63de3848590646cd918c32a317718ddd)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:45.938956 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaa9e3d-2ac7-44f6-84f1-5e10f045960a admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:47.166887 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-acaa9e3d-2ac7-44f6-84f1-5e10f045960a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63de3848590646cd918c32a317718ddd', 'request_id': 'req-acaa9e3d-2ac7-44f6-84f1-5e10f045960a'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:47.286310 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-acaa9e3d-2ac7-44f6-84f1-5e10f045960a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63de3848590646cd918c32a317718ddd', 'request_id': 'req-acaa9e3d-2ac7-44f6-84f1-5e10f045960a'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:47.345238 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-acaa9e3d-2ac7-44f6-84f1-5e10f045960a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63de3848590646cd918c32a317718ddd', 'request_id': 'req-acaa9e3d-2ac7-44f6-84f1-5e10f045960a'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:47.345238 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-acaa9e3d-2ac7-44f6-84f1-5e10f045960a admin admin] The token cache is being invalidate because project 63de3848590646cd918c32a317718ddd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87019) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 17:58:47.345238 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-acaa9e3d-2ac7-44f6-84f1-5e10f045960a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:47.345238 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-acaa9e3d-2ac7-44f6-84f1-5e10f045960a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:47.345238 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 908/1808] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 14 17:58:45 2022] DELETE /identity/v3/projects/63de3848590646cd918c32a317718ddd => generated 0 bytes in 1579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:58:47.346755 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045946fe-a0c5-4f1c-bf16-954f9de4d9b6 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:47.346755 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045946fe-a0c5-4f1c-bf16-954f9de4d9b6 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:47.346755 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045946fe-a0c5-4f1c-bf16-954f9de4d9b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:47.386281 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-045946fe-a0c5-4f1c-bf16-954f9de4d9b6 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:58:47.392059 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-045946fe-a0c5-4f1c-bf16-954f9de4d9b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:47.534563 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeef1d3-3b3a-410f-b0bc-944eeeafbffc None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:47.534881 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeef1d3-3b3a-410f-b0bc-944eeeafbffc None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:47.535891 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeef1d3-3b3a-410f-b0bc-944eeeafbffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:47.561640 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 901/1809] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:58:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:58:47.566538 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb1aa32-e27c-49e4-a705-8f400172287d None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:47.568677 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb1aa32-e27c-49e4-a705-8f400172287d None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:47.572637 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb1aa32-e27c-49e4-a705-8f400172287d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:47.608660 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-deb1aa32-e27c-49e4-a705-8f400172287d None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:58:47.622689 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-deb1aa32-e27c-49e4-a705-8f400172287d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:47.641580 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-aeeef1d3-3b3a-410f-b0bc-944eeeafbffc None None] MFA Rules not processed for user `a504d802f1624eb8be000fd95e7dd8ad`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:58:47.647506 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-aeeef1d3-3b3a-410f-b0bc-944eeeafbffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:47.651879 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 902/1810] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:58:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:58:47.653794 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb1aa32-e27c-49e4-a705-8f400172287d None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:47.678210 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb1aa32-e27c-49e4-a705-8f400172287d None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:47.690935 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eca3f92-8831-4838-ad30-8a2fe20bb0ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:47.691918 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eca3f92-8831-4838-ad30-8a2fe20bb0ed admin admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:47.692985 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eca3f92-8831-4838-ad30-8a2fe20bb0ed admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:47.693513 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eca3f92-8831-4838-ad30-8a2fe20bb0ed admin admin] PATH_INFO: `/v3/domains` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:47.696469 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eca3f92-8831-4838-ad30-8a2fe20bb0ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:58:47.704044 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eca3f92-8831-4838-ad30-8a2fe20bb0ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:47.704044 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eca3f92-8831-4838-ad30-8a2fe20bb0ed admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:47.725582 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 903/1811] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 14 17:58:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:58:47.729700 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eca3f92-8831-4838-ad30-8a2fe20bb0ed admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:47.741977 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eca3f92-8831-4838-ad30-8a2fe20bb0ed admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:47.750747 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd19654b-7b65-40ba-9337-835b644211c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:47.752337 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd19654b-7b65-40ba-9337-835b644211c1 admin admin] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:47.752959 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd19654b-7b65-40ba-9337-835b644211c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:47.753445 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd19654b-7b65-40ba-9337-835b644211c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:47.754808 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd19654b-7b65-40ba-9337-835b644211c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:47.757178 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd19654b-7b65-40ba-9337-835b644211c1 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:47.816338 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 909/1812] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:58:47 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:58:47.817561 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeef1d3-3b3a-410f-b0bc-944eeeafbffc None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:47.821494 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-aeeef1d3-3b3a-410f-b0bc-944eeeafbffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:47.852305 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeef1d3-3b3a-410f-b0bc-944eeeafbffc None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:47.867485 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd9332c-86da-4de2-9f95-a164c292babb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:47.868444 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd9332c-86da-4de2-9f95-a164c292babb admin admin] REQUEST_METHOD: `DELETE` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:47.868789 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd9332c-86da-4de2-9f95-a164c292babb admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:47.869075 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd9332c-86da-4de2-9f95-a164c292babb admin admin] PATH_INFO: `/v3/users/616674116d0841afb108ca8e6a560233` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:47.870488 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd9332c-86da-4de2-9f95-a164c292babb admin admin] RBAC: Authorizing `identity:delete_user(user_id=616674116d0841afb108ca8e6a560233)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:47.872596 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd9332c-86da-4de2-9f95-a164c292babb admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:47.916839 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 904/1813] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 14 17:58:47 2022] POST /identity/v3/projects => generated 383 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 17:58:47.921211 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd19654b-7b65-40ba-9337-835b644211c1 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:48.013281 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd19654b-7b65-40ba-9337-835b644211c1 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:48.021593 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a98155-a26a-4254-9a6c-1cb4641bd22f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:48.022305 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a98155-a26a-4254-9a6c-1cb4641bd22f admin admin] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:48.022600 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a98155-a26a-4254-9a6c-1cb4641bd22f admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:48.023463 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a98155-a26a-4254-9a6c-1cb4641bd22f admin admin] PATH_INFO: `/v3/users` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:48.024192 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a98155-a26a-4254-9a6c-1cb4641bd22f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:48.026878 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a98155-a26a-4254-9a6c-1cb4641bd22f admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:48.123353 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-7cd9332c-86da-4de2-9f95-a164c292babb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '616674116d0841afb108ca8e6a560233'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:48.123353 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-7cd9332c-86da-4de2-9f95-a164c292babb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '616674116d0841afb108ca8e6a560233'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:48.123353 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-7cd9332c-86da-4de2-9f95-a164c292babb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '616674116d0841afb108ca8e6a560233'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:48.125338 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 905/1814] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 14 17:58:47 2022] POST /identity/v3/users => generated 292 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:58:48.126688 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a98155-a26a-4254-9a6c-1cb4641bd22f admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:48.129904 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-08a98155-a26a-4254-9a6c-1cb4641bd22f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:48.147530 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a98155-a26a-4254-9a6c-1cb4641bd22f admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:48.153374 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7e45e2-4d0b-4052-974f-7ad9687988a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:48.154503 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e45e2-4d0b-4052-974f-7ad9687988a5 admin admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:48.154503 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e45e2-4d0b-4052-974f-7ad9687988a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:48.154684 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e45e2-4d0b-4052-974f-7ad9687988a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:48.155788 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7e45e2-4d0b-4052-974f-7ad9687988a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:48.158366 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7e45e2-4d0b-4052-974f-7ad9687988a5 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:48.170343 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 906/1815] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 17:58:48 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 17:58:48.175665 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7e45e2-4d0b-4052-974f-7ad9687988a5 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:48.188817 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7e45e2-4d0b-4052-974f-7ad9687988a5 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:48.194114 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6fa156-352a-476b-ac79-767c710d9525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:48.194799 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6fa156-352a-476b-ac79-767c710d9525 admin admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:48.195086 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6fa156-352a-476b-ac79-767c710d9525 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:48.195400 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6fa156-352a-476b-ac79-767c710d9525 admin admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:48.196377 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6fa156-352a-476b-ac79-767c710d9525 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:48.197729 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6fa156-352a-476b-ac79-767c710d9525 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:48.202939 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-7cd9332c-86da-4de2-9f95-a164c292babb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '616674116d0841afb108ca8e6a560233'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:48.220853 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 907/1816] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 17:58:48 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 17:58:48.231028 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-7cd9332c-86da-4de2-9f95-a164c292babb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '616674116d0841afb108ca8e6a560233'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:48.233338 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6fa156-352a-476b-ac79-767c710d9525 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:48.264368 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6fa156-352a-476b-ac79-767c710d9525 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:48.278234 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb30fe9-d90f-450b-9cf7-f3c4ec11c686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:48.281114 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb30fe9-d90f-450b-9cf7-f3c4ec11c686 admin admin] REQUEST_METHOD: `PUT` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:48.281114 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb30fe9-d90f-450b-9cf7-f3c4ec11c686 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:48.282255 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb30fe9-d90f-450b-9cf7-f3c4ec11c686 admin admin] PATH_INFO: `/v3/projects/d746e85432a54249b34510afd09d765c/users/4ac9e9e442f1482f8de6bf5cfe4350d9/roles/9ee80134743f4c2b88525b04df2facba` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:48.289052 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 910/1817] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 14 17:58:47 2022] DELETE /identity/v3/users/616674116d0841afb108ca8e6a560233 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:58:48.290576 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa6d49b-4481-4e8c-ade7-553af8767c62 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:48.290872 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa6d49b-4481-4e8c-ade7-553af8767c62 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:48.291159 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa6d49b-4481-4e8c-ade7-553af8767c62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:48.310448 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:58:48.318444 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb30fe9-d90f-450b-9cf7-f3c4ec11c686 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d746e85432a54249b34510afd09d765c, user_id=4ac9e9e442f1482f8de6bf5cfe4350d9, role_id=9ee80134743f4c2b88525b04df2facba)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:48.322972 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb30fe9-d90f-450b-9cf7-f3c4ec11c686 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:48.324324 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-8fa6d49b-4481-4e8c-ade7-553af8767c62 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:58:48.325755 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-8fa6d49b-4481-4e8c-ade7-553af8767c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:48.406654 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 908/1818] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 17:58:48 2022] PUT /identity/v3/projects/d746e85432a54249b34510afd09d765c/users/4ac9e9e442f1482f8de6bf5cfe4350d9/roles/9ee80134743f4c2b88525b04df2facba => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:58:48.408192 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36682362-96ae-4fad-a3d5-4240f479631c None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:48.413114 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36682362-96ae-4fad-a3d5-4240f479631c None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:48.413114 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36682362-96ae-4fad-a3d5-4240f479631c None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:48.413114 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 909/1819] 10.222.0.36 () {54 vars in 921 bytes} [Tue Jun 14 17:58:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:58:48.418121 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa18fbf-5081-4d43-9963-63770f6b549e None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:48.418422 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa18fbf-5081-4d43-9963-63770f6b549e None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:48.418703 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa18fbf-5081-4d43-9963-63770f6b549e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:48.439757 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 911/1820] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:58:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:58:48.441329 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4664a62f-d200-423b-a498-c659312bdd38 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:48.442001 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4664a62f-d200-423b-a498-c659312bdd38 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:48.442312 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4664a62f-d200-423b-a498-c659312bdd38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:48.451204 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-2aa18fbf-5081-4d43-9963-63770f6b549e None None] MFA Rules not processed for user `e4696d396adb495ab300a9a5a5727595`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:58:48.455752 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-2aa18fbf-5081-4d43-9963-63770f6b549e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:48.472491 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-4664a62f-d200-423b-a498-c659312bdd38 None None] MFA Rules not processed for user `4ac9e9e442f1482f8de6bf5cfe4350d9`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:58:48.473843 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-4664a62f-d200-423b-a498-c659312bdd38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:48.615425 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 910/1821] 10.222.0.36 () {58 vars in 1018 bytes} [Tue Jun 14 17:58:48 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 17:58:48.616451 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa18fbf-5081-4d43-9963-63770f6b549e None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:48.617896 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-2aa18fbf-5081-4d43-9963-63770f6b549e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:48.621736 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 912/1822] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:58:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:58:48.624083 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4664a62f-d200-423b-a498-c659312bdd38 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:48.700442 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa18fbf-5081-4d43-9963-63770f6b549e None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:48.704401 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4664a62f-d200-423b-a498-c659312bdd38 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:48.709915 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54006745-0d59-4862-84fb-afebab9e6cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:48.710115 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec42c20-2809-4176-9e3b-87715682590a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5652329c71cd431fb579d69cef933b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:48.710633 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec42c20-2809-4176-9e3b-87715682590a service neutron] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:48.710923 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec42c20-2809-4176-9e3b-87715682590a service neutron] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:48.711212 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec42c20-2809-4176-9e3b-87715682590a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:48.711914 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54006745-0d59-4862-84fb-afebab9e6cbc admin admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:48.712367 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54006745-0d59-4862-84fb-afebab9e6cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:48.712818 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54006745-0d59-4862-84fb-afebab9e6cbc admin admin] PATH_INFO: `/v3/projects` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:48.713698 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54006745-0d59-4862-84fb-afebab9e6cbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:48.715973 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54006745-0d59-4862-84fb-afebab9e6cbc admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:48.722481 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec42c20-2809-4176-9e3b-87715682590a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:48.723992 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec42c20-2809-4176-9e3b-87715682590a service neutron] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:48.735803 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 911/1823] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:58:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:58:48.736735 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec42c20-2809-4176-9e3b-87715682590a service neutron] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:48.738077 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-0ec42c20-2809-4176-9e3b-87715682590a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:48.754554 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec42c20-2809-4176-9e3b-87715682590a service neutron] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:48.762753 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50da90d0-27c6-4b00-be45-5bd2d32569e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4696d396adb495ab300a9a5a5727595', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:48.763476 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50da90d0-27c6-4b00-be45-5bd2d32569e2 service nova] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:48.763763 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50da90d0-27c6-4b00-be45-5bd2d32569e2 service nova] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:48.764052 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50da90d0-27c6-4b00-be45-5bd2d32569e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:48.774033 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50da90d0-27c6-4b00-be45-5bd2d32569e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:48.775660 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50da90d0-27c6-4b00-be45-5bd2d32569e2 service nova] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:48.788047 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 912/1824] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:58:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:58:48.899952 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 913/1825] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 14 17:58:48 2022] POST /identity/v3/projects => generated 385 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:58:48.904106 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50da90d0-27c6-4b00-be45-5bd2d32569e2 service nova] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:48.915893 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50da90d0-27c6-4b00-be45-5bd2d32569e2 service nova] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:49.002952 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed62bd0d-4863-4922-9a29-7b217957f6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:49.004249 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed62bd0d-4863-4922-9a29-7b217957f6aa admin admin] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:49.004539 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed62bd0d-4863-4922-9a29-7b217957f6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:49.004820 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed62bd0d-4863-4922-9a29-7b217957f6aa admin admin] PATH_INFO: `/v3/users` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:49.005542 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed62bd0d-4863-4922-9a29-7b217957f6aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:49.007490 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed62bd0d-4863-4922-9a29-7b217957f6aa admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:49.189043 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 913/1826] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 14 17:58:48 2022] POST /identity/v3/users => generated 299 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 17:58:49.191755 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54006745-0d59-4862-84fb-afebab9e6cbc admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:49.203851 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54006745-0d59-4862-84fb-afebab9e6cbc admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:49.209468 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdf7712-4606-4b95-9e8e-77d7b54b6ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:49.210274 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdf7712-4606-4b95-9e8e-77d7b54b6ff8 admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:49.210463 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdf7712-4606-4b95-9e8e-77d7b54b6ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:49.210789 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdf7712-4606-4b95-9e8e-77d7b54b6ff8 admin admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:49.211551 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdf7712-4606-4b95-9e8e-77d7b54b6ff8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:49.213218 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdf7712-4606-4b95-9e8e-77d7b54b6ff8 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:49.225697 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 914/1827] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 17:58:49 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 17:58:49.229545 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed62bd0d-4863-4922-9a29-7b217957f6aa admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:49.243113 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed62bd0d-4863-4922-9a29-7b217957f6aa admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:49.249482 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325ae163-f22f-4981-87a3-59ef4fcd9427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:49.251070 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325ae163-f22f-4981-87a3-59ef4fcd9427 admin admin] REQUEST_METHOD: `PUT` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:49.251410 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325ae163-f22f-4981-87a3-59ef4fcd9427 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:49.251704 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325ae163-f22f-4981-87a3-59ef4fcd9427 admin admin] PATH_INFO: `/v3/projects/421251242a2643e584e841f25c1f56dc/users/d9e574e873a34d83b1001e6f5370b830/roles/1348580877d04014bfdec4d866b98a74` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:49.278763 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdf7712-4606-4b95-9e8e-77d7b54b6ff8 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:49.279802 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325ae163-f22f-4981-87a3-59ef4fcd9427 admin admin] RBAC: Authorizing `identity:create_grant(project_id=421251242a2643e584e841f25c1f56dc, user_id=d9e574e873a34d83b1001e6f5370b830, role_id=1348580877d04014bfdec4d866b98a74)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:49.282739 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-fcdf7712-4606-4b95-9e8e-77d7b54b6ff8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:49.283551 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325ae163-f22f-4981-87a3-59ef4fcd9427 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:49.321556 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdf7712-4606-4b95-9e8e-77d7b54b6ff8 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:49.329801 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44099db3-fabe-469c-ba94-c0f792f6d868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:49.331270 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44099db3-fabe-469c-ba94-c0f792f6d868 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:49.331903 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44099db3-fabe-469c-ba94-c0f792f6d868 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:49.332342 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44099db3-fabe-469c-ba94-c0f792f6d868 admin admin] PATH_INFO: `/v3/projects/11cde5e430c0406c9bcf214c14882af2` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:49.334793 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44099db3-fabe-469c-ba94-c0f792f6d868 admin admin] RBAC: Authorizing `identity:delete_project(project_id=11cde5e430c0406c9bcf214c14882af2)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:49.336929 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44099db3-fabe-469c-ba94-c0f792f6d868 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:49.383886 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 914/1828] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 17:58:49 2022] PUT /identity/v3/projects/421251242a2643e584e841f25c1f56dc/users/d9e574e873a34d83b1001e6f5370b830/roles/1348580877d04014bfdec4d866b98a74 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:58:49.389200 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325ae163-f22f-4981-87a3-59ef4fcd9427 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:49.480445 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325ae163-f22f-4981-87a3-59ef4fcd9427 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:49.508502 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-44099db3-fabe-469c-ba94-c0f792f6d868 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11cde5e430c0406c9bcf214c14882af2', 'request_id': 'req-44099db3-fabe-469c-ba94-c0f792f6d868'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:49.576956 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117d29b6-3332-4b5b-8b8f-4cac9cbe01f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:49.579631 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117d29b6-3332-4b5b-8b8f-4cac9cbe01f2 admin admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:49.579631 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117d29b6-3332-4b5b-8b8f-4cac9cbe01f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:49.579631 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117d29b6-3332-4b5b-8b8f-4cac9cbe01f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:49.580345 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117d29b6-3332-4b5b-8b8f-4cac9cbe01f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:49.582126 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117d29b6-3332-4b5b-8b8f-4cac9cbe01f2 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:49.596883 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 915/1829] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 17:58:49 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 17:58:49.596883 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65453454-3728-47b3-9e99-3f2332441c3f None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:49.596883 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65453454-3728-47b3-9e99-3f2332441c3f None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:49.596883 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65453454-3728-47b3-9e99-3f2332441c3f None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:49.598695 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 916/1830] 10.222.0.36 () {54 vars in 921 bytes} [Tue Jun 14 17:58:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:58:49.599147 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65453454-3728-47b3-9e99-3f2332441c3f None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:49.610791 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-44099db3-fabe-469c-ba94-c0f792f6d868 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11cde5e430c0406c9bcf214c14882af2', 'request_id': 'req-44099db3-fabe-469c-ba94-c0f792f6d868'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:49.628425 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-44099db3-fabe-469c-ba94-c0f792f6d868 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11cde5e430c0406c9bcf214c14882af2', 'request_id': 'req-44099db3-fabe-469c-ba94-c0f792f6d868'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:49.634800 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65453454-3728-47b3-9e99-3f2332441c3f None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:49.639072 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-44099db3-fabe-469c-ba94-c0f792f6d868 admin admin] The token cache is being invalidate because project 11cde5e430c0406c9bcf214c14882af2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87019) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 17:58:49.639519 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-44099db3-fabe-469c-ba94-c0f792f6d868 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:49.643240 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-44099db3-fabe-469c-ba94-c0f792f6d868 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:49.645596 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 915/1831] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 14 17:58:49 2022] DELETE /identity/v3/projects/11cde5e430c0406c9bcf214c14882af2 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:58:49.647719 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f71acb-8f17-4b68-804b-8caa02e7c195 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:49.648009 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f71acb-8f17-4b68-804b-8caa02e7c195 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:49.648736 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f41f70-fd63-46b0-abc9-d9d8e66e6fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:49.650083 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f41f70-fd63-46b0-abc9-d9d8e66e6fe7 admin admin] REQUEST_METHOD: `PUT` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:49.650370 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f41f70-fd63-46b0-abc9-d9d8e66e6fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:49.650701 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f41f70-fd63-46b0-abc9-d9d8e66e6fe7 admin admin] PATH_INFO: `/v3/projects/421251242a2643e584e841f25c1f56dc/users/d9e574e873a34d83b1001e6f5370b830/roles/1348580877d04014bfdec4d866b98a74` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:49.652100 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f71acb-8f17-4b68-804b-8caa02e7c195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:49.652795 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f41f70-fd63-46b0-abc9-d9d8e66e6fe7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=421251242a2643e584e841f25c1f56dc, user_id=d9e574e873a34d83b1001e6f5370b830, role_id=1348580877d04014bfdec4d866b98a74)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:49.657335 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f41f70-fd63-46b0-abc9-d9d8e66e6fe7 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:49.675342 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 917/1832] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 17:58:49 2022] PUT /identity/v3/projects/421251242a2643e584e841f25c1f56dc/users/d9e574e873a34d83b1001e6f5370b830/roles/1348580877d04014bfdec4d866b98a74 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:58:49.675342 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f41f70-fd63-46b0-abc9-d9d8e66e6fe7 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:49.682504 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-16f41f70-fd63-46b0-abc9-d9d8e66e6fe7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:49.691037 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-87f71acb-8f17-4b68-804b-8caa02e7c195 None None] MFA Rules not processed for user `6a8049f9c66b4b5185c26084fd8239ab`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:58:49.696035 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-87f71acb-8f17-4b68-804b-8caa02e7c195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:49.794261 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 916/1833] 10.222.0.36 () {58 vars in 1018 bytes} [Tue Jun 14 17:58:49 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:58:49.796481 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749ad2ef-a382-4bdc-829c-50d6e32b191c None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:49.797908 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749ad2ef-a382-4bdc-829c-50d6e32b191c None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:49.798425 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749ad2ef-a382-4bdc-829c-50d6e32b191c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:49.803043 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f41f70-fd63-46b0-abc9-d9d8e66e6fe7 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:49.822125 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d4bfb5-fe86-4223-9bc0-5e80742d8867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:49.823092 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d4bfb5-fe86-4223-9bc0-5e80742d8867 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:49.823401 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d4bfb5-fe86-4223-9bc0-5e80742d8867 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:49.823682 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d4bfb5-fe86-4223-9bc0-5e80742d8867 admin admin] PATH_INFO: `/v3/users/982b81f3b5a94f5584a71c34f86f33de` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:49.825454 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d4bfb5-fe86-4223-9bc0-5e80742d8867 admin admin] RBAC: Authorizing `identity:delete_user(user_id=982b81f3b5a94f5584a71c34f86f33de)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:49.827592 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d4bfb5-fe86-4223-9bc0-5e80742d8867 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:49.855834 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-749ad2ef-a382-4bdc-829c-50d6e32b191c None None] MFA Rules not processed for user `d9e574e873a34d83b1001e6f5370b830`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:58:49.857093 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-749ad2ef-a382-4bdc-829c-50d6e32b191c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:49.954012 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 917/1834] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:58:49 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:58:49.955076 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749ad2ef-a382-4bdc-829c-50d6e32b191c None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:49.956569 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-749ad2ef-a382-4bdc-829c-50d6e32b191c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:49.973670 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749ad2ef-a382-4bdc-829c-50d6e32b191c None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:49.980814 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7114f8-6a2e-4798-b410-852028d973ba service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a8049f9c66b4b5185c26084fd8239ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:49.981476 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7114f8-6a2e-4798-b410-852028d973ba service placement] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:49.981770 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7114f8-6a2e-4798-b410-852028d973ba service placement] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:49.982053 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7114f8-6a2e-4798-b410-852028d973ba service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:49.994058 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7114f8-6a2e-4798-b410-852028d973ba service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:49.995699 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:58:50.001867 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7114f8-6a2e-4798-b410-852028d973ba service placement] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:50.009538 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 918/1835] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:58:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:58:50.012079 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7114f8-6a2e-4798-b410-852028d973ba service placement] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:50.013382 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-5f7114f8-6a2e-4798-b410-852028d973ba service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:50.098868 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7114f8-6a2e-4798-b410-852028d973ba service placement] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:50.105731 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9d4710-bdfb-46ce-8949-ac6be582f24d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17945e7d72954b8787e0ba09a9903247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:50.106622 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9d4710-bdfb-46ce-8949-ac6be582f24d service cinder] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:50.107014 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9d4710-bdfb-46ce-8949-ac6be582f24d service cinder] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:50.107429 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9d4710-bdfb-46ce-8949-ac6be582f24d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:50.109466 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-7d9d4710-bdfb-46ce-8949-ac6be582f24d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:50.111244 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-13d4bfb5-fe86-4223-9bc0-5e80742d8867 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '982b81f3b5a94f5584a71c34f86f33de'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:50.114302 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-13d4bfb5-fe86-4223-9bc0-5e80742d8867 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '982b81f3b5a94f5584a71c34f86f33de'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:50.116255 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-13d4bfb5-fe86-4223-9bc0-5e80742d8867 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '982b81f3b5a94f5584a71c34f86f33de'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:50.178747 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9d4710-bdfb-46ce-8949-ac6be582f24d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:50.180245 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9d4710-bdfb-46ce-8949-ac6be582f24d service cinder] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:50.190790 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 919/1836] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:58:50 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:58:50.205918 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-13d4bfb5-fe86-4223-9bc0-5e80742d8867 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '982b81f3b5a94f5584a71c34f86f33de'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:50.215663 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-13d4bfb5-fe86-4223-9bc0-5e80742d8867 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '982b81f3b5a94f5584a71c34f86f33de'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:50.269797 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 918/1837] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 14 17:58:49 2022] DELETE /identity/v3/users/982b81f3b5a94f5584a71c34f86f33de => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:58:50.934140 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9d4710-bdfb-46ce-8949-ac6be582f24d service cinder] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:50.950112 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9d4710-bdfb-46ce-8949-ac6be582f24d service cinder] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:51.030331 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770cb3fb-ec69-49a3-aa55-8872ea5e441a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:51.035128 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770cb3fb-ec69-49a3-aa55-8872ea5e441a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:51.035515 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770cb3fb-ec69-49a3-aa55-8872ea5e441a admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:51.038339 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770cb3fb-ec69-49a3-aa55-8872ea5e441a admin admin] PATH_INFO: `/v3/projects/d52364e0e5284912bdccd4430fd1e09a` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:51.040137 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770cb3fb-ec69-49a3-aa55-8872ea5e441a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d52364e0e5284912bdccd4430fd1e09a)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:51.042431 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770cb3fb-ec69-49a3-aa55-8872ea5e441a admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:51.064120 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d4bfb5-fe86-4223-9bc0-5e80742d8867 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:51.066314 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-13d4bfb5-fe86-4223-9bc0-5e80742d8867 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:51.090497 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d4bfb5-fe86-4223-9bc0-5e80742d8867 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:51.104997 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc35197-6939-42bb-9374-5f3613239c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:51.105954 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc35197-6939-42bb-9374-5f3613239c7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:51.106248 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc35197-6939-42bb-9374-5f3613239c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:51.106529 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc35197-6939-42bb-9374-5f3613239c7c admin admin] PATH_INFO: `/v3/users/34ed72772964438e8f35d1a8f468ad19` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:51.108131 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc35197-6939-42bb-9374-5f3613239c7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=34ed72772964438e8f35d1a8f468ad19)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:51.110489 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc35197-6939-42bb-9374-5f3613239c7c admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:51.215069 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-770cb3fb-ec69-49a3-aa55-8872ea5e441a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd52364e0e5284912bdccd4430fd1e09a', 'request_id': 'req-770cb3fb-ec69-49a3-aa55-8872ea5e441a'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:51.326266 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-770cb3fb-ec69-49a3-aa55-8872ea5e441a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd52364e0e5284912bdccd4430fd1e09a', 'request_id': 'req-770cb3fb-ec69-49a3-aa55-8872ea5e441a'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:51.334814 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-770cb3fb-ec69-49a3-aa55-8872ea5e441a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd52364e0e5284912bdccd4430fd1e09a', 'request_id': 'req-770cb3fb-ec69-49a3-aa55-8872ea5e441a'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:51.342119 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-8fc35197-6939-42bb-9374-5f3613239c7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34ed72772964438e8f35d1a8f468ad19'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:51.342864 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-8fc35197-6939-42bb-9374-5f3613239c7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34ed72772964438e8f35d1a8f468ad19'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:51.344332 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-8fc35197-6939-42bb-9374-5f3613239c7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34ed72772964438e8f35d1a8f468ad19'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:51.350698 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-770cb3fb-ec69-49a3-aa55-8872ea5e441a admin admin] The token cache is being invalidate because project d52364e0e5284912bdccd4430fd1e09a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87019) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 17:58:51.354677 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-770cb3fb-ec69-49a3-aa55-8872ea5e441a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:51.355284 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-770cb3fb-ec69-49a3-aa55-8872ea5e441a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:51.357048 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 920/1838] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 14 17:58:50 2022] DELETE /identity/v3/projects/d52364e0e5284912bdccd4430fd1e09a => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 17:58:51.361874 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33120d7-17ce-45eb-ab11-b359c9836ab3 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:51.362189 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33120d7-17ce-45eb-ab11-b359c9836ab3 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:51.362503 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33120d7-17ce-45eb-ab11-b359c9836ab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:51.383082 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-e33120d7-17ce-45eb-ab11-b359c9836ab3 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:58:51.384340 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-e33120d7-17ce-45eb-ab11-b359c9836ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:51.452023 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-8fc35197-6939-42bb-9374-5f3613239c7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34ed72772964438e8f35d1a8f468ad19'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:51.468472 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-8fc35197-6939-42bb-9374-5f3613239c7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34ed72772964438e8f35d1a8f468ad19'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:51.500939 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 919/1839] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 14 17:58:51 2022] DELETE /identity/v3/users/34ed72772964438e8f35d1a8f468ad19 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:58:51.587379 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 921/1840] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:58:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 17:58:51.595593 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edebaa3a-5d1b-4048-97f5-3bece4d15586 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:51.596207 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edebaa3a-5d1b-4048-97f5-3bece4d15586 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:51.596490 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edebaa3a-5d1b-4048-97f5-3bece4d15586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:51.618891 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-edebaa3a-5d1b-4048-97f5-3bece4d15586 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:58:51.620129 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-edebaa3a-5d1b-4048-97f5-3bece4d15586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:51.684455 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 920/1841] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:58:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:58:51.688819 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33120d7-17ce-45eb-ab11-b359c9836ab3 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:51.699569 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33120d7-17ce-45eb-ab11-b359c9836ab3 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:51.705609 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ed5d1d-fd23-48dc-9df9-ee3d4546a6e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:51.705782 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ed5d1d-fd23-48dc-9df9-ee3d4546a6e3 admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:51.706030 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ed5d1d-fd23-48dc-9df9-ee3d4546a6e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:51.706316 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ed5d1d-fd23-48dc-9df9-ee3d4546a6e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:51.707101 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ed5d1d-fd23-48dc-9df9-ee3d4546a6e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:58:51.707453 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ed5d1d-fd23-48dc-9df9-ee3d4546a6e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:51.709107 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ed5d1d-fd23-48dc-9df9-ee3d4546a6e3 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:51.724170 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 922/1842] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 14 17:58:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:58:51.728425 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edebaa3a-5d1b-4048-97f5-3bece4d15586 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:51.738451 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edebaa3a-5d1b-4048-97f5-3bece4d15586 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:51.743589 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26d9cd5-44ce-472f-a74a-7544b5490aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:51.744253 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26d9cd5-44ce-472f-a74a-7544b5490aa8 admin admin] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:51.744540 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26d9cd5-44ce-472f-a74a-7544b5490aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:51.744862 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26d9cd5-44ce-472f-a74a-7544b5490aa8 admin admin] PATH_INFO: `/v3/projects` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:51.745591 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26d9cd5-44ce-472f-a74a-7544b5490aa8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:51.747517 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26d9cd5-44ce-472f-a74a-7544b5490aa8 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:51.839430 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 921/1843] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 14 17:58:51 2022] POST /identity/v3/projects => generated 399 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:58:51.840484 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ed5d1d-fd23-48dc-9df9-ee3d4546a6e3 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:51.850998 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ed5d1d-fd23-48dc-9df9-ee3d4546a6e3 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:51.931921 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ed0e33-41be-41c3-9dd4-b3671ff30b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:51.932860 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ed0e33-41be-41c3-9dd4-b3671ff30b81 admin admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:51.933200 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ed0e33-41be-41c3-9dd4-b3671ff30b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:51.933489 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ed0e33-41be-41c3-9dd4-b3671ff30b81 admin admin] PATH_INFO: `/v3/users` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:51.934533 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ed0e33-41be-41c3-9dd4-b3671ff30b81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:51.937270 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ed0e33-41be-41c3-9dd4-b3671ff30b81 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:52.056077 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 923/1844] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 14 17:58:51 2022] POST /identity/v3/users => generated 300 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 17:58:52.058942 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26d9cd5-44ce-472f-a74a-7544b5490aa8 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:52.060473 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-e26d9cd5-44ce-472f-a74a-7544b5490aa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:52.060599 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ed0e33-41be-41c3-9dd4-b3671ff30b81 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:52.073112 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ed0e33-41be-41c3-9dd4-b3671ff30b81 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:52.075597 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26d9cd5-44ce-472f-a74a-7544b5490aa8 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:52.078238 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3a65cc-4c5d-4ca8-b36d-7fb4fc85ed77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:52.079039 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3a65cc-4c5d-4ca8-b36d-7fb4fc85ed77 admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:52.079350 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3a65cc-4c5d-4ca8-b36d-7fb4fc85ed77 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:52.079648 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3a65cc-4c5d-4ca8-b36d-7fb4fc85ed77 admin admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:52.080439 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3a65cc-4c5d-4ca8-b36d-7fb4fc85ed77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:52.082009 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3a65cc-4c5d-4ca8-b36d-7fb4fc85ed77 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:52.091869 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7310b14-7b45-4603-9e33-dfe202e2e8ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:52.095931 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 924/1845] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 17:58:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 17:58:52.098502 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7310b14-7b45-4603-9e33-dfe202e2e8ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:52.099140 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7310b14-7b45-4603-9e33-dfe202e2e8ef admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:52.099662 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7310b14-7b45-4603-9e33-dfe202e2e8ef admin admin] PATH_INFO: `/v3/projects/36a0c5fed0574ecea06addafa12a9e0e` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:52.101887 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7310b14-7b45-4603-9e33-dfe202e2e8ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=36a0c5fed0574ecea06addafa12a9e0e)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:52.104408 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7310b14-7b45-4603-9e33-dfe202e2e8ef admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:52.106365 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3a65cc-4c5d-4ca8-b36d-7fb4fc85ed77 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:52.123010 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3a65cc-4c5d-4ca8-b36d-7fb4fc85ed77 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:52.145936 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ba899e-9e50-4219-a3cc-cd1c181412db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:52.146662 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ba899e-9e50-4219-a3cc-cd1c181412db admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:52.147893 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ba899e-9e50-4219-a3cc-cd1c181412db admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:52.148328 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ba899e-9e50-4219-a3cc-cd1c181412db admin admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:52.149227 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ba899e-9e50-4219-a3cc-cd1c181412db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:52.151826 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ba899e-9e50-4219-a3cc-cd1c181412db admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:52.168008 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 925/1846] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 17:58:52 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 17:58:52.174004 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ba899e-9e50-4219-a3cc-cd1c181412db admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:52.186770 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ba899e-9e50-4219-a3cc-cd1c181412db admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:52.193656 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9649040e-8e0f-48ae-b621-578bf60abccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:52.195508 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9649040e-8e0f-48ae-b621-578bf60abccd admin admin] REQUEST_METHOD: `PUT` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:52.195796 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9649040e-8e0f-48ae-b621-578bf60abccd admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:52.196475 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9649040e-8e0f-48ae-b621-578bf60abccd admin admin] PATH_INFO: `/v3/projects/ea02efb0648e476baa08e438d3ab8e92/users/633a1149ed3c4deaa1937c9c4336c9ed/roles/9ee80134743f4c2b88525b04df2facba` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:52.213850 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9649040e-8e0f-48ae-b621-578bf60abccd admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea02efb0648e476baa08e438d3ab8e92, user_id=633a1149ed3c4deaa1937c9c4336c9ed, role_id=9ee80134743f4c2b88525b04df2facba)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:52.217135 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9649040e-8e0f-48ae-b621-578bf60abccd admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:52.367611 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 926/1847] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 17:58:52 2022] PUT /identity/v3/projects/ea02efb0648e476baa08e438d3ab8e92/users/633a1149ed3c4deaa1937c9c4336c9ed/roles/9ee80134743f4c2b88525b04df2facba => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:58:52.376838 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9c3003-0148-4f5d-8da1-29e1bfed0801 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:52.377131 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9c3003-0148-4f5d-8da1-29e1bfed0801 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:52.377557 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9c3003-0148-4f5d-8da1-29e1bfed0801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:52.387543 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-d7310b14-7b45-4603-9e33-dfe202e2e8ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36a0c5fed0574ecea06addafa12a9e0e', 'request_id': 'req-d7310b14-7b45-4603-9e33-dfe202e2e8ef'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:52.416604 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-8c9c3003-0148-4f5d-8da1-29e1bfed0801 None None] MFA Rules not processed for user `633a1149ed3c4deaa1937c9c4336c9ed`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:58:52.416803 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:58:52.418695 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-8c9c3003-0148-4f5d-8da1-29e1bfed0801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:52.497636 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-d7310b14-7b45-4603-9e33-dfe202e2e8ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36a0c5fed0574ecea06addafa12a9e0e', 'request_id': 'req-d7310b14-7b45-4603-9e33-dfe202e2e8ef'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:52.506744 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-d7310b14-7b45-4603-9e33-dfe202e2e8ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36a0c5fed0574ecea06addafa12a9e0e', 'request_id': 'req-d7310b14-7b45-4603-9e33-dfe202e2e8ef'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:52.525292 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 927/1848] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:58:52 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:58:52.525448 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-d7310b14-7b45-4603-9e33-dfe202e2e8ef admin admin] The token cache is being invalidate because project 36a0c5fed0574ecea06addafa12a9e0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 17:58:52.525448 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-d7310b14-7b45-4603-9e33-dfe202e2e8ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:52.526118 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-d7310b14-7b45-4603-9e33-dfe202e2e8ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:52.526619 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9c3003-0148-4f5d-8da1-29e1bfed0801 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:52.531656 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 922/1849] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 14 17:58:52 2022] DELETE /identity/v3/projects/36a0c5fed0574ecea06addafa12a9e0e => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:58:52.533812 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7310b14-7b45-4603-9e33-dfe202e2e8ef admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:52.538582 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-d7310b14-7b45-4603-9e33-dfe202e2e8ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:52.606569 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9c3003-0148-4f5d-8da1-29e1bfed0801 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:52.611345 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9975c2-9c41-41de-829c-a5df6f14b56b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:52.612022 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9975c2-9c41-41de-829c-a5df6f14b56b admin admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:52.612318 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9975c2-9c41-41de-829c-a5df6f14b56b admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:52.612601 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9975c2-9c41-41de-829c-a5df6f14b56b admin admin] PATH_INFO: `/v3/projects` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:52.613310 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9975c2-9c41-41de-829c-a5df6f14b56b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:52.615233 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9975c2-9c41-41de-829c-a5df6f14b56b admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:52.617181 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7310b14-7b45-4603-9e33-dfe202e2e8ef admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:52.624434 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b48570d-690e-4cc0-9166-4e90655ada55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:52.625520 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b48570d-690e-4cc0-9166-4e90655ada55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:52.625954 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b48570d-690e-4cc0-9166-4e90655ada55 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:52.626242 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b48570d-690e-4cc0-9166-4e90655ada55 admin admin] PATH_INFO: `/v3/users/a504d802f1624eb8be000fd95e7dd8ad` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:52.627679 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b48570d-690e-4cc0-9166-4e90655ada55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a504d802f1624eb8be000fd95e7dd8ad)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:52.629968 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b48570d-690e-4cc0-9166-4e90655ada55 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:52.829116 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 928/1850] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 14 17:58:52 2022] POST /identity/v3/projects => generated 399 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:58:52.833330 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9975c2-9c41-41de-829c-a5df6f14b56b admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:52.834914 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-aa9975c2-9c41-41de-829c-a5df6f14b56b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:52.910153 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9975c2-9c41-41de-829c-a5df6f14b56b admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:52.915319 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34cc05d-041e-41b2-a152-e98e904395be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:52.916155 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34cc05d-041e-41b2-a152-e98e904395be admin admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:52.916448 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34cc05d-041e-41b2-a152-e98e904395be admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:52.916734 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34cc05d-041e-41b2-a152-e98e904395be admin admin] PATH_INFO: `/v3/users` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:52.922205 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34cc05d-041e-41b2-a152-e98e904395be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:52.922205 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34cc05d-041e-41b2-a152-e98e904395be admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:52.925243 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-9b48570d-690e-4cc0-9166-4e90655ada55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a504d802f1624eb8be000fd95e7dd8ad'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:52.926552 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-9b48570d-690e-4cc0-9166-4e90655ada55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a504d802f1624eb8be000fd95e7dd8ad'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:52.927279 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-9b48570d-690e-4cc0-9166-4e90655ada55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a504d802f1624eb8be000fd95e7dd8ad'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:53.051421 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-9b48570d-690e-4cc0-9166-4e90655ada55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a504d802f1624eb8be000fd95e7dd8ad'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:53.065836 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 929/1851] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 14 17:58:52 2022] POST /identity/v3/users => generated 306 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 17:58:53.067081 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34cc05d-041e-41b2-a152-e98e904395be admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:53.069166 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-9b48570d-690e-4cc0-9166-4e90655ada55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a504d802f1624eb8be000fd95e7dd8ad'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:53.084669 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-d34cc05d-041e-41b2-a152-e98e904395be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:53.091741 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 923/1852] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 14 17:58:52 2022] DELETE /identity/v3/users/a504d802f1624eb8be000fd95e7dd8ad => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:58:53.126320 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34cc05d-041e-41b2-a152-e98e904395be admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:53.256566 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f968b99e-1e22-4f9f-88ec-b687104a07cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:53.257452 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f968b99e-1e22-4f9f-88ec-b687104a07cf admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:53.257749 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f968b99e-1e22-4f9f-88ec-b687104a07cf admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:53.258763 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f968b99e-1e22-4f9f-88ec-b687104a07cf admin admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:53.259572 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f968b99e-1e22-4f9f-88ec-b687104a07cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:53.262656 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f968b99e-1e22-4f9f-88ec-b687104a07cf admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:53.280038 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 930/1853] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 17:58:53 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 17:58:53.284706 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b48570d-690e-4cc0-9166-4e90655ada55 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:53.297361 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b48570d-690e-4cc0-9166-4e90655ada55 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:53.315511 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfd0744-eb69-46ee-9c40-4c657d748e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:53.316076 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfd0744-eb69-46ee-9c40-4c657d748e53 admin admin] REQUEST_METHOD: `PUT` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:53.316286 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfd0744-eb69-46ee-9c40-4c657d748e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:53.316864 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfd0744-eb69-46ee-9c40-4c657d748e53 admin admin] PATH_INFO: `/v3/projects/8e71c2bb344d4e84af7b896d048f81dc/users/a5bba0f9095548728ffb9a10fdd9b491/roles/1348580877d04014bfdec4d866b98a74` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:53.370467 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfd0744-eb69-46ee-9c40-4c657d748e53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e71c2bb344d4e84af7b896d048f81dc, user_id=a5bba0f9095548728ffb9a10fdd9b491, role_id=1348580877d04014bfdec4d866b98a74)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:53.376592 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfd0744-eb69-46ee-9c40-4c657d748e53 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:53.505125 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 924/1854] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 17:58:53 2022] PUT /identity/v3/projects/8e71c2bb344d4e84af7b896d048f81dc/users/a5bba0f9095548728ffb9a10fdd9b491/roles/1348580877d04014bfdec4d866b98a74 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:58:53.509393 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f968b99e-1e22-4f9f-88ec-b687104a07cf admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:53.520743 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f968b99e-1e22-4f9f-88ec-b687104a07cf admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:53.611864 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5ea2f9-591b-40d0-9543-8c62638837cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:53.613331 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5ea2f9-591b-40d0-9543-8c62638837cd admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:53.613331 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5ea2f9-591b-40d0-9543-8c62638837cd admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:53.613331 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5ea2f9-591b-40d0-9543-8c62638837cd admin admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:53.614070 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5ea2f9-591b-40d0-9543-8c62638837cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:53.615715 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5ea2f9-591b-40d0-9543-8c62638837cd admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:53.635220 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfd0744-eb69-46ee-9c40-4c657d748e53 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:53.639563 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-bdfd0744-eb69-46ee-9c40-4c657d748e53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:53.677316 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 931/1855] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 17:58:53 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 17:58:53.690105 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5ea2f9-591b-40d0-9543-8c62638837cd admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:53.724317 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfd0744-eb69-46ee-9c40-4c657d748e53 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:53.743151 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5ea2f9-591b-40d0-9543-8c62638837cd admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:53.744428 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e20624-f679-442e-b6b4-4f018f2e99dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:53.747820 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e20624-f679-442e-b6b4-4f018f2e99dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:53.748938 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e20624-f679-442e-b6b4-4f018f2e99dc admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:53.750038 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e20624-f679-442e-b6b4-4f018f2e99dc admin admin] PATH_INFO: `/v3/projects/2278350373f44922a3b4690b18f92dc7` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:53.754097 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e435592f-25ae-468d-8aed-c4449b4d6fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:53.754517 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e20624-f679-442e-b6b4-4f018f2e99dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=2278350373f44922a3b4690b18f92dc7)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:53.754999 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e435592f-25ae-468d-8aed-c4449b4d6fcc admin admin] REQUEST_METHOD: `PUT` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:53.755283 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e435592f-25ae-468d-8aed-c4449b4d6fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:53.755595 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e435592f-25ae-468d-8aed-c4449b4d6fcc admin admin] PATH_INFO: `/v3/projects/8e71c2bb344d4e84af7b896d048f81dc/users/a5bba0f9095548728ffb9a10fdd9b491/roles/1348580877d04014bfdec4d866b98a74` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:53.759566 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e20624-f679-442e-b6b4-4f018f2e99dc admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:53.760541 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e435592f-25ae-468d-8aed-c4449b4d6fcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e71c2bb344d4e84af7b896d048f81dc, user_id=a5bba0f9095548728ffb9a10fdd9b491, role_id=1348580877d04014bfdec4d866b98a74)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:53.763189 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e435592f-25ae-468d-8aed-c4449b4d6fcc admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:53.805532 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 932/1856] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 17:58:53 2022] PUT /identity/v3/projects/8e71c2bb344d4e84af7b896d048f81dc/users/a5bba0f9095548728ffb9a10fdd9b491/roles/1348580877d04014bfdec4d866b98a74 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:58:53.805532 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06751e66-ed1d-4880-bd19-fd6580d24806 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:53.805532 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06751e66-ed1d-4880-bd19-fd6580d24806 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:53.805532 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06751e66-ed1d-4880-bd19-fd6580d24806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:53.836110 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-06751e66-ed1d-4880-bd19-fd6580d24806 None None] MFA Rules not processed for user `a5bba0f9095548728ffb9a10fdd9b491`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:58:53.837483 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-06751e66-ed1d-4880-bd19-fd6580d24806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:53.942836 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 933/1857] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:58:53 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 17:58:53.954315 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06751e66-ed1d-4880-bd19-fd6580d24806 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:53.955732 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-06751e66-ed1d-4880-bd19-fd6580d24806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:54.001958 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-b1e20624-f679-442e-b6b4-4f018f2e99dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2278350373f44922a3b4690b18f92dc7', 'request_id': 'req-b1e20624-f679-442e-b6b4-4f018f2e99dc'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:54.014054 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06751e66-ed1d-4880-bd19-fd6580d24806 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:54.063024 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5817d3cf-30f5-49cb-b4b4-52c9cad2b8d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17945e7d72954b8787e0ba09a9903247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:54.063730 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5817d3cf-30f5-49cb-b4b4-52c9cad2b8d0 service cinder] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:54.064022 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5817d3cf-30f5-49cb-b4b4-52c9cad2b8d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:54.064362 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5817d3cf-30f5-49cb-b4b4-52c9cad2b8d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:54.086017 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-b1e20624-f679-442e-b6b4-4f018f2e99dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2278350373f44922a3b4690b18f92dc7', 'request_id': 'req-b1e20624-f679-442e-b6b4-4f018f2e99dc'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:54.092332 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-b1e20624-f679-442e-b6b4-4f018f2e99dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2278350373f44922a3b4690b18f92dc7', 'request_id': 'req-b1e20624-f679-442e-b6b4-4f018f2e99dc'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:54.106429 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-b1e20624-f679-442e-b6b4-4f018f2e99dc admin admin] The token cache is being invalidate because project 2278350373f44922a3b4690b18f92dc7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 17:58:54.107052 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-b1e20624-f679-442e-b6b4-4f018f2e99dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:54.107859 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-b1e20624-f679-442e-b6b4-4f018f2e99dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:54.109531 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 925/1858] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 14 17:58:53 2022] DELETE /identity/v3/projects/2278350373f44922a3b4690b18f92dc7 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:58:54.116426 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da61917d-5c33-4c94-a84e-6903579b26da None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:54.116730 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da61917d-5c33-4c94-a84e-6903579b26da None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:54.117635 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da61917d-5c33-4c94-a84e-6903579b26da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:54.139583 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-da61917d-5c33-4c94-a84e-6903579b26da None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:58:54.141594 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-da61917d-5c33-4c94-a84e-6903579b26da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:54.158149 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5817d3cf-30f5-49cb-b4b4-52c9cad2b8d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:54.159668 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5817d3cf-30f5-49cb-b4b4-52c9cad2b8d0 service cinder] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:54.170093 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 934/1859] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:58:53 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 17:58:54.217539 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 926/1860] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:58:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:58:54.230211 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fbfd73-ce27-4350-9e20-88b4ae6cf6e8 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:54.230499 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fbfd73-ce27-4350-9e20-88b4ae6cf6e8 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:54.230848 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fbfd73-ce27-4350-9e20-88b4ae6cf6e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:54.255085 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-46fbfd73-ce27-4350-9e20-88b4ae6cf6e8 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:58:54.256947 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-46fbfd73-ce27-4350-9e20-88b4ae6cf6e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:54.272335 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 935/1861] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:58:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:58:54.273473 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da61917d-5c33-4c94-a84e-6903579b26da None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:54.285001 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da61917d-5c33-4c94-a84e-6903579b26da None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:54.290896 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9807c08-7753-4848-9c4f-93645d6456bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:54.291725 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9807c08-7753-4848-9c4f-93645d6456bf admin admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:54.292214 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9807c08-7753-4848-9c4f-93645d6456bf admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:54.292571 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9807c08-7753-4848-9c4f-93645d6456bf admin admin] PATH_INFO: `/v3/domains` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:54.293467 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9807c08-7753-4848-9c4f-93645d6456bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:58:54.293844 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9807c08-7753-4848-9c4f-93645d6456bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:54.295558 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9807c08-7753-4848-9c4f-93645d6456bf admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:54.321121 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 927/1862] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 14 17:58:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:58:54.325565 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fbfd73-ce27-4350-9e20-88b4ae6cf6e8 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:54.337801 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fbfd73-ce27-4350-9e20-88b4ae6cf6e8 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:54.349117 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9785c4df-424f-44a8-86d6-e44c62508844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:54.349117 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9785c4df-424f-44a8-86d6-e44c62508844 admin admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:54.349117 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9785c4df-424f-44a8-86d6-e44c62508844 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:54.349117 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9785c4df-424f-44a8-86d6-e44c62508844 admin admin] PATH_INFO: `/v3/projects` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:54.350304 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9785c4df-424f-44a8-86d6-e44c62508844 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:54.350304 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9785c4df-424f-44a8-86d6-e44c62508844 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:54.435440 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 936/1863] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 14 17:58:54 2022] POST /identity/v3/projects => generated 387 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:58:54.440638 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9807c08-7753-4848-9c4f-93645d6456bf admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:54.451875 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9807c08-7753-4848-9c4f-93645d6456bf admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:54.454268 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9785c4df-424f-44a8-86d6-e44c62508844 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:54.456685 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-9785c4df-424f-44a8-86d6-e44c62508844 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:54.524648 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9785c4df-424f-44a8-86d6-e44c62508844 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:54.528354 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a213f13e-641d-4be0-9395-d9c83d6a7804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:54.528493 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f7f792-9e46-4467-a4f5-0edad825a50e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17945e7d72954b8787e0ba09a9903247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:54.529068 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f7f792-9e46-4467-a4f5-0edad825a50e service cinder] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:54.529327 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a213f13e-641d-4be0-9395-d9c83d6a7804 admin admin] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:54.529548 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f7f792-9e46-4467-a4f5-0edad825a50e service cinder] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:54.529629 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f7f792-9e46-4467-a4f5-0edad825a50e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:54.529697 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a213f13e-641d-4be0-9395-d9c83d6a7804 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:54.529895 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a213f13e-641d-4be0-9395-d9c83d6a7804 admin admin] PATH_INFO: `/v3/users` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:54.530799 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a213f13e-641d-4be0-9395-d9c83d6a7804 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:54.532166 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-47f7f792-9e46-4467-a4f5-0edad825a50e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:54.533223 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a213f13e-641d-4be0-9395-d9c83d6a7804 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:54.611174 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f7f792-9e46-4467-a4f5-0edad825a50e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:54.612860 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f7f792-9e46-4467-a4f5-0edad825a50e service cinder] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:54.623245 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 937/1864] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:58:54 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 17:58:54.667573 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 928/1865] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 14 17:58:54 2022] POST /identity/v3/users => generated 294 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 17:58:54.670536 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f7f792-9e46-4467-a4f5-0edad825a50e service cinder] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:54.682711 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f7f792-9e46-4467-a4f5-0edad825a50e service cinder] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:54.689799 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f83400-5856-414e-a8aa-51892f4e1b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:54.690694 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f83400-5856-414e-a8aa-51892f4e1b09 admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:54.691056 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f83400-5856-414e-a8aa-51892f4e1b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:54.691512 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f83400-5856-414e-a8aa-51892f4e1b09 admin admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:54.692430 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f83400-5856-414e-a8aa-51892f4e1b09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:54.694373 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f83400-5856-414e-a8aa-51892f4e1b09 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:54.727780 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 938/1866] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 17:58:54 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 17:58:54.735975 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a213f13e-641d-4be0-9395-d9c83d6a7804 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:54.754236 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a213f13e-641d-4be0-9395-d9c83d6a7804 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:54.762840 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b57d30-e09d-4aae-b2d9-5500f0e6a011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:54.764652 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b57d30-e09d-4aae-b2d9-5500f0e6a011 admin admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:54.765097 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b57d30-e09d-4aae-b2d9-5500f0e6a011 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:54.765905 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b57d30-e09d-4aae-b2d9-5500f0e6a011 admin admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:54.768317 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b57d30-e09d-4aae-b2d9-5500f0e6a011 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:54.771155 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b57d30-e09d-4aae-b2d9-5500f0e6a011 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:54.791096 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 929/1867] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 17:58:54 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 17:58:54.792486 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f83400-5856-414e-a8aa-51892f4e1b09 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:54.810448 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f83400-5856-414e-a8aa-51892f4e1b09 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:54.822354 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5f55c1-2f6b-45c7-914a-431f73b36430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:54.823262 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5f55c1-2f6b-45c7-914a-431f73b36430 admin admin] REQUEST_METHOD: `PUT` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:54.823573 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5f55c1-2f6b-45c7-914a-431f73b36430 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:54.823859 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5f55c1-2f6b-45c7-914a-431f73b36430 admin admin] PATH_INFO: `/v3/projects/f11e76080fb142a895ae56a097ebffb2/users/75cc5bf9cbee48e28b913efeb41024bf/roles/9ee80134743f4c2b88525b04df2facba` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:54.847893 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5f55c1-2f6b-45c7-914a-431f73b36430 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f11e76080fb142a895ae56a097ebffb2, user_id=75cc5bf9cbee48e28b913efeb41024bf, role_id=9ee80134743f4c2b88525b04df2facba)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:54.850269 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5f55c1-2f6b-45c7-914a-431f73b36430 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:54.978254 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 939/1868] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 17:58:54 2022] PUT /identity/v3/projects/f11e76080fb142a895ae56a097ebffb2/users/75cc5bf9cbee48e28b913efeb41024bf/roles/9ee80134743f4c2b88525b04df2facba => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 17:58:54.990286 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96481116-d705-485b-8fe2-26188cce2114 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:54.990582 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96481116-d705-485b-8fe2-26188cce2114 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:54.990866 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96481116-d705-485b-8fe2-26188cce2114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:55.018421 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-96481116-d705-485b-8fe2-26188cce2114 None None] MFA Rules not processed for user `75cc5bf9cbee48e28b913efeb41024bf`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:58:55.019741 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-96481116-d705-485b-8fe2-26188cce2114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:55.125650 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 930/1869] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:58:54 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:58:55.130423 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5f55c1-2f6b-45c7-914a-431f73b36430 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:55.238753 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:58:55.258975 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5f55c1-2f6b-45c7-914a-431f73b36430 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:55.294451 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a003e87b-2618-489f-88be-bfeb4b3efbd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:55.295165 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a003e87b-2618-489f-88be-bfeb4b3efbd1 admin admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:55.295493 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a003e87b-2618-489f-88be-bfeb4b3efbd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:55.295780 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a003e87b-2618-489f-88be-bfeb4b3efbd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:55.298817 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a003e87b-2618-489f-88be-bfeb4b3efbd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:55.300867 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a003e87b-2618-489f-88be-bfeb4b3efbd1 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:55.458612 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 940/1870] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 14 17:58:55 2022] POST /identity/v3/projects => generated 385 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:58:55.462642 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96481116-d705-485b-8fe2-26188cce2114 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:55.473843 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96481116-d705-485b-8fe2-26188cce2114 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:55.555922 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360e9d87-e624-4c01-98c9-88867aa88a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:55.556596 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360e9d87-e624-4c01-98c9-88867aa88a45 admin admin] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:55.556881 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360e9d87-e624-4c01-98c9-88867aa88a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:55.557160 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360e9d87-e624-4c01-98c9-88867aa88a45 admin admin] PATH_INFO: `/v3/users` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:55.557859 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360e9d87-e624-4c01-98c9-88867aa88a45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:55.559997 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360e9d87-e624-4c01-98c9-88867aa88a45 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:55.712336 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 931/1871] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 14 17:58:55 2022] POST /identity/v3/users => generated 299 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:58:55.713985 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a003e87b-2618-489f-88be-bfeb4b3efbd1 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:55.725278 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a003e87b-2618-489f-88be-bfeb4b3efbd1 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:55.729934 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48d383f-52c0-4e48-b1ad-9e436b632b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:55.730600 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48d383f-52c0-4e48-b1ad-9e436b632b79 admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:55.730891 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48d383f-52c0-4e48-b1ad-9e436b632b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:55.731170 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48d383f-52c0-4e48-b1ad-9e436b632b79 admin admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:55.731971 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48d383f-52c0-4e48-b1ad-9e436b632b79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:55.733565 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48d383f-52c0-4e48-b1ad-9e436b632b79 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:55.748380 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 941/1872] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 17:58:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 17:58:55.750355 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360e9d87-e624-4c01-98c9-88867aa88a45 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:55.761557 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360e9d87-e624-4c01-98c9-88867aa88a45 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:55.767326 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a3d8e7-6af8-41fa-8808-273280a7056c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:55.768372 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a3d8e7-6af8-41fa-8808-273280a7056c admin admin] REQUEST_METHOD: `PUT` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:55.768691 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a3d8e7-6af8-41fa-8808-273280a7056c admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:55.768973 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a3d8e7-6af8-41fa-8808-273280a7056c admin admin] PATH_INFO: `/v3/projects/61e3d78894c6440a8ebf11789de5bdbe/users/e580279b4bd94390a8cb33865e627c1d/roles/1348580877d04014bfdec4d866b98a74` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:55.785331 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a3d8e7-6af8-41fa-8808-273280a7056c admin admin] RBAC: Authorizing `identity:create_grant(project_id=61e3d78894c6440a8ebf11789de5bdbe, user_id=e580279b4bd94390a8cb33865e627c1d, role_id=1348580877d04014bfdec4d866b98a74)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:55.788032 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a3d8e7-6af8-41fa-8808-273280a7056c admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:55.915167 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 932/1873] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 17:58:55 2022] PUT /identity/v3/projects/61e3d78894c6440a8ebf11789de5bdbe/users/e580279b4bd94390a8cb33865e627c1d/roles/1348580877d04014bfdec4d866b98a74 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:58:55.919428 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48d383f-52c0-4e48-b1ad-9e436b632b79 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:55.930427 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48d383f-52c0-4e48-b1ad-9e436b632b79 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:56.031751 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fa1610-7e10-4a7c-af62-a2ccb7883b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:56.032577 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fa1610-7e10-4a7c-af62-a2ccb7883b81 admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:56.032978 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fa1610-7e10-4a7c-af62-a2ccb7883b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:56.033333 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fa1610-7e10-4a7c-af62-a2ccb7883b81 admin admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:56.034825 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fa1610-7e10-4a7c-af62-a2ccb7883b81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:56.036794 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fa1610-7e10-4a7c-af62-a2ccb7883b81 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:56.053935 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 942/1874] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 17:58:55 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 17:58:56.056229 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a3d8e7-6af8-41fa-8808-273280a7056c admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:56.074396 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a3d8e7-6af8-41fa-8808-273280a7056c admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:56.079833 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8c81b7-ed80-425d-8032-99a081250591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:56.080754 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8c81b7-ed80-425d-8032-99a081250591 admin admin] REQUEST_METHOD: `PUT` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:56.081039 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8c81b7-ed80-425d-8032-99a081250591 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:56.081321 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8c81b7-ed80-425d-8032-99a081250591 admin admin] PATH_INFO: `/v3/projects/61e3d78894c6440a8ebf11789de5bdbe/users/e580279b4bd94390a8cb33865e627c1d/roles/1348580877d04014bfdec4d866b98a74` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:56.083481 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8c81b7-ed80-425d-8032-99a081250591 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61e3d78894c6440a8ebf11789de5bdbe, user_id=e580279b4bd94390a8cb33865e627c1d, role_id=1348580877d04014bfdec4d866b98a74)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:56.086682 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8c81b7-ed80-425d-8032-99a081250591 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:56.098609 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 933/1875] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 17:58:56 2022] PUT /identity/v3/projects/61e3d78894c6440a8ebf11789de5bdbe/users/e580279b4bd94390a8cb33865e627c1d/roles/1348580877d04014bfdec4d866b98a74 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:58:56.109897 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c2e619-3249-4e31-97c5-69de4992d076 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:56.110272 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c2e619-3249-4e31-97c5-69de4992d076 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:56.110512 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c2e619-3249-4e31-97c5-69de4992d076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:56.144032 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-12c2e619-3249-4e31-97c5-69de4992d076 None None] MFA Rules not processed for user `e580279b4bd94390a8cb33865e627c1d`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:58:56.145292 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-12c2e619-3249-4e31-97c5-69de4992d076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:56.223441 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 943/1876] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:58:56 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:58:56.236063 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8c81b7-ed80-425d-8032-99a081250591 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:56.297373 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8c81b7-ed80-425d-8032-99a081250591 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:56.301237 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ceaede-16fb-416a-9e07-a5f4f74de4c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17945e7d72954b8787e0ba09a9903247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:56.305068 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ceaede-16fb-416a-9e07-a5f4f74de4c3 service cinder] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:56.305068 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ceaede-16fb-416a-9e07-a5f4f74de4c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:56.305068 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ceaede-16fb-416a-9e07-a5f4f74de4c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:56.314274 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ceaede-16fb-416a-9e07-a5f4f74de4c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:56.315867 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ceaede-16fb-416a-9e07-a5f4f74de4c3 service cinder] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:56.326152 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 934/1877] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:58:56 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 17:58:56.365962 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c2e619-3249-4e31-97c5-69de4992d076 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:56.371510 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:58:56.444003 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ceaede-16fb-416a-9e07-a5f4f74de4c3 service cinder] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:56.455397 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ceaede-16fb-416a-9e07-a5f4f74de4c3 service cinder] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:56.461813 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2431af36-6170-412e-a194-b0f269debecd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17945e7d72954b8787e0ba09a9903247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:56.462505 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2431af36-6170-412e-a194-b0f269debecd service cinder] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:56.462827 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2431af36-6170-412e-a194-b0f269debecd service cinder] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:56.463094 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2431af36-6170-412e-a194-b0f269debecd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:56.465374 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-2431af36-6170-412e-a194-b0f269debecd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:56.472285 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c2e619-3249-4e31-97c5-69de4992d076 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:56.477334 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d19a1b0-2af9-43b5-8666-caa91c031b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:56.478238 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d19a1b0-2af9-43b5-8666-caa91c031b26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:56.480130 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d19a1b0-2af9-43b5-8666-caa91c031b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:56.480130 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d19a1b0-2af9-43b5-8666-caa91c031b26 admin admin] PATH_INFO: `/v3/users/75cc5bf9cbee48e28b913efeb41024bf` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:56.481006 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d19a1b0-2af9-43b5-8666-caa91c031b26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75cc5bf9cbee48e28b913efeb41024bf)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:56.486995 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d19a1b0-2af9-43b5-8666-caa91c031b26 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:56.541650 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2431af36-6170-412e-a194-b0f269debecd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:56.543006 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2431af36-6170-412e-a194-b0f269debecd service cinder] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:56.553492 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 935/1878] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:58:56 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:58:56.846061 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-5d19a1b0-2af9-43b5-8666-caa91c031b26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75cc5bf9cbee48e28b913efeb41024bf'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:56.846979 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-5d19a1b0-2af9-43b5-8666-caa91c031b26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75cc5bf9cbee48e28b913efeb41024bf'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:56.847691 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-5d19a1b0-2af9-43b5-8666-caa91c031b26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75cc5bf9cbee48e28b913efeb41024bf'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:56.955257 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-5d19a1b0-2af9-43b5-8666-caa91c031b26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75cc5bf9cbee48e28b913efeb41024bf'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:56.963535 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-5d19a1b0-2af9-43b5-8666-caa91c031b26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75cc5bf9cbee48e28b913efeb41024bf'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:56.984331 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 944/1879] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 14 17:58:56 2022] DELETE /identity/v3/users/75cc5bf9cbee48e28b913efeb41024bf => generated 0 bytes in 621 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:58:56.989159 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c650b43-decd-4f58-b363-d09e465d69a3 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:56.989464 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c650b43-decd-4f58-b363-d09e465d69a3 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:56.989753 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c650b43-decd-4f58-b363-d09e465d69a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:57.013012 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-5c650b43-decd-4f58-b363-d09e465d69a3 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:58:57.013012 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-5c650b43-decd-4f58-b363-d09e465d69a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:57.083103 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 936/1880] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:58:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:58:57.091680 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d19a1b0-2af9-43b5-8666-caa91c031b26 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:57.093333 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-5d19a1b0-2af9-43b5-8666-caa91c031b26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:57.176112 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d19a1b0-2af9-43b5-8666-caa91c031b26 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:57.180761 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d252a8-5aed-4b91-a7f4-b115f6de1321 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5652329c71cd431fb579d69cef933b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:57.181701 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d252a8-5aed-4b91-a7f4-b115f6de1321 service neutron] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:57.181993 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d252a8-5aed-4b91-a7f4-b115f6de1321 service neutron] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:57.182284 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d252a8-5aed-4b91-a7f4-b115f6de1321 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:57.194731 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d252a8-5aed-4b91-a7f4-b115f6de1321 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:57.196381 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d252a8-5aed-4b91-a7f4-b115f6de1321 service neutron] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:57.209709 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 945/1881] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:58:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 17:58:58.395363 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c650b43-decd-4f58-b363-d09e465d69a3 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:58.396871 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-5c650b43-decd-4f58-b363-d09e465d69a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:58.409859 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c650b43-decd-4f58-b363-d09e465d69a3 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:58.415395 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d78141-6d4a-499a-a156-cbcd5c2fa7f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:58.416485 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d78141-6d4a-499a-a156-cbcd5c2fa7f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:58.416928 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d78141-6d4a-499a-a156-cbcd5c2fa7f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:58.417363 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d78141-6d4a-499a-a156-cbcd5c2fa7f6 admin admin] PATH_INFO: `/v3/projects/f11e76080fb142a895ae56a097ebffb2` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:58.418768 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d78141-6d4a-499a-a156-cbcd5c2fa7f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f11e76080fb142a895ae56a097ebffb2)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:58.421039 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d78141-6d4a-499a-a156-cbcd5c2fa7f6 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:58.600918 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-f1d78141-6d4a-499a-a156-cbcd5c2fa7f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f11e76080fb142a895ae56a097ebffb2', 'request_id': 'req-f1d78141-6d4a-499a-a156-cbcd5c2fa7f6'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:58.691217 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-f1d78141-6d4a-499a-a156-cbcd5c2fa7f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f11e76080fb142a895ae56a097ebffb2', 'request_id': 'req-f1d78141-6d4a-499a-a156-cbcd5c2fa7f6'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:58.701665 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-f1d78141-6d4a-499a-a156-cbcd5c2fa7f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f11e76080fb142a895ae56a097ebffb2', 'request_id': 'req-f1d78141-6d4a-499a-a156-cbcd5c2fa7f6'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:58.729870 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-f1d78141-6d4a-499a-a156-cbcd5c2fa7f6 admin admin] The token cache is being invalidate because project f11e76080fb142a895ae56a097ebffb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 17:58:58.730438 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-f1d78141-6d4a-499a-a156-cbcd5c2fa7f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:58.731261 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-f1d78141-6d4a-499a-a156-cbcd5c2fa7f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:58.733394 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 937/1882] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 14 17:58:58 2022] DELETE /identity/v3/projects/f11e76080fb142a895ae56a097ebffb2 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:58:58.738235 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d252a8-5aed-4b91-a7f4-b115f6de1321 service neutron] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:58.751841 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d252a8-5aed-4b91-a7f4-b115f6de1321 service neutron] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:58.862566 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4355d0a7-61c9-49ca-834e-7a381585a1f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:58.863506 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4355d0a7-61c9-49ca-834e-7a381585a1f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:58.863796 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4355d0a7-61c9-49ca-834e-7a381585a1f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:58.864078 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4355d0a7-61c9-49ca-834e-7a381585a1f2 admin admin] PATH_INFO: `/v3/users/e580279b4bd94390a8cb33865e627c1d` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:58.865664 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4355d0a7-61c9-49ca-834e-7a381585a1f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e580279b4bd94390a8cb33865e627c1d)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:58.868161 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4355d0a7-61c9-49ca-834e-7a381585a1f2 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:58.943620 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:58:59.086456 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-4355d0a7-61c9-49ca-834e-7a381585a1f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e580279b4bd94390a8cb33865e627c1d'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:59.087198 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-4355d0a7-61c9-49ca-834e-7a381585a1f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e580279b4bd94390a8cb33865e627c1d'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:59.088028 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-4355d0a7-61c9-49ca-834e-7a381585a1f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e580279b4bd94390a8cb33865e627c1d'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:59.144045 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:58:59.200383 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-4355d0a7-61c9-49ca-834e-7a381585a1f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e580279b4bd94390a8cb33865e627c1d'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:59.214190 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-4355d0a7-61c9-49ca-834e-7a381585a1f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e580279b4bd94390a8cb33865e627c1d'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:58:59.238560 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 946/1883] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 14 17:58:58 2022] DELETE /identity/v3/users/e580279b4bd94390a8cb33865e627c1d => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:58:59.820591 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d78141-6d4a-499a-a156-cbcd5c2fa7f6 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:59.823450 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-f1d78141-6d4a-499a-a156-cbcd5c2fa7f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:59.845230 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d78141-6d4a-499a-a156-cbcd5c2fa7f6 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:59.948198 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89caf9db-c47f-43d1-a4b7-1f16932343dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:59.960562 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89caf9db-c47f-43d1-a4b7-1f16932343dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:59.961083 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89caf9db-c47f-43d1-a4b7-1f16932343dd admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:59.961518 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89caf9db-c47f-43d1-a4b7-1f16932343dd admin admin] PATH_INFO: `/v3/projects/61e3d78894c6440a8ebf11789de5bdbe` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:59.963713 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89caf9db-c47f-43d1-a4b7-1f16932343dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=61e3d78894c6440a8ebf11789de5bdbe)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:59.966724 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89caf9db-c47f-43d1-a4b7-1f16932343dd admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:00.169745 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-89caf9db-c47f-43d1-a4b7-1f16932343dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61e3d78894c6440a8ebf11789de5bdbe', 'request_id': 'req-89caf9db-c47f-43d1-a4b7-1f16932343dd'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:00.263396 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-89caf9db-c47f-43d1-a4b7-1f16932343dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61e3d78894c6440a8ebf11789de5bdbe', 'request_id': 'req-89caf9db-c47f-43d1-a4b7-1f16932343dd'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:00.278597 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-89caf9db-c47f-43d1-a4b7-1f16932343dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61e3d78894c6440a8ebf11789de5bdbe', 'request_id': 'req-89caf9db-c47f-43d1-a4b7-1f16932343dd'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:00.295716 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-89caf9db-c47f-43d1-a4b7-1f16932343dd admin admin] The token cache is being invalidate because project 61e3d78894c6440a8ebf11789de5bdbe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 17:59:00.295716 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-89caf9db-c47f-43d1-a4b7-1f16932343dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:00.312089 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-89caf9db-c47f-43d1-a4b7-1f16932343dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:00.316129 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 938/1884] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 14 17:58:59 2022] DELETE /identity/v3/projects/61e3d78894c6440a8ebf11789de5bdbe => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:59:00.320914 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebf7296-3683-45a6-a68b-dcb4d21d72b7 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:00.321403 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebf7296-3683-45a6-a68b-dcb4d21d72b7 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:00.321703 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebf7296-3683-45a6-a68b-dcb4d21d72b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:00.343406 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-eebf7296-3683-45a6-a68b-dcb4d21d72b7 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:59:00.345231 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-eebf7296-3683-45a6-a68b-dcb4d21d72b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:00.419726 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 947/1885] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:59:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:59:00.427950 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7ef354-b0cd-44e9-870a-870f014dca3f None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:00.428314 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7ef354-b0cd-44e9-870a-870f014dca3f None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:00.428694 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7ef354-b0cd-44e9-870a-870f014dca3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:00.450816 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-6b7ef354-b0cd-44e9-870a-870f014dca3f None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:59:00.452473 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-6b7ef354-b0cd-44e9-870a-870f014dca3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:00.461972 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 939/1886] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:59:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 17:59:00.466997 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebf7296-3683-45a6-a68b-dcb4d21d72b7 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:00.478571 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebf7296-3683-45a6-a68b-dcb4d21d72b7 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:00.483548 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70cbbc1-210e-4618-bad6-ee50cbd0f130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:00.486081 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70cbbc1-210e-4618-bad6-ee50cbd0f130 admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:00.486370 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70cbbc1-210e-4618-bad6-ee50cbd0f130 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:00.486658 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70cbbc1-210e-4618-bad6-ee50cbd0f130 admin admin] PATH_INFO: `/v3/domains` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:00.487438 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70cbbc1-210e-4618-bad6-ee50cbd0f130 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:59:00.487754 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70cbbc1-210e-4618-bad6-ee50cbd0f130 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:00.489424 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70cbbc1-210e-4618-bad6-ee50cbd0f130 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:00.506396 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 948/1887] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 14 17:59:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:59:00.507600 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7ef354-b0cd-44e9-870a-870f014dca3f None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:00.519428 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7ef354-b0cd-44e9-870a-870f014dca3f None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:00.525275 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b37bb8-739d-48df-ab29-831c08d13285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:00.525965 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b37bb8-739d-48df-ab29-831c08d13285 admin admin] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:00.526349 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b37bb8-739d-48df-ab29-831c08d13285 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:00.526640 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b37bb8-739d-48df-ab29-831c08d13285 admin admin] PATH_INFO: `/v3/projects` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:00.527455 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b37bb8-739d-48df-ab29-831c08d13285 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:00.529649 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b37bb8-739d-48df-ab29-831c08d13285 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:00.634809 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 940/1888] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 14 17:59:00 2022] POST /identity/v3/projects => generated 383 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:59:00.638836 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70cbbc1-210e-4618-bad6-ee50cbd0f130 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:00.655271 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70cbbc1-210e-4618-bad6-ee50cbd0f130 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:00.726946 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac63eb9-e3cc-45ea-89c2-68a42963a5fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:00.727593 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac63eb9-e3cc-45ea-89c2-68a42963a5fb admin admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:00.727888 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac63eb9-e3cc-45ea-89c2-68a42963a5fb admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:00.728177 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac63eb9-e3cc-45ea-89c2-68a42963a5fb admin admin] PATH_INFO: `/v3/users` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:00.728885 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac63eb9-e3cc-45ea-89c2-68a42963a5fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:00.730812 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac63eb9-e3cc-45ea-89c2-68a42963a5fb admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:00.819279 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 949/1889] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 14 17:59:00 2022] POST /identity/v3/users => generated 292 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:59:00.823443 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b37bb8-739d-48df-ab29-831c08d13285 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:00.834451 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b37bb8-739d-48df-ab29-831c08d13285 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:00.839118 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1922be05-c601-434d-8d07-5096b1ad2f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:00.839994 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1922be05-c601-434d-8d07-5096b1ad2f9f admin admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:00.840436 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1922be05-c601-434d-8d07-5096b1ad2f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:00.840714 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1922be05-c601-434d-8d07-5096b1ad2f9f admin admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:00.841444 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1922be05-c601-434d-8d07-5096b1ad2f9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:00.843036 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1922be05-c601-434d-8d07-5096b1ad2f9f admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:00.854387 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 941/1890] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 17:59:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 17:59:00.858427 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac63eb9-e3cc-45ea-89c2-68a42963a5fb admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:00.870718 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac63eb9-e3cc-45ea-89c2-68a42963a5fb admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:00.876736 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d360260e-80d7-4271-a047-658e1ce2910d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:00.877500 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d360260e-80d7-4271-a047-658e1ce2910d admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:00.877859 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d360260e-80d7-4271-a047-658e1ce2910d admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:00.878213 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d360260e-80d7-4271-a047-658e1ce2910d admin admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:00.879026 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d360260e-80d7-4271-a047-658e1ce2910d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:00.891205 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d360260e-80d7-4271-a047-658e1ce2910d admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:00.913306 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 950/1891] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 17:59:00 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 17:59:00.917726 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1922be05-c601-434d-8d07-5096b1ad2f9f admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:00.929110 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1922be05-c601-434d-8d07-5096b1ad2f9f admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:00.934285 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43a35de-c86e-4cf1-bb0d-2f12d14916fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:00.935264 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43a35de-c86e-4cf1-bb0d-2f12d14916fd admin admin] REQUEST_METHOD: `PUT` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:00.935590 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43a35de-c86e-4cf1-bb0d-2f12d14916fd admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:00.935878 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43a35de-c86e-4cf1-bb0d-2f12d14916fd admin admin] PATH_INFO: `/v3/projects/c8ce24beabe442b3be3e6b3ebedcc653/users/2c843d97eafb49339504416d488ae7ef/roles/9ee80134743f4c2b88525b04df2facba` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:00.955806 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43a35de-c86e-4cf1-bb0d-2f12d14916fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8ce24beabe442b3be3e6b3ebedcc653, user_id=2c843d97eafb49339504416d488ae7ef, role_id=9ee80134743f4c2b88525b04df2facba)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:00.960224 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43a35de-c86e-4cf1-bb0d-2f12d14916fd admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:01.055348 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 942/1892] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 17:59:00 2022] PUT /identity/v3/projects/c8ce24beabe442b3be3e6b3ebedcc653/users/2c843d97eafb49339504416d488ae7ef/roles/9ee80134743f4c2b88525b04df2facba => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:59:01.070639 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0366eafd-93f5-4e8b-a4c9-edfdb9a36970 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:01.070957 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0366eafd-93f5-4e8b-a4c9-edfdb9a36970 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:01.071216 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0366eafd-93f5-4e8b-a4c9-edfdb9a36970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:01.101394 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-0366eafd-93f5-4e8b-a4c9-edfdb9a36970 None None] MFA Rules not processed for user `2c843d97eafb49339504416d488ae7ef`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:59:01.102616 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-0366eafd-93f5-4e8b-a4c9-edfdb9a36970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:01.169731 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 951/1893] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:59:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:59:01.174868 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43a35de-c86e-4cf1-bb0d-2f12d14916fd admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:01.278263 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43a35de-c86e-4cf1-bb0d-2f12d14916fd admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:01.283868 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a33607e-218e-4fc7-a1e5-073b47ef30c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:01.284616 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a33607e-218e-4fc7-a1e5-073b47ef30c4 admin admin] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:01.284913 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a33607e-218e-4fc7-a1e5-073b47ef30c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:01.285201 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a33607e-218e-4fc7-a1e5-073b47ef30c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:01.285903 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a33607e-218e-4fc7-a1e5-073b47ef30c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:01.287858 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a33607e-218e-4fc7-a1e5-073b47ef30c4 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:01.411228 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0366eafd-93f5-4e8b-a4c9-edfdb9a36970 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:01.412646 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-0366eafd-93f5-4e8b-a4c9-edfdb9a36970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:01.428277 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0366eafd-93f5-4e8b-a4c9-edfdb9a36970 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:01.433064 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16489597-3f93-48ea-98f2-d73f4ba31566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:01.434018 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16489597-3f93-48ea-98f2-d73f4ba31566 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:01.434378 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16489597-3f93-48ea-98f2-d73f4ba31566 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:01.434729 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16489597-3f93-48ea-98f2-d73f4ba31566 admin admin] PATH_INFO: `/v3/users/633a1149ed3c4deaa1937c9c4336c9ed` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:01.436005 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16489597-3f93-48ea-98f2-d73f4ba31566 admin admin] RBAC: Authorizing `identity:delete_user(user_id=633a1149ed3c4deaa1937c9c4336c9ed)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:01.438975 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16489597-3f93-48ea-98f2-d73f4ba31566 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:01.453132 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 943/1894] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 14 17:59:01 2022] POST /identity/v3/projects => generated 381 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:59:01.458967 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a33607e-218e-4fc7-a1e5-073b47ef30c4 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:01.496725 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:59:01.545214 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a33607e-218e-4fc7-a1e5-073b47ef30c4 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:01.545868 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5d62f3-d5dc-4aef-9dce-16ddf280e7d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:01.546736 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d62f3-d5dc-4aef-9dce-16ddf280e7d7 admin admin] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:01.547586 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d62f3-d5dc-4aef-9dce-16ddf280e7d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:01.547868 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d62f3-d5dc-4aef-9dce-16ddf280e7d7 admin admin] PATH_INFO: `/v3/users` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:01.548755 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5d62f3-d5dc-4aef-9dce-16ddf280e7d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:01.550711 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5d62f3-d5dc-4aef-9dce-16ddf280e7d7 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:01.686211 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 944/1895] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 14 17:59:01 2022] POST /identity/v3/users => generated 297 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:59:01.690328 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5d62f3-d5dc-4aef-9dce-16ddf280e7d7 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:01.700931 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5d62f3-d5dc-4aef-9dce-16ddf280e7d7 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:01.705735 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:59:01.709384 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e28c599-b7bd-4517-9f55-0519750a4bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:01.710029 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e28c599-b7bd-4517-9f55-0519750a4bc4 admin admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:01.710322 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e28c599-b7bd-4517-9f55-0519750a4bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:01.710608 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e28c599-b7bd-4517-9f55-0519750a4bc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:01.711381 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e28c599-b7bd-4517-9f55-0519750a4bc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:01.714275 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e28c599-b7bd-4517-9f55-0519750a4bc4 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:01.728352 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-16489597-3f93-48ea-98f2-d73f4ba31566 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '633a1149ed3c4deaa1937c9c4336c9ed'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:01.729137 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-16489597-3f93-48ea-98f2-d73f4ba31566 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '633a1149ed3c4deaa1937c9c4336c9ed'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:01.729820 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-16489597-3f93-48ea-98f2-d73f4ba31566 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '633a1149ed3c4deaa1937c9c4336c9ed'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:01.733223 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 945/1896] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 17:59:01 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 14 17:59:01.740116 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e28c599-b7bd-4517-9f55-0519750a4bc4 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:01.741945 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-5e28c599-b7bd-4517-9f55-0519750a4bc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:01.761317 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e28c599-b7bd-4517-9f55-0519750a4bc4 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:01.767612 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94619155-52f5-42cb-9306-56efa043dff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:01.768606 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94619155-52f5-42cb-9306-56efa043dff4 admin admin] REQUEST_METHOD: `PUT` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:01.768972 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94619155-52f5-42cb-9306-56efa043dff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:01.769514 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94619155-52f5-42cb-9306-56efa043dff4 admin admin] PATH_INFO: `/v3/projects/143663158f3f4182b1420dd0bac431af/users/6626484997e74419a0c6dda2cfda6436/roles/1348580877d04014bfdec4d866b98a74` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:01.789634 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94619155-52f5-42cb-9306-56efa043dff4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=143663158f3f4182b1420dd0bac431af, user_id=6626484997e74419a0c6dda2cfda6436, role_id=1348580877d04014bfdec4d866b98a74)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:01.792476 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94619155-52f5-42cb-9306-56efa043dff4 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:01.804292 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-16489597-3f93-48ea-98f2-d73f4ba31566 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '633a1149ed3c4deaa1937c9c4336c9ed'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:01.814481 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-16489597-3f93-48ea-98f2-d73f4ba31566 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '633a1149ed3c4deaa1937c9c4336c9ed'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:01.837253 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 952/1897] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 14 17:59:01 2022] DELETE /identity/v3/users/633a1149ed3c4deaa1937c9c4336c9ed => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:59:01.843174 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a0b2ec-e256-4f2b-9a15-f5923e1f954f None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:01.843174 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a0b2ec-e256-4f2b-9a15-f5923e1f954f None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:01.843174 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a0b2ec-e256-4f2b-9a15-f5923e1f954f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:01.859291 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-31a0b2ec-e256-4f2b-9a15-f5923e1f954f None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:59:01.860751 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-31a0b2ec-e256-4f2b-9a15-f5923e1f954f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:01.910505 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 946/1898] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 17:59:01 2022] PUT /identity/v3/projects/143663158f3f4182b1420dd0bac431af/users/6626484997e74419a0c6dda2cfda6436/roles/1348580877d04014bfdec4d866b98a74 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 17:59:01.919819 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94619155-52f5-42cb-9306-56efa043dff4 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:01.951971 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 953/1899] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:59:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:59:01.962375 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a0b2ec-e256-4f2b-9a15-f5923e1f954f None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:01.963730 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-31a0b2ec-e256-4f2b-9a15-f5923e1f954f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:02.025070 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94619155-52f5-42cb-9306-56efa043dff4 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:02.038958 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ce76c7-d03e-42c1-9e13-2b0288b9c76c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:02.039851 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ce76c7-d03e-42c1-9e13-2b0288b9c76c admin admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:02.040307 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ce76c7-d03e-42c1-9e13-2b0288b9c76c admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:02.040702 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ce76c7-d03e-42c1-9e13-2b0288b9c76c admin admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:02.041579 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ce76c7-d03e-42c1-9e13-2b0288b9c76c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:02.043721 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ce76c7-d03e-42c1-9e13-2b0288b9c76c admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:02.045882 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a0b2ec-e256-4f2b-9a15-f5923e1f954f None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:02.066985 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 947/1900] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 17:59:01 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 14 17:59:02.069783 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ce76c7-d03e-42c1-9e13-2b0288b9c76c admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:02.087905 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ce76c7-d03e-42c1-9e13-2b0288b9c76c admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:02.100803 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608dc05c-f60e-43d7-99fa-24c9d0cdb870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:02.100803 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608dc05c-f60e-43d7-99fa-24c9d0cdb870 admin admin] REQUEST_METHOD: `PUT` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:02.100803 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608dc05c-f60e-43d7-99fa-24c9d0cdb870 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:02.100803 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608dc05c-f60e-43d7-99fa-24c9d0cdb870 admin admin] PATH_INFO: `/v3/projects/143663158f3f4182b1420dd0bac431af/users/6626484997e74419a0c6dda2cfda6436/roles/1348580877d04014bfdec4d866b98a74` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:02.101604 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608dc05c-f60e-43d7-99fa-24c9d0cdb870 admin admin] RBAC: Authorizing `identity:create_grant(project_id=143663158f3f4182b1420dd0bac431af, user_id=6626484997e74419a0c6dda2cfda6436, role_id=1348580877d04014bfdec4d866b98a74)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:02.105488 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608dc05c-f60e-43d7-99fa-24c9d0cdb870 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:02.121502 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 948/1901] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 17:59:02 2022] PUT /identity/v3/projects/143663158f3f4182b1420dd0bac431af/users/6626484997e74419a0c6dda2cfda6436/roles/1348580877d04014bfdec4d866b98a74 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:59:02.134235 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69c8543-9d09-4457-981b-af3bb271f3f2 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:02.134542 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69c8543-9d09-4457-981b-af3bb271f3f2 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:02.134807 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69c8543-9d09-4457-981b-af3bb271f3f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:02.138177 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965be423-3e18-4743-9fdd-bc5928356616 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5652329c71cd431fb579d69cef933b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:02.138928 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965be423-3e18-4743-9fdd-bc5928356616 service neutron] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:02.139249 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965be423-3e18-4743-9fdd-bc5928356616 service neutron] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:02.139576 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965be423-3e18-4743-9fdd-bc5928356616 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:02.155843 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965be423-3e18-4743-9fdd-bc5928356616 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:02.157425 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965be423-3e18-4743-9fdd-bc5928356616 service neutron] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:02.171416 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-c69c8543-9d09-4457-981b-af3bb271f3f2 None None] MFA Rules not processed for user `6626484997e74419a0c6dda2cfda6436`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:59:02.173123 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-c69c8543-9d09-4457-981b-af3bb271f3f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:02.174840 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 954/1902] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:59:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 17:59:02.267355 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 949/1903] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:59:02 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 17:59:02.284376 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965be423-3e18-4743-9fdd-bc5928356616 service neutron] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:02.285969 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-965be423-3e18-4743-9fdd-bc5928356616 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:02.352531 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965be423-3e18-4743-9fdd-bc5928356616 service neutron] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:02.405377 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20b7da3-657a-4e9f-8d8c-c8a58dcbb735 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17945e7d72954b8787e0ba09a9903247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:02.406114 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b7da3-657a-4e9f-8d8c-c8a58dcbb735 service cinder] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:02.406411 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b7da3-657a-4e9f-8d8c-c8a58dcbb735 service cinder] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:02.406874 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b7da3-657a-4e9f-8d8c-c8a58dcbb735 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:02.417445 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20b7da3-657a-4e9f-8d8c-c8a58dcbb735 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:02.418935 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20b7da3-657a-4e9f-8d8c-c8a58dcbb735 service cinder] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:02.432736 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 955/1904] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:59:02 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:59:02.598643 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69c8543-9d09-4457-981b-af3bb271f3f2 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:02.608215 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69c8543-9d09-4457-981b-af3bb271f3f2 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:02.612261 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff0d11e-dbef-49ae-bb67-6b88b3660501 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17945e7d72954b8787e0ba09a9903247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:02.613072 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff0d11e-dbef-49ae-bb67-6b88b3660501 service cinder] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:02.613430 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff0d11e-dbef-49ae-bb67-6b88b3660501 service cinder] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:02.613785 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff0d11e-dbef-49ae-bb67-6b88b3660501 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:02.615815 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-2ff0d11e-dbef-49ae-bb67-6b88b3660501 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:02.667841 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20b7da3-657a-4e9f-8d8c-c8a58dcbb735 service cinder] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:02.669329 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-a20b7da3-657a-4e9f-8d8c-c8a58dcbb735 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:02.726322 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff0d11e-dbef-49ae-bb67-6b88b3660501 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:02.727958 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff0d11e-dbef-49ae-bb67-6b88b3660501 service cinder] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:02.738912 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 950/1905] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:59:02 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 17:59:02.799517 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20b7da3-657a-4e9f-8d8c-c8a58dcbb735 service cinder] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:02.804461 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9be8e43-738e-4e34-97c8-f49b6fa2a1aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:02.806039 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9be8e43-738e-4e34-97c8-f49b6fa2a1aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:02.806336 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9be8e43-738e-4e34-97c8-f49b6fa2a1aa admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:02.806625 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9be8e43-738e-4e34-97c8-f49b6fa2a1aa admin admin] PATH_INFO: `/v3/projects/ea02efb0648e476baa08e438d3ab8e92` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:02.808991 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9be8e43-738e-4e34-97c8-f49b6fa2a1aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea02efb0648e476baa08e438d3ab8e92)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:02.810098 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9be8e43-738e-4e34-97c8-f49b6fa2a1aa admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:02.972940 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-d9be8e43-738e-4e34-97c8-f49b6fa2a1aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea02efb0648e476baa08e438d3ab8e92', 'request_id': 'req-d9be8e43-738e-4e34-97c8-f49b6fa2a1aa'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:03.074586 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-d9be8e43-738e-4e34-97c8-f49b6fa2a1aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea02efb0648e476baa08e438d3ab8e92', 'request_id': 'req-d9be8e43-738e-4e34-97c8-f49b6fa2a1aa'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:03.084860 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-d9be8e43-738e-4e34-97c8-f49b6fa2a1aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea02efb0648e476baa08e438d3ab8e92', 'request_id': 'req-d9be8e43-738e-4e34-97c8-f49b6fa2a1aa'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:03.102269 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-d9be8e43-738e-4e34-97c8-f49b6fa2a1aa admin admin] The token cache is being invalidate because project ea02efb0648e476baa08e438d3ab8e92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87019) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 17:59:03.102615 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-d9be8e43-738e-4e34-97c8-f49b6fa2a1aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:03.103609 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-d9be8e43-738e-4e34-97c8-f49b6fa2a1aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:03.105288 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 956/1906] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 14 17:59:02 2022] DELETE /identity/v3/projects/ea02efb0648e476baa08e438d3ab8e92 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:59:03.111134 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff0d11e-dbef-49ae-bb67-6b88b3660501 service cinder] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:03.128211 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff0d11e-dbef-49ae-bb67-6b88b3660501 service cinder] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:03.199568 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63941e8f-e4a0-40e2-83c2-904272df53dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:03.208640 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63941e8f-e4a0-40e2-83c2-904272df53dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:03.209237 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63941e8f-e4a0-40e2-83c2-904272df53dd admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:03.209782 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63941e8f-e4a0-40e2-83c2-904272df53dd admin admin] PATH_INFO: `/v3/users/a5bba0f9095548728ffb9a10fdd9b491` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:03.212350 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63941e8f-e4a0-40e2-83c2-904272df53dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5bba0f9095548728ffb9a10fdd9b491)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:03.214436 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63941e8f-e4a0-40e2-83c2-904272df53dd admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:03.369832 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9be8e43-738e-4e34-97c8-f49b6fa2a1aa admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:03.371370 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-d9be8e43-738e-4e34-97c8-f49b6fa2a1aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:03.386315 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9be8e43-738e-4e34-97c8-f49b6fa2a1aa admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:03.391380 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24d360d-3382-4c62-b1f3-84dd4f113403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:03.397562 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24d360d-3382-4c62-b1f3-84dd4f113403 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:03.397562 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24d360d-3382-4c62-b1f3-84dd4f113403 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:03.397562 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24d360d-3382-4c62-b1f3-84dd4f113403 admin admin] PATH_INFO: `/v3/users/2c843d97eafb49339504416d488ae7ef` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:03.397562 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24d360d-3382-4c62-b1f3-84dd4f113403 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c843d97eafb49339504416d488ae7ef)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:03.397562 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24d360d-3382-4c62-b1f3-84dd4f113403 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:03.431624 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-63941e8f-e4a0-40e2-83c2-904272df53dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5bba0f9095548728ffb9a10fdd9b491'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:03.432284 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-63941e8f-e4a0-40e2-83c2-904272df53dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5bba0f9095548728ffb9a10fdd9b491'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:03.432896 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-63941e8f-e4a0-40e2-83c2-904272df53dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5bba0f9095548728ffb9a10fdd9b491'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:03.633189 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-63941e8f-e4a0-40e2-83c2-904272df53dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5bba0f9095548728ffb9a10fdd9b491'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:03.636063 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:59:03.643834 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-63941e8f-e4a0-40e2-83c2-904272df53dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5bba0f9095548728ffb9a10fdd9b491'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:03.661725 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 951/1907] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 14 17:59:03 2022] DELETE /identity/v3/users/a5bba0f9095548728ffb9a10fdd9b491 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:59:03.760028 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-b24d360d-3382-4c62-b1f3-84dd4f113403 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c843d97eafb49339504416d488ae7ef'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:03.760975 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-b24d360d-3382-4c62-b1f3-84dd4f113403 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c843d97eafb49339504416d488ae7ef'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:03.761732 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-b24d360d-3382-4c62-b1f3-84dd4f113403 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c843d97eafb49339504416d488ae7ef'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:03.882706 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-b24d360d-3382-4c62-b1f3-84dd4f113403 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c843d97eafb49339504416d488ae7ef'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:03.892123 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-b24d360d-3382-4c62-b1f3-84dd4f113403 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c843d97eafb49339504416d488ae7ef'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:03.927902 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 957/1908] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 14 17:59:03 2022] DELETE /identity/v3/users/2c843d97eafb49339504416d488ae7ef => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 17:59:03.931293 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f2bc8b-d721-46a9-ab1a-6cd2753823e9 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:03.931614 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f2bc8b-d721-46a9-ab1a-6cd2753823e9 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:03.934531 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f2bc8b-d721-46a9-ab1a-6cd2753823e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:03.956064 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-14f2bc8b-d721-46a9-ab1a-6cd2753823e9 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:59:03.958735 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-14f2bc8b-d721-46a9-ab1a-6cd2753823e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:03.977315 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:59:04.048427 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 952/1909] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:59:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:59:04.059789 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24d360d-3382-4c62-b1f3-84dd4f113403 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:04.062014 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-b24d360d-3382-4c62-b1f3-84dd4f113403 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:04.131001 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24d360d-3382-4c62-b1f3-84dd4f113403 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:04.134870 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409eff3d-4603-4c81-9903-4fd0a5acce5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5652329c71cd431fb579d69cef933b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:04.135617 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409eff3d-4603-4c81-9903-4fd0a5acce5e service neutron] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:04.135918 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409eff3d-4603-4c81-9903-4fd0a5acce5e service neutron] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:04.136196 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409eff3d-4603-4c81-9903-4fd0a5acce5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:04.146778 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409eff3d-4603-4c81-9903-4fd0a5acce5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:04.148281 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409eff3d-4603-4c81-9903-4fd0a5acce5e service neutron] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:04.161540 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f2bc8b-d721-46a9-ab1a-6cd2753823e9 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:04.164395 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-14f2bc8b-d721-46a9-ab1a-6cd2753823e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:04.173786 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 958/1910] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:59:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:59:04.177595 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f2bc8b-d721-46a9-ab1a-6cd2753823e9 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:04.183350 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5506747f-f09b-4db7-81e1-db3c9ca1999b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:04.184057 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5506747f-f09b-4db7-81e1-db3c9ca1999b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:04.184349 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5506747f-f09b-4db7-81e1-db3c9ca1999b admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:04.184637 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5506747f-f09b-4db7-81e1-db3c9ca1999b admin admin] PATH_INFO: `/v3/projects/8e71c2bb344d4e84af7b896d048f81dc` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:04.185979 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5506747f-f09b-4db7-81e1-db3c9ca1999b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e71c2bb344d4e84af7b896d048f81dc)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:04.188618 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5506747f-f09b-4db7-81e1-db3c9ca1999b admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:04.327687 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-5506747f-f09b-4db7-81e1-db3c9ca1999b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e71c2bb344d4e84af7b896d048f81dc', 'request_id': 'req-5506747f-f09b-4db7-81e1-db3c9ca1999b'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:04.401317 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-5506747f-f09b-4db7-81e1-db3c9ca1999b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e71c2bb344d4e84af7b896d048f81dc', 'request_id': 'req-5506747f-f09b-4db7-81e1-db3c9ca1999b'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:04.409083 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-5506747f-f09b-4db7-81e1-db3c9ca1999b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e71c2bb344d4e84af7b896d048f81dc', 'request_id': 'req-5506747f-f09b-4db7-81e1-db3c9ca1999b'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:04.426831 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-5506747f-f09b-4db7-81e1-db3c9ca1999b admin admin] The token cache is being invalidate because project 8e71c2bb344d4e84af7b896d048f81dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 17:59:04.427236 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-5506747f-f09b-4db7-81e1-db3c9ca1999b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:04.428057 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-5506747f-f09b-4db7-81e1-db3c9ca1999b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:04.429740 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 953/1911] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 14 17:59:04 2022] DELETE /identity/v3/projects/8e71c2bb344d4e84af7b896d048f81dc => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 17:59:04.434641 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97f9ed6-184e-4d6f-8760-4ec6b5f33cf5 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:04.434932 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97f9ed6-184e-4d6f-8760-4ec6b5f33cf5 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:04.435518 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97f9ed6-184e-4d6f-8760-4ec6b5f33cf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:04.458754 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-b97f9ed6-184e-4d6f-8760-4ec6b5f33cf5 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:59:04.460280 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-b97f9ed6-184e-4d6f-8760-4ec6b5f33cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:04.539392 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 959/1912] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:59:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:59:04.548700 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e16dec3-4882-402b-92d9-18f31458b34b None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:04.549070 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e16dec3-4882-402b-92d9-18f31458b34b None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:04.549429 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e16dec3-4882-402b-92d9-18f31458b34b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:04.574281 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-8e16dec3-4882-402b-92d9-18f31458b34b None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:59:04.575631 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-8e16dec3-4882-402b-92d9-18f31458b34b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:04.585085 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 954/1913] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:59:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 17:59:04.588311 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:59:04.589519 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97f9ed6-184e-4d6f-8760-4ec6b5f33cf5 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:04.607644 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97f9ed6-184e-4d6f-8760-4ec6b5f33cf5 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:04.613855 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c395a0ff-99ba-457c-81a5-e79e07e29dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:04.615050 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c395a0ff-99ba-457c-81a5-e79e07e29dca admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:04.615445 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c395a0ff-99ba-457c-81a5-e79e07e29dca admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:04.615796 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c395a0ff-99ba-457c-81a5-e79e07e29dca admin admin] PATH_INFO: `/v3/domains` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:04.616605 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c395a0ff-99ba-457c-81a5-e79e07e29dca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:59:04.617023 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c395a0ff-99ba-457c-81a5-e79e07e29dca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:04.618651 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c395a0ff-99ba-457c-81a5-e79e07e29dca admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:04.632162 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 960/1914] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 14 17:59:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:59:04.636159 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e16dec3-4882-402b-92d9-18f31458b34b None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:04.646769 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e16dec3-4882-402b-92d9-18f31458b34b None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:04.653131 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd26f9e5-7349-493c-a61c-4ce2f23a6af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:04.653801 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd26f9e5-7349-493c-a61c-4ce2f23a6af2 admin admin] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:04.654051 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd26f9e5-7349-493c-a61c-4ce2f23a6af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:04.654521 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd26f9e5-7349-493c-a61c-4ce2f23a6af2 admin admin] PATH_INFO: `/v3/projects` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:04.655245 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd26f9e5-7349-493c-a61c-4ce2f23a6af2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:04.659096 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd26f9e5-7349-493c-a61c-4ce2f23a6af2 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:04.693619 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c395a0ff-99ba-457c-81a5-e79e07e29dca admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:04.694050 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-c395a0ff-99ba-457c-81a5-e79e07e29dca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:04.721517 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c395a0ff-99ba-457c-81a5-e79e07e29dca admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:04.729587 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5993d3cc-5dca-4dab-879a-a7c15aa336dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:04.730794 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5993d3cc-5dca-4dab-879a-a7c15aa336dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:04.731088 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5993d3cc-5dca-4dab-879a-a7c15aa336dd admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:04.731410 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5993d3cc-5dca-4dab-879a-a7c15aa336dd admin admin] PATH_INFO: `/v3/projects/c8ce24beabe442b3be3e6b3ebedcc653` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:04.732651 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5993d3cc-5dca-4dab-879a-a7c15aa336dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8ce24beabe442b3be3e6b3ebedcc653)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:04.735027 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5993d3cc-5dca-4dab-879a-a7c15aa336dd admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:04.760111 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 955/1915] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 14 17:59:04 2022] POST /identity/v3/projects => generated 387 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:59:04.760111 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd26f9e5-7349-493c-a61c-4ce2f23a6af2 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:04.835540 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd26f9e5-7349-493c-a61c-4ce2f23a6af2 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:04.841900 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb041c6-1692-4b37-8e26-78ebb538ef4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:04.842656 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb041c6-1692-4b37-8e26-78ebb538ef4c admin admin] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:04.842957 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb041c6-1692-4b37-8e26-78ebb538ef4c admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:04.843245 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb041c6-1692-4b37-8e26-78ebb538ef4c admin admin] PATH_INFO: `/v3/users` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:04.845962 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb041c6-1692-4b37-8e26-78ebb538ef4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:04.850169 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb041c6-1692-4b37-8e26-78ebb538ef4c admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:04.873368 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-5993d3cc-5dca-4dab-879a-a7c15aa336dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8ce24beabe442b3be3e6b3ebedcc653', 'request_id': 'req-5993d3cc-5dca-4dab-879a-a7c15aa336dd'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:04.938303 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-5993d3cc-5dca-4dab-879a-a7c15aa336dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8ce24beabe442b3be3e6b3ebedcc653', 'request_id': 'req-5993d3cc-5dca-4dab-879a-a7c15aa336dd'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:04.946193 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 956/1916] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 14 17:59:04 2022] POST /identity/v3/users => generated 294 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 17:59:04.946632 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-5993d3cc-5dca-4dab-879a-a7c15aa336dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8ce24beabe442b3be3e6b3ebedcc653', 'request_id': 'req-5993d3cc-5dca-4dab-879a-a7c15aa336dd'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:04.949962 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb041c6-1692-4b37-8e26-78ebb538ef4c admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:04.962048 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-5993d3cc-5dca-4dab-879a-a7c15aa336dd admin admin] The token cache is being invalidate because project c8ce24beabe442b3be3e6b3ebedcc653 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87019) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 17:59:04.962294 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb041c6-1692-4b37-8e26-78ebb538ef4c admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:04.962420 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-5993d3cc-5dca-4dab-879a-a7c15aa336dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:04.963314 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-5993d3cc-5dca-4dab-879a-a7c15aa336dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:04.968367 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 961/1917] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 14 17:59:04 2022] DELETE /identity/v3/projects/c8ce24beabe442b3be3e6b3ebedcc653 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 17:59:04.969628 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5993d3cc-5dca-4dab-879a-a7c15aa336dd admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:04.971049 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-5993d3cc-5dca-4dab-879a-a7c15aa336dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:05.039057 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed581b8-8b45-464b-ae23-1365dc3d4a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:05.039944 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed581b8-8b45-464b-ae23-1365dc3d4a38 admin admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:05.040352 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed581b8-8b45-464b-ae23-1365dc3d4a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:05.040647 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed581b8-8b45-464b-ae23-1365dc3d4a38 admin admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:05.041389 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed581b8-8b45-464b-ae23-1365dc3d4a38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:05.043404 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed581b8-8b45-464b-ae23-1365dc3d4a38 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:05.048950 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5993d3cc-5dca-4dab-879a-a7c15aa336dd admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:05.054067 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ea5faa-0108-4ded-8ce7-925bc0979c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:05.054973 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ea5faa-0108-4ded-8ce7-925bc0979c62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:05.055264 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ea5faa-0108-4ded-8ce7-925bc0979c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:05.058855 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ea5faa-0108-4ded-8ce7-925bc0979c62 admin admin] PATH_INFO: `/v3/users/6626484997e74419a0c6dda2cfda6436` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:05.060782 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 957/1918] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 17:59:04 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 14 17:59:05.060893 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ea5faa-0108-4ded-8ce7-925bc0979c62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6626484997e74419a0c6dda2cfda6436)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:05.060893 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ea5faa-0108-4ded-8ce7-925bc0979c62 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:05.061027 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed581b8-8b45-464b-ae23-1365dc3d4a38 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:05.062023 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-9ed581b8-8b45-464b-ae23-1365dc3d4a38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:05.077720 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed581b8-8b45-464b-ae23-1365dc3d4a38 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:05.083785 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469e0058-f0c8-44a4-9302-67e7286825f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:05.084496 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469e0058-f0c8-44a4-9302-67e7286825f9 admin admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:05.085070 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469e0058-f0c8-44a4-9302-67e7286825f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:05.085070 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469e0058-f0c8-44a4-9302-67e7286825f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:05.088593 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469e0058-f0c8-44a4-9302-67e7286825f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:05.088593 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469e0058-f0c8-44a4-9302-67e7286825f9 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:05.098644 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 958/1919] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 17:59:05 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 14 17:59:05.102966 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469e0058-f0c8-44a4-9302-67e7286825f9 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:05.114479 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469e0058-f0c8-44a4-9302-67e7286825f9 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:05.119734 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6498a59b-5a07-43e8-bcbb-877ab6abcbaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:05.120645 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6498a59b-5a07-43e8-bcbb-877ab6abcbaf admin admin] REQUEST_METHOD: `PUT` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:05.120937 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6498a59b-5a07-43e8-bcbb-877ab6abcbaf admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:05.121374 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6498a59b-5a07-43e8-bcbb-877ab6abcbaf admin admin] PATH_INFO: `/v3/projects/2d7463636c1d44d08468ca69dabe6d3b/users/95da42c990da418aafe84ad5c6350c58/roles/9ee80134743f4c2b88525b04df2facba` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:05.139885 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6498a59b-5a07-43e8-bcbb-877ab6abcbaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d7463636c1d44d08468ca69dabe6d3b, user_id=95da42c990da418aafe84ad5c6350c58, role_id=9ee80134743f4c2b88525b04df2facba)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:05.143685 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6498a59b-5a07-43e8-bcbb-877ab6abcbaf admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:05.219118 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 959/1920] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 17:59:05 2022] PUT /identity/v3/projects/2d7463636c1d44d08468ca69dabe6d3b/users/95da42c990da418aafe84ad5c6350c58/roles/9ee80134743f4c2b88525b04df2facba => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 17:59:05.230635 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef366fba-86b7-4d9b-983b-c1f01e5755f4 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:05.230931 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef366fba-86b7-4d9b-983b-c1f01e5755f4 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:05.231222 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef366fba-86b7-4d9b-983b-c1f01e5755f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:05.260069 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-ef366fba-86b7-4d9b-983b-c1f01e5755f4 None None] MFA Rules not processed for user `95da42c990da418aafe84ad5c6350c58`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:59:05.261332 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-ef366fba-86b7-4d9b-983b-c1f01e5755f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:05.289109 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-33ea5faa-0108-4ded-8ce7-925bc0979c62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6626484997e74419a0c6dda2cfda6436'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:05.290592 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-33ea5faa-0108-4ded-8ce7-925bc0979c62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6626484997e74419a0c6dda2cfda6436'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:05.291160 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-33ea5faa-0108-4ded-8ce7-925bc0979c62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6626484997e74419a0c6dda2cfda6436'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:05.333814 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 960/1921] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:59:05 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 17:59:05.338457 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef366fba-86b7-4d9b-983b-c1f01e5755f4 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:05.339865 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-ef366fba-86b7-4d9b-983b-c1f01e5755f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:05.405771 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-33ea5faa-0108-4ded-8ce7-925bc0979c62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6626484997e74419a0c6dda2cfda6436'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:05.412116 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef366fba-86b7-4d9b-983b-c1f01e5755f4 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:05.415552 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-33ea5faa-0108-4ded-8ce7-925bc0979c62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6626484997e74419a0c6dda2cfda6436'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:05.417132 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be0bf1f-32de-452d-82cb-b3f7877f1f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:05.418048 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be0bf1f-32de-452d-82cb-b3f7877f1f53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:05.418334 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be0bf1f-32de-452d-82cb-b3f7877f1f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:05.418627 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be0bf1f-32de-452d-82cb-b3f7877f1f53 admin admin] PATH_INFO: `/v3/users/4ac9e9e442f1482f8de6bf5cfe4350d9` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:05.419876 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be0bf1f-32de-452d-82cb-b3f7877f1f53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ac9e9e442f1482f8de6bf5cfe4350d9)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:05.421940 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be0bf1f-32de-452d-82cb-b3f7877f1f53 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:05.435139 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 962/1922] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 14 17:59:04 2022] DELETE /identity/v3/users/6626484997e74419a0c6dda2cfda6436 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:59:05.436183 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ea5faa-0108-4ded-8ce7-925bc0979c62 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:05.437727 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-33ea5faa-0108-4ded-8ce7-925bc0979c62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:05.588762 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ea5faa-0108-4ded-8ce7-925bc0979c62 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:05.594173 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b1eb46-f383-4611-bd75-88ffbd234964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:05.594891 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b1eb46-f383-4611-bd75-88ffbd234964 admin admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:05.595229 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b1eb46-f383-4611-bd75-88ffbd234964 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:05.595802 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b1eb46-f383-4611-bd75-88ffbd234964 admin admin] PATH_INFO: `/v3/projects` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:05.596539 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b1eb46-f383-4611-bd75-88ffbd234964 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:05.598443 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b1eb46-f383-4611-bd75-88ffbd234964 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:05.699339 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 963/1923] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 14 17:59:05 2022] POST /identity/v3/projects => generated 389 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:59:05.704370 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b1eb46-f383-4611-bd75-88ffbd234964 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:05.709026 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-2be0bf1f-32de-452d-82cb-b3f7877f1f53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ac9e9e442f1482f8de6bf5cfe4350d9'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:05.709828 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-2be0bf1f-32de-452d-82cb-b3f7877f1f53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ac9e9e442f1482f8de6bf5cfe4350d9'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:05.710525 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-2be0bf1f-32de-452d-82cb-b3f7877f1f53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ac9e9e442f1482f8de6bf5cfe4350d9'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:05.776089 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b1eb46-f383-4611-bd75-88ffbd234964 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:05.781189 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf723b68-98c2-4032-b49a-78e12db1dc59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:05.781692 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-2be0bf1f-32de-452d-82cb-b3f7877f1f53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ac9e9e442f1482f8de6bf5cfe4350d9'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:05.781988 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf723b68-98c2-4032-b49a-78e12db1dc59 admin admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:05.782283 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf723b68-98c2-4032-b49a-78e12db1dc59 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:05.782728 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf723b68-98c2-4032-b49a-78e12db1dc59 admin admin] PATH_INFO: `/v3/users` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:05.783823 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf723b68-98c2-4032-b49a-78e12db1dc59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:05.785848 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf723b68-98c2-4032-b49a-78e12db1dc59 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:05.796297 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-2be0bf1f-32de-452d-82cb-b3f7877f1f53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ac9e9e442f1482f8de6bf5cfe4350d9'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:05.811262 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 961/1924] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 14 17:59:05 2022] DELETE /identity/v3/users/4ac9e9e442f1482f8de6bf5cfe4350d9 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:59:05.816445 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be02f91d-6001-456f-b975-2183d374ee39 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:05.817027 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be02f91d-6001-456f-b975-2183d374ee39 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:05.819203 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be02f91d-6001-456f-b975-2183d374ee39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:05.835450 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-be02f91d-6001-456f-b975-2183d374ee39 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:59:05.836682 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-be02f91d-6001-456f-b975-2183d374ee39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:05.905226 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 962/1925] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:59:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 17:59:05.905556 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 964/1926] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 14 17:59:05 2022] POST /identity/v3/users => generated 301 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 17:59:05.909309 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be02f91d-6001-456f-b975-2183d374ee39 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:05.910787 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-be02f91d-6001-456f-b975-2183d374ee39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:05.910972 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf723b68-98c2-4032-b49a-78e12db1dc59 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:05.912779 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-cf723b68-98c2-4032-b49a-78e12db1dc59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:05.922964 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be02f91d-6001-456f-b975-2183d374ee39 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:05.927808 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6f0c0e-c805-4374-a696-64a76d2686a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:05.928483 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6f0c0e-c805-4374-a696-64a76d2686a4 admin admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:05.928771 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6f0c0e-c805-4374-a696-64a76d2686a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:05.929054 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6f0c0e-c805-4374-a696-64a76d2686a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:05.931374 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6f0c0e-c805-4374-a696-64a76d2686a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:05.933927 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6f0c0e-c805-4374-a696-64a76d2686a4 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:05.938909 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:59:05.954643 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 963/1927] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 17:59:05 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 17:59:05.955572 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6f0c0e-c805-4374-a696-64a76d2686a4 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:05.957394 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-4b6f0c0e-c805-4374-a696-64a76d2686a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:05.974596 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6f0c0e-c805-4374-a696-64a76d2686a4 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:05.979988 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dfa488-5d73-444d-a4ff-2ce2d208804c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:05.980872 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dfa488-5d73-444d-a4ff-2ce2d208804c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:05.981155 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dfa488-5d73-444d-a4ff-2ce2d208804c admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:05.981515 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dfa488-5d73-444d-a4ff-2ce2d208804c admin admin] PATH_INFO: `/v3/projects/143663158f3f4182b1420dd0bac431af` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:05.982727 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dfa488-5d73-444d-a4ff-2ce2d208804c admin admin] RBAC: Authorizing `identity:delete_project(project_id=143663158f3f4182b1420dd0bac431af)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:05.984769 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dfa488-5d73-444d-a4ff-2ce2d208804c admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:05.985745 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf723b68-98c2-4032-b49a-78e12db1dc59 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:06.039455 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831c158b-ca4c-4c43-9794-357c26f61fa0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5652329c71cd431fb579d69cef933b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:06.039929 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831c158b-ca4c-4c43-9794-357c26f61fa0 service neutron] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:06.040217 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831c158b-ca4c-4c43-9794-357c26f61fa0 service neutron] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:06.040496 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831c158b-ca4c-4c43-9794-357c26f61fa0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:06.051847 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831c158b-ca4c-4c43-9794-357c26f61fa0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:06.053333 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831c158b-ca4c-4c43-9794-357c26f61fa0 service neutron] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:06.064697 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 965/1928] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:59:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:59:06.065708 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831c158b-ca4c-4c43-9794-357c26f61fa0 service neutron] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:06.075466 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831c158b-ca4c-4c43-9794-357c26f61fa0 service neutron] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:06.080829 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172d1f67-1dfd-4a9d-aab4-b36720a5ab3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:06.081739 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172d1f67-1dfd-4a9d-aab4-b36720a5ab3e admin admin] REQUEST_METHOD: `PUT` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:06.082028 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172d1f67-1dfd-4a9d-aab4-b36720a5ab3e admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:06.082312 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172d1f67-1dfd-4a9d-aab4-b36720a5ab3e admin admin] PATH_INFO: `/v3/projects/967d2a9403a7419f85dedcc54c7b9561/users/32162fe6556d4da4a62e0813e700d7a3/roles/1348580877d04014bfdec4d866b98a74` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:06.099253 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172d1f67-1dfd-4a9d-aab4-b36720a5ab3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=967d2a9403a7419f85dedcc54c7b9561, user_id=32162fe6556d4da4a62e0813e700d7a3, role_id=1348580877d04014bfdec4d866b98a74)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:06.102031 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172d1f67-1dfd-4a9d-aab4-b36720a5ab3e admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:06.252813 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 966/1929] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 17:59:06 2022] PUT /identity/v3/projects/967d2a9403a7419f85dedcc54c7b9561/users/32162fe6556d4da4a62e0813e700d7a3/roles/1348580877d04014bfdec4d866b98a74 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:59:06.256732 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172d1f67-1dfd-4a9d-aab4-b36720a5ab3e admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:06.262022 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-12dfa488-5d73-444d-a4ff-2ce2d208804c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '143663158f3f4182b1420dd0bac431af', 'request_id': 'req-12dfa488-5d73-444d-a4ff-2ce2d208804c'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:06.320949 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172d1f67-1dfd-4a9d-aab4-b36720a5ab3e admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:06.397409 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b2aa4b-4128-40cf-9f17-1c4c75b1956b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:06.398127 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b2aa4b-4128-40cf-9f17-1c4c75b1956b admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:06.398688 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b2aa4b-4128-40cf-9f17-1c4c75b1956b admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:06.398889 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b2aa4b-4128-40cf-9f17-1c4c75b1956b admin admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:06.399710 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b2aa4b-4128-40cf-9f17-1c4c75b1956b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:06.401549 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b2aa4b-4128-40cf-9f17-1c4c75b1956b admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:06.416759 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 967/1930] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 17:59:06 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 14 17:59:06.420365 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b2aa4b-4128-40cf-9f17-1c4c75b1956b admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:06.437147 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b2aa4b-4128-40cf-9f17-1c4c75b1956b admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:06.446139 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dfbc22-382b-4796-abc3-c3bf41daf15a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:06.447424 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dfbc22-382b-4796-abc3-c3bf41daf15a admin admin] REQUEST_METHOD: `PUT` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:06.447810 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dfbc22-382b-4796-abc3-c3bf41daf15a admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:06.448243 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dfbc22-382b-4796-abc3-c3bf41daf15a admin admin] PATH_INFO: `/v3/projects/967d2a9403a7419f85dedcc54c7b9561/users/32162fe6556d4da4a62e0813e700d7a3/roles/1348580877d04014bfdec4d866b98a74` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:06.450523 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dfbc22-382b-4796-abc3-c3bf41daf15a admin admin] RBAC: Authorizing `identity:create_grant(project_id=967d2a9403a7419f85dedcc54c7b9561, user_id=32162fe6556d4da4a62e0813e700d7a3, role_id=1348580877d04014bfdec4d866b98a74)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:06.455546 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dfbc22-382b-4796-abc3-c3bf41daf15a admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:06.468210 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-12dfa488-5d73-444d-a4ff-2ce2d208804c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '143663158f3f4182b1420dd0bac431af', 'request_id': 'req-12dfa488-5d73-444d-a4ff-2ce2d208804c'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:06.477743 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 968/1931] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 17:59:06 2022] PUT /identity/v3/projects/967d2a9403a7419f85dedcc54c7b9561/users/32162fe6556d4da4a62e0813e700d7a3/roles/1348580877d04014bfdec4d866b98a74 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 17:59:06.479474 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29b5586-0d50-444b-bcdd-317385f844dc None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:06.480058 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29b5586-0d50-444b-bcdd-317385f844dc None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:06.480328 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29b5586-0d50-444b-bcdd-317385f844dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:06.482916 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-12dfa488-5d73-444d-a4ff-2ce2d208804c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '143663158f3f4182b1420dd0bac431af', 'request_id': 'req-12dfa488-5d73-444d-a4ff-2ce2d208804c'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:06.505844 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-12dfa488-5d73-444d-a4ff-2ce2d208804c admin admin] The token cache is being invalidate because project 143663158f3f4182b1420dd0bac431af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 17:59:06.506468 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-12dfa488-5d73-444d-a4ff-2ce2d208804c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:06.508005 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-12dfa488-5d73-444d-a4ff-2ce2d208804c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:06.515423 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 964/1932] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 14 17:59:05 2022] DELETE /identity/v3/projects/143663158f3f4182b1420dd0bac431af => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:59:06.516218 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-a29b5586-0d50-444b-bcdd-317385f844dc None None] MFA Rules not processed for user `32162fe6556d4da4a62e0813e700d7a3`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:59:06.516218 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-a29b5586-0d50-444b-bcdd-317385f844dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:06.525248 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef69fc4-3c62-49d6-9387-b17131e60fd3 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:06.525544 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef69fc4-3c62-49d6-9387-b17131e60fd3 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:06.525832 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef69fc4-3c62-49d6-9387-b17131e60fd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:06.557114 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-bef69fc4-3c62-49d6-9387-b17131e60fd3 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:59:06.558460 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-bef69fc4-3c62-49d6-9387-b17131e60fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:06.594363 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 969/1933] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:59:06 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:59:06.605686 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29b5586-0d50-444b-bcdd-317385f844dc None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:06.607171 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-a29b5586-0d50-444b-bcdd-317385f844dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:06.637086 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 965/1934] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:59:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:59:06.644441 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef69fc4-3c62-49d6-9387-b17131e60fd3 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:06.646235 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-bef69fc4-3c62-49d6-9387-b17131e60fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:06.661002 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef69fc4-3c62-49d6-9387-b17131e60fd3 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:06.666556 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4276d2c-7f25-4f4b-92e3-639cbd4637e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:06.667494 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4276d2c-7f25-4f4b-92e3-639cbd4637e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:06.667852 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4276d2c-7f25-4f4b-92e3-639cbd4637e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:06.668069 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4276d2c-7f25-4f4b-92e3-639cbd4637e5 admin admin] PATH_INFO: `/v3/projects/d746e85432a54249b34510afd09d765c` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:06.669287 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4276d2c-7f25-4f4b-92e3-639cbd4637e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d746e85432a54249b34510afd09d765c)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:06.671238 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4276d2c-7f25-4f4b-92e3-639cbd4637e5 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:06.676776 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29b5586-0d50-444b-bcdd-317385f844dc None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:06.680907 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8591fbbf-8859-444c-8a46-a0c58245bf15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17945e7d72954b8787e0ba09a9903247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:06.681676 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8591fbbf-8859-444c-8a46-a0c58245bf15 service cinder] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:06.681897 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8591fbbf-8859-444c-8a46-a0c58245bf15 service cinder] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:06.682180 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8591fbbf-8859-444c-8a46-a0c58245bf15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:06.692568 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8591fbbf-8859-444c-8a46-a0c58245bf15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:06.694026 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8591fbbf-8859-444c-8a46-a0c58245bf15 service cinder] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:06.704785 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 970/1935] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:59:06 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 17:59:06.706138 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91513a49-6e1e-44bc-9d0c-d15b54028435 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:06.706388 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91513a49-6e1e-44bc-9d0c-d15b54028435 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:06.706674 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91513a49-6e1e-44bc-9d0c-d15b54028435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:06.725890 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-91513a49-6e1e-44bc-9d0c-d15b54028435 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:59:06.727115 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-91513a49-6e1e-44bc-9d0c-d15b54028435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:06.736494 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 971/1936] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:59:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:59:06.740932 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91513a49-6e1e-44bc-9d0c-d15b54028435 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:06.751109 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91513a49-6e1e-44bc-9d0c-d15b54028435 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:06.756172 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb305df-6e08-4f8e-935b-636aedca65f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:06.756846 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb305df-6e08-4f8e-935b-636aedca65f8 admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:06.757135 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb305df-6e08-4f8e-935b-636aedca65f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:06.757434 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb305df-6e08-4f8e-935b-636aedca65f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:06.758199 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb305df-6e08-4f8e-935b-636aedca65f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:59:06.758511 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb305df-6e08-4f8e-935b-636aedca65f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:06.760167 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb305df-6e08-4f8e-935b-636aedca65f8 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:06.777948 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 972/1937] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 14 17:59:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:59:06.783585 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb305df-6e08-4f8e-935b-636aedca65f8 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:06.795353 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb305df-6e08-4f8e-935b-636aedca65f8 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:06.806122 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-e4276d2c-7f25-4f4b-92e3-639cbd4637e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd746e85432a54249b34510afd09d765c', 'request_id': 'req-e4276d2c-7f25-4f4b-92e3-639cbd4637e5'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:06.857656 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:59:06.872241 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db63330f-ca4c-4c68-ba35-584c97a58ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:06.873302 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db63330f-ca4c-4c68-ba35-584c97a58ef5 admin admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:06.873302 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db63330f-ca4c-4c68-ba35-584c97a58ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:06.873617 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db63330f-ca4c-4c68-ba35-584c97a58ef5 admin admin] PATH_INFO: `/v3/projects` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:06.874316 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db63330f-ca4c-4c68-ba35-584c97a58ef5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:06.876446 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db63330f-ca4c-4c68-ba35-584c97a58ef5 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:06.892605 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-e4276d2c-7f25-4f4b-92e3-639cbd4637e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd746e85432a54249b34510afd09d765c', 'request_id': 'req-e4276d2c-7f25-4f4b-92e3-639cbd4637e5'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:06.899043 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-e4276d2c-7f25-4f4b-92e3-639cbd4637e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd746e85432a54249b34510afd09d765c', 'request_id': 'req-e4276d2c-7f25-4f4b-92e3-639cbd4637e5'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:06.911810 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-e4276d2c-7f25-4f4b-92e3-639cbd4637e5 admin admin] The token cache is being invalidate because project d746e85432a54249b34510afd09d765c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 17:59:06.912089 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-e4276d2c-7f25-4f4b-92e3-639cbd4637e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:06.912766 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-e4276d2c-7f25-4f4b-92e3-639cbd4637e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:06.914346 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 966/1938] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 14 17:59:06 2022] DELETE /identity/v3/projects/d746e85432a54249b34510afd09d765c => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:59:06.915112 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4276d2c-7f25-4f4b-92e3-639cbd4637e5 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:06.916437 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-e4276d2c-7f25-4f4b-92e3-639cbd4637e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:06.929472 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4276d2c-7f25-4f4b-92e3-639cbd4637e5 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:06.934239 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5820f7af-f0e3-4a22-bf92-0dc079b552ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:06.935122 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5820f7af-f0e3-4a22-bf92-0dc079b552ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:06.935467 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5820f7af-f0e3-4a22-bf92-0dc079b552ca admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:06.935752 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5820f7af-f0e3-4a22-bf92-0dc079b552ca admin admin] PATH_INFO: `/v3/users/95da42c990da418aafe84ad5c6350c58` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:06.936958 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5820f7af-f0e3-4a22-bf92-0dc079b552ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=95da42c990da418aafe84ad5c6350c58)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:06.939352 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5820f7af-f0e3-4a22-bf92-0dc079b552ca admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:06.999091 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 973/1939] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 14 17:59:06 2022] POST /identity/v3/projects => generated 373 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:59:06.999091 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db63330f-ca4c-4c68-ba35-584c97a58ef5 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:06.999091 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-db63330f-ca4c-4c68-ba35-584c97a58ef5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:07.063463 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db63330f-ca4c-4c68-ba35-584c97a58ef5 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:07.068534 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726e827c-e705-4e78-b826-8ba5fcfb16bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:07.069469 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726e827c-e705-4e78-b826-8ba5fcfb16bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:07.069759 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726e827c-e705-4e78-b826-8ba5fcfb16bc admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:07.070050 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726e827c-e705-4e78-b826-8ba5fcfb16bc admin admin] PATH_INFO: `/v3/users/d9e574e873a34d83b1001e6f5370b830` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:07.071357 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726e827c-e705-4e78-b826-8ba5fcfb16bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9e574e873a34d83b1001e6f5370b830)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:07.073334 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726e827c-e705-4e78-b826-8ba5fcfb16bc admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:07.122344 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-5820f7af-f0e3-4a22-bf92-0dc079b552ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95da42c990da418aafe84ad5c6350c58'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:07.123032 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-5820f7af-f0e3-4a22-bf92-0dc079b552ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95da42c990da418aafe84ad5c6350c58'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:07.123694 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-5820f7af-f0e3-4a22-bf92-0dc079b552ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95da42c990da418aafe84ad5c6350c58'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:07.177457 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-5820f7af-f0e3-4a22-bf92-0dc079b552ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95da42c990da418aafe84ad5c6350c58'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:07.185346 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-5820f7af-f0e3-4a22-bf92-0dc079b552ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95da42c990da418aafe84ad5c6350c58'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:07.205639 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 967/1940] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 14 17:59:06 2022] DELETE /identity/v3/users/95da42c990da418aafe84ad5c6350c58 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:59:07.206759 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5820f7af-f0e3-4a22-bf92-0dc079b552ca admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:07.208187 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-5820f7af-f0e3-4a22-bf92-0dc079b552ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:07.232185 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-726e827c-e705-4e78-b826-8ba5fcfb16bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9e574e873a34d83b1001e6f5370b830'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:07.233142 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-726e827c-e705-4e78-b826-8ba5fcfb16bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9e574e873a34d83b1001e6f5370b830'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:07.233927 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-726e827c-e705-4e78-b826-8ba5fcfb16bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9e574e873a34d83b1001e6f5370b830'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:07.240549 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:59:07.278326 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5820f7af-f0e3-4a22-bf92-0dc079b552ca admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:07.283534 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d06ef84-31a6-4ace-8258-b277eb813fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:07.284246 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d06ef84-31a6-4ace-8258-b277eb813fac admin admin] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:07.284537 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d06ef84-31a6-4ace-8258-b277eb813fac admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:07.284823 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d06ef84-31a6-4ace-8258-b277eb813fac admin admin] PATH_INFO: `/v3/users` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:07.285535 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d06ef84-31a6-4ace-8258-b277eb813fac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:07.287678 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d06ef84-31a6-4ace-8258-b277eb813fac admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:07.303104 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-726e827c-e705-4e78-b826-8ba5fcfb16bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9e574e873a34d83b1001e6f5370b830'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:07.311454 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-726e827c-e705-4e78-b826-8ba5fcfb16bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9e574e873a34d83b1001e6f5370b830'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:07.332931 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 974/1941] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 14 17:59:06 2022] DELETE /identity/v3/users/d9e574e873a34d83b1001e6f5370b830 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:59:07.334659 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a908a8-473a-416f-b0a9-c37ef63d2967 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:07.334955 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a908a8-473a-416f-b0a9-c37ef63d2967 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:07.335247 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a908a8-473a-416f-b0a9-c37ef63d2967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:07.355312 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-24a908a8-473a-416f-b0a9-c37ef63d2967 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:59:07.356614 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-24a908a8-473a-416f-b0a9-c37ef63d2967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:07.372739 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 968/1942] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 14 17:59:07 2022] POST /identity/v3/users => generated 287 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:59:07.379498 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d06ef84-31a6-4ace-8258-b277eb813fac admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:07.381551 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-8d06ef84-31a6-4ace-8258-b277eb813fac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:07.395430 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d06ef84-31a6-4ace-8258-b277eb813fac admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:07.425040 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 975/1943] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:59:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:59:07.441231 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a908a8-473a-416f-b0a9-c37ef63d2967 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:07.442876 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-24a908a8-473a-416f-b0a9-c37ef63d2967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:07.470144 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91afdcda-1254-4de8-98bf-ff7711919a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:07.470875 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91afdcda-1254-4de8-98bf-ff7711919a28 admin admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:07.471143 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91afdcda-1254-4de8-98bf-ff7711919a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:07.471535 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91afdcda-1254-4de8-98bf-ff7711919a28 admin admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:07.472193 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91afdcda-1254-4de8-98bf-ff7711919a28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:07.474315 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91afdcda-1254-4de8-98bf-ff7711919a28 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:07.485347 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 969/1944] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 17:59:07 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 14 17:59:07.490506 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91afdcda-1254-4de8-98bf-ff7711919a28 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:07.501445 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91afdcda-1254-4de8-98bf-ff7711919a28 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:07.506400 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d755b4a0-2dd3-4002-906c-abb23769c4cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:07.507172 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d755b4a0-2dd3-4002-906c-abb23769c4cc admin admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:07.507493 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d755b4a0-2dd3-4002-906c-abb23769c4cc admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:07.507782 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d755b4a0-2dd3-4002-906c-abb23769c4cc admin admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:07.508425 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a908a8-473a-416f-b0a9-c37ef63d2967 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:07.508538 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d755b4a0-2dd3-4002-906c-abb23769c4cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:07.510142 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d755b4a0-2dd3-4002-906c-abb23769c4cc admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:07.513934 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f553137-88cc-4ff0-a489-d997678f2430 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5652329c71cd431fb579d69cef933b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:07.514608 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f553137-88cc-4ff0-a489-d997678f2430 service neutron] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:07.514919 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f553137-88cc-4ff0-a489-d997678f2430 service neutron] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:07.515200 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f553137-88cc-4ff0-a489-d997678f2430 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:07.523571 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 970/1945] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 17:59:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 14 17:59:07.527010 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f553137-88cc-4ff0-a489-d997678f2430 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:07.527416 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d755b4a0-2dd3-4002-906c-abb23769c4cc admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:07.528543 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f553137-88cc-4ff0-a489-d997678f2430 service neutron] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:07.538023 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d755b4a0-2dd3-4002-906c-abb23769c4cc admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:07.540382 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 976/1946] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:59:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:59:07.543185 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d17924-9ddc-45f2-9323-ac9d14c2ab47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:07.544129 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d17924-9ddc-45f2-9323-ac9d14c2ab47 admin admin] REQUEST_METHOD: `PUT` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:07.544424 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d17924-9ddc-45f2-9323-ac9d14c2ab47 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:07.544738 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d17924-9ddc-45f2-9323-ac9d14c2ab47 admin admin] PATH_INFO: `/v3/projects/41a862a8f8c040a09a98cdf15d079ffe/users/3b86b5e87322440a854490cefd8109fd/roles/9ee80134743f4c2b88525b04df2facba` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:07.565520 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d17924-9ddc-45f2-9323-ac9d14c2ab47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41a862a8f8c040a09a98cdf15d079ffe, user_id=3b86b5e87322440a854490cefd8109fd, role_id=9ee80134743f4c2b88525b04df2facba)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:07.570072 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d17924-9ddc-45f2-9323-ac9d14c2ab47 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:07.721661 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 971/1947] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 17:59:07 2022] PUT /identity/v3/projects/41a862a8f8c040a09a98cdf15d079ffe/users/3b86b5e87322440a854490cefd8109fd/roles/9ee80134743f4c2b88525b04df2facba => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:59:07.733077 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e051bbd-cc48-400a-a680-a830ba4a4ba9 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:07.733077 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e051bbd-cc48-400a-a680-a830ba4a4ba9 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:07.733077 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e051bbd-cc48-400a-a680-a830ba4a4ba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:07.769179 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-1e051bbd-cc48-400a-a680-a830ba4a4ba9 None None] MFA Rules not processed for user `3b86b5e87322440a854490cefd8109fd`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:59:07.770668 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-1e051bbd-cc48-400a-a680-a830ba4a4ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:07.835659 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 977/1948] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:59:07 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:59:07.847141 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d17924-9ddc-45f2-9323-ac9d14c2ab47 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:07.848872 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-64d17924-9ddc-45f2-9323-ac9d14c2ab47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:07.911246 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e051bbd-cc48-400a-a680-a830ba4a4ba9 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:07.922353 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-1e051bbd-cc48-400a-a680-a830ba4a4ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:07.929908 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d17924-9ddc-45f2-9323-ac9d14c2ab47 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:07.933841 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5a27a9-c604-40f4-8d7c-5055be242a03 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17945e7d72954b8787e0ba09a9903247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:07.941802 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a27a9-c604-40f4-8d7c-5055be242a03 service cinder] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:07.941802 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a27a9-c604-40f4-8d7c-5055be242a03 service cinder] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:07.941802 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a27a9-c604-40f4-8d7c-5055be242a03 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:07.945497 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5a27a9-c604-40f4-8d7c-5055be242a03 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:07.946852 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5a27a9-c604-40f4-8d7c-5055be242a03 service cinder] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:07.957375 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 972/1949] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:59:07 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:59:07.985898 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5a27a9-c604-40f4-8d7c-5055be242a03 service cinder] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:08.028657 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e051bbd-cc48-400a-a680-a830ba4a4ba9 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:08.034750 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f190b504-9bd3-4149-a085-a9fbdb4376c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:08.035670 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f190b504-9bd3-4149-a085-a9fbdb4376c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:08.035960 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f190b504-9bd3-4149-a085-a9fbdb4376c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:08.036233 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f190b504-9bd3-4149-a085-a9fbdb4376c3 admin admin] PATH_INFO: `/v3/projects/421251242a2643e584e841f25c1f56dc` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:08.037463 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f190b504-9bd3-4149-a085-a9fbdb4376c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=421251242a2643e584e841f25c1f56dc)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:08.039536 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f190b504-9bd3-4149-a085-a9fbdb4376c3 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:08.065305 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5a27a9-c604-40f4-8d7c-5055be242a03 service cinder] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:08.071892 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bc1432-bbb1-41ef-800e-1a98e3d2a9ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:08.073595 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc1432-bbb1-41ef-800e-1a98e3d2a9ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:08.073940 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc1432-bbb1-41ef-800e-1a98e3d2a9ba admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:08.074252 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc1432-bbb1-41ef-800e-1a98e3d2a9ba admin admin] PATH_INFO: `/v3/users/3b86b5e87322440a854490cefd8109fd` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:08.075977 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bc1432-bbb1-41ef-800e-1a98e3d2a9ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b86b5e87322440a854490cefd8109fd)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:08.077974 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bc1432-bbb1-41ef-800e-1a98e3d2a9ba admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:08.080621 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:59:08.158561 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-f190b504-9bd3-4149-a085-a9fbdb4376c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '421251242a2643e584e841f25c1f56dc', 'request_id': 'req-f190b504-9bd3-4149-a085-a9fbdb4376c3'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:08.274407 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-f190b504-9bd3-4149-a085-a9fbdb4376c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '421251242a2643e584e841f25c1f56dc', 'request_id': 'req-f190b504-9bd3-4149-a085-a9fbdb4376c3'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:08.282501 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-f190b504-9bd3-4149-a085-a9fbdb4376c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '421251242a2643e584e841f25c1f56dc', 'request_id': 'req-f190b504-9bd3-4149-a085-a9fbdb4376c3'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:08.294189 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-f190b504-9bd3-4149-a085-a9fbdb4376c3 admin admin] The token cache is being invalidate because project 421251242a2643e584e841f25c1f56dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87019) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 17:59:08.294518 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-f190b504-9bd3-4149-a085-a9fbdb4376c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:08.295204 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-f190b504-9bd3-4149-a085-a9fbdb4376c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:08.298031 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 978/1950] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 14 17:59:07 2022] DELETE /identity/v3/projects/421251242a2643e584e841f25c1f56dc => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 17:59:08.298363 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f190b504-9bd3-4149-a085-a9fbdb4376c3 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:08.299966 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-f190b504-9bd3-4149-a085-a9fbdb4376c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:08.319222 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-52bc1432-bbb1-41ef-800e-1a98e3d2a9ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b86b5e87322440a854490cefd8109fd'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:08.319929 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-52bc1432-bbb1-41ef-800e-1a98e3d2a9ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b86b5e87322440a854490cefd8109fd'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:08.320562 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-52bc1432-bbb1-41ef-800e-1a98e3d2a9ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b86b5e87322440a854490cefd8109fd'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:08.368790 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f190b504-9bd3-4149-a085-a9fbdb4376c3 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:08.379350 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccf83d5-f40f-4e6d-9ebe-7fa36d86d84f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:08.380301 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccf83d5-f40f-4e6d-9ebe-7fa36d86d84f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:08.380563 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccf83d5-f40f-4e6d-9ebe-7fa36d86d84f admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:08.380850 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccf83d5-f40f-4e6d-9ebe-7fa36d86d84f admin admin] PATH_INFO: `/v3/projects/2d7463636c1d44d08468ca69dabe6d3b` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:08.382347 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccf83d5-f40f-4e6d-9ebe-7fa36d86d84f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d7463636c1d44d08468ca69dabe6d3b)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:08.384466 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccf83d5-f40f-4e6d-9ebe-7fa36d86d84f admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:08.434651 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-52bc1432-bbb1-41ef-800e-1a98e3d2a9ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b86b5e87322440a854490cefd8109fd'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:08.444478 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-52bc1432-bbb1-41ef-800e-1a98e3d2a9ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b86b5e87322440a854490cefd8109fd'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:08.466326 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 973/1951] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 14 17:59:07 2022] DELETE /identity/v3/users/3b86b5e87322440a854490cefd8109fd => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:59:08.467788 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261350e4-c1c0-45c2-a2c7-2889f0b32d0e None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:08.468109 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261350e4-c1c0-45c2-a2c7-2889f0b32d0e None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:08.468388 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261350e4-c1c0-45c2-a2c7-2889f0b32d0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:08.490963 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-261350e4-c1c0-45c2-a2c7-2889f0b32d0e None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:59:08.492221 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-261350e4-c1c0-45c2-a2c7-2889f0b32d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:08.564941 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-3ccf83d5-f40f-4e6d-9ebe-7fa36d86d84f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d7463636c1d44d08468ca69dabe6d3b', 'request_id': 'req-3ccf83d5-f40f-4e6d-9ebe-7fa36d86d84f'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:08.581202 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 974/1952] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:59:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:59:08.583415 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cf9c3d-f255-41b1-8aa5-8383dd57639f None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:08.583638 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cf9c3d-f255-41b1-8aa5-8383dd57639f None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:08.584104 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cf9c3d-f255-41b1-8aa5-8383dd57639f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:08.603618 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-c0cf9c3d-f255-41b1-8aa5-8383dd57639f None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:59:08.606219 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:59:08.606995 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-c0cf9c3d-f255-41b1-8aa5-8383dd57639f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:08.633981 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-3ccf83d5-f40f-4e6d-9ebe-7fa36d86d84f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d7463636c1d44d08468ca69dabe6d3b', 'request_id': 'req-3ccf83d5-f40f-4e6d-9ebe-7fa36d86d84f'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:08.648252 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-3ccf83d5-f40f-4e6d-9ebe-7fa36d86d84f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d7463636c1d44d08468ca69dabe6d3b', 'request_id': 'req-3ccf83d5-f40f-4e6d-9ebe-7fa36d86d84f'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:08.662448 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-3ccf83d5-f40f-4e6d-9ebe-7fa36d86d84f admin admin] The token cache is being invalidate because project 2d7463636c1d44d08468ca69dabe6d3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87019) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 17:59:08.663093 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-3ccf83d5-f40f-4e6d-9ebe-7fa36d86d84f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:08.663643 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-3ccf83d5-f40f-4e6d-9ebe-7fa36d86d84f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:08.665528 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 979/1953] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 14 17:59:08 2022] DELETE /identity/v3/projects/2d7463636c1d44d08468ca69dabe6d3b => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:59:08.669712 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5193fb-ff27-4893-b14c-6d85a9196fc9 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:08.670016 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5193fb-ff27-4893-b14c-6d85a9196fc9 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:08.670444 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5193fb-ff27-4893-b14c-6d85a9196fc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:08.676382 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 975/1954] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:59:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:59:08.680652 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cf9c3d-f255-41b1-8aa5-8383dd57639f None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:08.681933 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-c0cf9c3d-f255-41b1-8aa5-8383dd57639f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:08.693505 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-7a5193fb-ff27-4893-b14c-6d85a9196fc9 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:59:08.695013 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-7a5193fb-ff27-4893-b14c-6d85a9196fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:08.696576 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cf9c3d-f255-41b1-8aa5-8383dd57639f None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:08.701874 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e75498-0c5e-4bd6-b516-65233b36a76a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:08.704130 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e75498-0c5e-4bd6-b516-65233b36a76a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:08.704130 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e75498-0c5e-4bd6-b516-65233b36a76a admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:08.704130 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e75498-0c5e-4bd6-b516-65233b36a76a admin admin] PATH_INFO: `/v3/users/32162fe6556d4da4a62e0813e700d7a3` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:08.706160 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e75498-0c5e-4bd6-b516-65233b36a76a admin admin] RBAC: Authorizing `identity:delete_user(user_id=32162fe6556d4da4a62e0813e700d7a3)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:08.706410 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 980/1955] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:59:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:59:08.708008 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5193fb-ff27-4893-b14c-6d85a9196fc9 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:08.708983 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e75498-0c5e-4bd6-b516-65233b36a76a admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:08.710198 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-7a5193fb-ff27-4893-b14c-6d85a9196fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:08.773406 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5193fb-ff27-4893-b14c-6d85a9196fc9 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:08.777491 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1774f906-5714-4a92-8bba-abdb0fb78502 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5652329c71cd431fb579d69cef933b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:08.778152 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1774f906-5714-4a92-8bba-abdb0fb78502 service neutron] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:08.778444 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1774f906-5714-4a92-8bba-abdb0fb78502 service neutron] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:08.778727 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1774f906-5714-4a92-8bba-abdb0fb78502 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:08.788907 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1774f906-5714-4a92-8bba-abdb0fb78502 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:08.790393 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1774f906-5714-4a92-8bba-abdb0fb78502 service neutron] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:08.800931 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 981/1956] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:59:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:59:08.801757 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1774f906-5714-4a92-8bba-abdb0fb78502 service neutron] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:08.811373 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1774f906-5714-4a92-8bba-abdb0fb78502 service neutron] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:08.818207 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d9f46f-ca21-41dc-86aa-69b188b62884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:08.821244 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d9f46f-ca21-41dc-86aa-69b188b62884 admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:08.821244 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d9f46f-ca21-41dc-86aa-69b188b62884 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:08.821244 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d9f46f-ca21-41dc-86aa-69b188b62884 admin admin] PATH_INFO: `/v3/domains` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:08.821244 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d9f46f-ca21-41dc-86aa-69b188b62884 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:59:08.821244 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d9f46f-ca21-41dc-86aa-69b188b62884 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:08.822288 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d9f46f-ca21-41dc-86aa-69b188b62884 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:08.841105 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 982/1957] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 14 17:59:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:59:08.842043 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d9f46f-ca21-41dc-86aa-69b188b62884 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:08.854972 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d9f46f-ca21-41dc-86aa-69b188b62884 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:08.860929 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f7443d-90e1-44ba-8d34-3aab302ad2b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:08.861607 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f7443d-90e1-44ba-8d34-3aab302ad2b2 admin admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:08.861895 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f7443d-90e1-44ba-8d34-3aab302ad2b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:08.862178 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f7443d-90e1-44ba-8d34-3aab302ad2b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:08.862884 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f7443d-90e1-44ba-8d34-3aab302ad2b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:08.864833 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f7443d-90e1-44ba-8d34-3aab302ad2b2 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:08.928958 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-b5e75498-0c5e-4bd6-b516-65233b36a76a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32162fe6556d4da4a62e0813e700d7a3'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:08.929651 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-b5e75498-0c5e-4bd6-b516-65233b36a76a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32162fe6556d4da4a62e0813e700d7a3'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:08.930441 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-b5e75498-0c5e-4bd6-b516-65233b36a76a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32162fe6556d4da4a62e0813e700d7a3'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:08.970530 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 983/1958] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 14 17:59:08 2022] POST /identity/v3/projects => generated 385 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:59:08.971859 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f7443d-90e1-44ba-8d34-3aab302ad2b2 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:08.973659 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-d1f7443d-90e1-44ba-8d34-3aab302ad2b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:09.034624 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-b5e75498-0c5e-4bd6-b516-65233b36a76a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32162fe6556d4da4a62e0813e700d7a3'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:09.065087 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-b5e75498-0c5e-4bd6-b516-65233b36a76a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32162fe6556d4da4a62e0813e700d7a3'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:09.065574 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f7443d-90e1-44ba-8d34-3aab302ad2b2 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:09.077078 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a86653-7ffd-4247-8fcc-68e44015cbc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:09.078674 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a86653-7ffd-4247-8fcc-68e44015cbc4 admin admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:09.078674 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a86653-7ffd-4247-8fcc-68e44015cbc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:09.078674 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a86653-7ffd-4247-8fcc-68e44015cbc4 admin admin] PATH_INFO: `/v3/users` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:09.079043 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a86653-7ffd-4247-8fcc-68e44015cbc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:09.086910 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 976/1959] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 14 17:59:08 2022] DELETE /identity/v3/users/32162fe6556d4da4a62e0813e700d7a3 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:59:09.087187 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a86653-7ffd-4247-8fcc-68e44015cbc4 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:09.183619 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 984/1960] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 14 17:59:08 2022] POST /identity/v3/users => generated 293 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 17:59:09.189681 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e75498-0c5e-4bd6-b516-65233b36a76a admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:09.258786 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e75498-0c5e-4bd6-b516-65233b36a76a admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:09.263405 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fee1460-3891-46a6-812b-3cd6460894bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:09.264096 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fee1460-3891-46a6-812b-3cd6460894bd admin admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:09.264384 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fee1460-3891-46a6-812b-3cd6460894bd admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:09.264661 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fee1460-3891-46a6-812b-3cd6460894bd admin admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:09.265463 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fee1460-3891-46a6-812b-3cd6460894bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:09.267492 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fee1460-3891-46a6-812b-3cd6460894bd admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:09.281086 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 977/1961] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 17:59:09 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 17:59:09.282565 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a86653-7ffd-4247-8fcc-68e44015cbc4 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:09.292827 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a86653-7ffd-4247-8fcc-68e44015cbc4 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:09.298607 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b51fa4-1bbf-406c-971b-53c2dd7e2560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:09.299321 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b51fa4-1bbf-406c-971b-53c2dd7e2560 admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:09.299624 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b51fa4-1bbf-406c-971b-53c2dd7e2560 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:09.300403 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b51fa4-1bbf-406c-971b-53c2dd7e2560 admin admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:09.300663 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b51fa4-1bbf-406c-971b-53c2dd7e2560 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:09.302434 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b51fa4-1bbf-406c-971b-53c2dd7e2560 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:09.314613 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 985/1962] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 17:59:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 17:59:09.332498 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fee1460-3891-46a6-812b-3cd6460894bd admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:09.348812 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fee1460-3891-46a6-812b-3cd6460894bd admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:09.354887 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0b6332-f321-4202-9a12-5c0c0c166054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:09.356000 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0b6332-f321-4202-9a12-5c0c0c166054 admin admin] REQUEST_METHOD: `PUT` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:09.356470 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0b6332-f321-4202-9a12-5c0c0c166054 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:09.356841 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0b6332-f321-4202-9a12-5c0c0c166054 admin admin] PATH_INFO: `/v3/projects/5a0d1ea8815e4cdba732bb43819e36e2/users/5300568337ce4298b468a3d0c8d7facd/roles/9ee80134743f4c2b88525b04df2facba` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:09.383010 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0b6332-f321-4202-9a12-5c0c0c166054 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a0d1ea8815e4cdba732bb43819e36e2, user_id=5300568337ce4298b468a3d0c8d7facd, role_id=9ee80134743f4c2b88525b04df2facba)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:09.386397 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0b6332-f321-4202-9a12-5c0c0c166054 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:09.389683 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:59:09.503152 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 978/1963] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 17:59:09 2022] PUT /identity/v3/projects/5a0d1ea8815e4cdba732bb43819e36e2/users/5300568337ce4298b468a3d0c8d7facd/roles/9ee80134743f4c2b88525b04df2facba => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:59:09.515882 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d22e27-7fd8-44c6-82f2-0a0bb1376023 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:09.516594 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d22e27-7fd8-44c6-82f2-0a0bb1376023 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:09.517169 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d22e27-7fd8-44c6-82f2-0a0bb1376023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:09.523511 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0b6332-f321-4202-9a12-5c0c0c166054 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:09.525337 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-ae0b6332-f321-4202-9a12-5c0c0c166054 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:09.558173 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-07d22e27-7fd8-44c6-82f2-0a0bb1376023 None None] MFA Rules not processed for user `5300568337ce4298b468a3d0c8d7facd`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:59:09.561098 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-07d22e27-7fd8-44c6-82f2-0a0bb1376023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:09.649761 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0b6332-f321-4202-9a12-5c0c0c166054 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:09.652036 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 986/1964] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:59:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:59:09.653299 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d22e27-7fd8-44c6-82f2-0a0bb1376023 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:09.654859 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-07d22e27-7fd8-44c6-82f2-0a0bb1376023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:09.667820 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fb36f5-2c04-4ea2-87a8-58434463883d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:09.669253 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fb36f5-2c04-4ea2-87a8-58434463883d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:09.669650 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fb36f5-2c04-4ea2-87a8-58434463883d admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:09.670032 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fb36f5-2c04-4ea2-87a8-58434463883d admin admin] PATH_INFO: `/v3/projects/41a862a8f8c040a09a98cdf15d079ffe` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:09.671510 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d22e27-7fd8-44c6-82f2-0a0bb1376023 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:09.672239 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fb36f5-2c04-4ea2-87a8-58434463883d admin admin] RBAC: Authorizing `identity:delete_project(project_id=41a862a8f8c040a09a98cdf15d079ffe)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:09.674645 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fb36f5-2c04-4ea2-87a8-58434463883d admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:09.692791 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9419f1-c58c-4e7f-a0b6-2cc20f6d3fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:09.692791 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9419f1-c58c-4e7f-a0b6-2cc20f6d3fcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:09.692791 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9419f1-c58c-4e7f-a0b6-2cc20f6d3fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:09.692791 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9419f1-c58c-4e7f-a0b6-2cc20f6d3fcc admin admin] PATH_INFO: `/v3/projects/967d2a9403a7419f85dedcc54c7b9561` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:09.693184 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9419f1-c58c-4e7f-a0b6-2cc20f6d3fcc admin admin] RBAC: Authorizing `identity:delete_project(project_id=967d2a9403a7419f85dedcc54c7b9561)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:09.697031 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9419f1-c58c-4e7f-a0b6-2cc20f6d3fcc admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:09.855619 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-eb9419f1-c58c-4e7f-a0b6-2cc20f6d3fcc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '967d2a9403a7419f85dedcc54c7b9561', 'request_id': 'req-eb9419f1-c58c-4e7f-a0b6-2cc20f6d3fcc'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:09.856865 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-26fb36f5-2c04-4ea2-87a8-58434463883d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41a862a8f8c040a09a98cdf15d079ffe', 'request_id': 'req-26fb36f5-2c04-4ea2-87a8-58434463883d'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:09.971858 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-eb9419f1-c58c-4e7f-a0b6-2cc20f6d3fcc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '967d2a9403a7419f85dedcc54c7b9561', 'request_id': 'req-eb9419f1-c58c-4e7f-a0b6-2cc20f6d3fcc'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:09.979101 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-eb9419f1-c58c-4e7f-a0b6-2cc20f6d3fcc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '967d2a9403a7419f85dedcc54c7b9561', 'request_id': 'req-eb9419f1-c58c-4e7f-a0b6-2cc20f6d3fcc'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:09.993765 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-eb9419f1-c58c-4e7f-a0b6-2cc20f6d3fcc admin admin] The token cache is being invalidate because project 967d2a9403a7419f85dedcc54c7b9561 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87019) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 17:59:09.994166 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-eb9419f1-c58c-4e7f-a0b6-2cc20f6d3fcc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:09.995015 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-eb9419f1-c58c-4e7f-a0b6-2cc20f6d3fcc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:09.997192 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 987/1965] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 14 17:59:09 2022] DELETE /identity/v3/projects/967d2a9403a7419f85dedcc54c7b9561 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:59:10.000381 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9419f1-c58c-4e7f-a0b6-2cc20f6d3fcc admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:10.000714 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-eb9419f1-c58c-4e7f-a0b6-2cc20f6d3fcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:10.057434 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-26fb36f5-2c04-4ea2-87a8-58434463883d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41a862a8f8c040a09a98cdf15d079ffe', 'request_id': 'req-26fb36f5-2c04-4ea2-87a8-58434463883d'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:10.070177 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-26fb36f5-2c04-4ea2-87a8-58434463883d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41a862a8f8c040a09a98cdf15d079ffe', 'request_id': 'req-26fb36f5-2c04-4ea2-87a8-58434463883d'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:10.081922 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9419f1-c58c-4e7f-a0b6-2cc20f6d3fcc admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:10.112161 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-26fb36f5-2c04-4ea2-87a8-58434463883d admin admin] The token cache is being invalidate because project 41a862a8f8c040a09a98cdf15d079ffe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 17:59:10.112616 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-26fb36f5-2c04-4ea2-87a8-58434463883d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:10.113200 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-26fb36f5-2c04-4ea2-87a8-58434463883d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:10.120792 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 979/1966] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 14 17:59:09 2022] DELETE /identity/v3/projects/41a862a8f8c040a09a98cdf15d079ffe => generated 0 bytes in 595 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 17:59:10.123695 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fed606c-60c2-4aff-96e5-0d5e14f56acf None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:10.125433 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fed606c-60c2-4aff-96e5-0d5e14f56acf None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:10.126429 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fed606c-60c2-4aff-96e5-0d5e14f56acf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:10.163671 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-1fed606c-60c2-4aff-96e5-0d5e14f56acf None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:59:10.166364 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-1fed606c-60c2-4aff-96e5-0d5e14f56acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:10.200468 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89404362-ccfe-498d-9974-331c5ed7c574 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17945e7d72954b8787e0ba09a9903247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:10.201766 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89404362-ccfe-498d-9974-331c5ed7c574 service cinder] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:10.202367 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89404362-ccfe-498d-9974-331c5ed7c574 service cinder] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:10.202984 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89404362-ccfe-498d-9974-331c5ed7c574 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:10.230794 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-89404362-ccfe-498d-9974-331c5ed7c574 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:10.268479 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 980/1967] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:59:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:59:10.268479 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79cf61d-b072-4e57-b3cc-3d6ce40eebc6 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:10.268479 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79cf61d-b072-4e57-b3cc-3d6ce40eebc6 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:10.268479 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79cf61d-b072-4e57-b3cc-3d6ce40eebc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:10.307662 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-d79cf61d-b072-4e57-b3cc-3d6ce40eebc6 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:59:10.310274 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-d79cf61d-b072-4e57-b3cc-3d6ce40eebc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:10.333080 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 981/1968] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:59:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:59:10.335398 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca7d228-c586-4824-9ee0-27faa42923e9 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:10.335906 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca7d228-c586-4824-9ee0-27faa42923e9 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:10.336346 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca7d228-c586-4824-9ee0-27faa42923e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:10.377756 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-cca7d228-c586-4824-9ee0-27faa42923e9 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:59:10.379700 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-cca7d228-c586-4824-9ee0-27faa42923e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:10.390136 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 982/1969] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:59:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:59:10.393124 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc543885-e7d0-45df-9775-002a678ef7a5 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:10.393429 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc543885-e7d0-45df-9775-002a678ef7a5 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:10.393724 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc543885-e7d0-45df-9775-002a678ef7a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:10.399543 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89404362-ccfe-498d-9974-331c5ed7c574 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:10.402717 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89404362-ccfe-498d-9974-331c5ed7c574 service cinder] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:10.417652 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-fc543885-e7d0-45df-9775-002a678ef7a5 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:59:10.419085 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-fc543885-e7d0-45df-9775-002a678ef7a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:10.424413 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 988/1970] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:59:09 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:59:10.427256 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:59:10.427484 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89404362-ccfe-498d-9974-331c5ed7c574 service cinder] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:10.457589 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 983/1971] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:59:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:59:10.458275 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc543885-e7d0-45df-9775-002a678ef7a5 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:10.460347 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-fc543885-e7d0-45df-9775-002a678ef7a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:10.462003 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89404362-ccfe-498d-9974-331c5ed7c574 service cinder] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:10.483216 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dd557b-1ba8-446b-b142-7fc122ee9d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:10.484776 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd557b-1ba8-446b-b142-7fc122ee9d0f admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:10.485168 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd557b-1ba8-446b-b142-7fc122ee9d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:10.485745 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd557b-1ba8-446b-b142-7fc122ee9d0f admin admin] PATH_INFO: `/v3/domains` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:10.487134 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc543885-e7d0-45df-9775-002a678ef7a5 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:10.488166 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dd557b-1ba8-446b-b142-7fc122ee9d0f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:59:10.488624 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dd557b-1ba8-446b-b142-7fc122ee9d0f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:10.490813 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dd557b-1ba8-446b-b142-7fc122ee9d0f admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:10.497658 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db4ae30-1a67-48de-8544-e21a138eabfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:10.498930 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db4ae30-1a67-48de-8544-e21a138eabfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:10.499441 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db4ae30-1a67-48de-8544-e21a138eabfb admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:10.499951 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db4ae30-1a67-48de-8544-e21a138eabfb admin admin] PATH_INFO: `/v3/users/5300568337ce4298b468a3d0c8d7facd` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:10.501958 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db4ae30-1a67-48de-8544-e21a138eabfb admin admin] RBAC: Authorizing `identity:delete_user(user_id=5300568337ce4298b468a3d0c8d7facd)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:10.504562 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db4ae30-1a67-48de-8544-e21a138eabfb admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:10.522301 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 989/1972] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 14 17:59:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:59:10.522301 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dd557b-1ba8-446b-b142-7fc122ee9d0f admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:10.536537 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dd557b-1ba8-446b-b142-7fc122ee9d0f admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:10.541962 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c04999-ca2f-459b-9d02-bf1ef2345b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:10.542595 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c04999-ca2f-459b-9d02-bf1ef2345b7f admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:10.542891 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c04999-ca2f-459b-9d02-bf1ef2345b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:10.543173 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c04999-ca2f-459b-9d02-bf1ef2345b7f admin admin] PATH_INFO: `/v3/domains` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:10.543996 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c04999-ca2f-459b-9d02-bf1ef2345b7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:59:10.544317 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c04999-ca2f-459b-9d02-bf1ef2345b7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:10.546150 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c04999-ca2f-459b-9d02-bf1ef2345b7f admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:10.564866 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 990/1973] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 14 17:59:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:59:10.566035 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c04999-ca2f-459b-9d02-bf1ef2345b7f admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:10.580076 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c04999-ca2f-459b-9d02-bf1ef2345b7f admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:10.585826 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d8e10e-eab4-4a22-bea4-e62e9492e306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:10.586536 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d8e10e-eab4-4a22-bea4-e62e9492e306 admin admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:10.586829 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d8e10e-eab4-4a22-bea4-e62e9492e306 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:10.587256 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d8e10e-eab4-4a22-bea4-e62e9492e306 admin admin] PATH_INFO: `/v3/projects` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:10.588035 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d8e10e-eab4-4a22-bea4-e62e9492e306 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:10.590679 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d8e10e-eab4-4a22-bea4-e62e9492e306 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:10.646102 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:59:10.688663 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 991/1974] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 14 17:59:10 2022] POST /identity/v3/projects => generated 377 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:59:10.690214 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d8e10e-eab4-4a22-bea4-e62e9492e306 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:10.763867 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d8e10e-eab4-4a22-bea4-e62e9492e306 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:10.769964 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc91c2ec-f10e-46bf-ad46-aefc0081ae5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:10.770642 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc91c2ec-f10e-46bf-ad46-aefc0081ae5e admin admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:10.770941 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc91c2ec-f10e-46bf-ad46-aefc0081ae5e admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:10.771316 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc91c2ec-f10e-46bf-ad46-aefc0081ae5e admin admin] PATH_INFO: `/v3/projects` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:10.772027 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc91c2ec-f10e-46bf-ad46-aefc0081ae5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:10.774032 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc91c2ec-f10e-46bf-ad46-aefc0081ae5e admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:10.802225 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-1db4ae30-1a67-48de-8544-e21a138eabfb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5300568337ce4298b468a3d0c8d7facd'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:10.802791 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-1db4ae30-1a67-48de-8544-e21a138eabfb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5300568337ce4298b468a3d0c8d7facd'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:10.803473 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-1db4ae30-1a67-48de-8544-e21a138eabfb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5300568337ce4298b468a3d0c8d7facd'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:10.894235 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 992/1975] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 14 17:59:10 2022] POST /identity/v3/projects => generated 375 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:59:10.895291 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc91c2ec-f10e-46bf-ad46-aefc0081ae5e admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:10.897353 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-fc91c2ec-f10e-46bf-ad46-aefc0081ae5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:10.914847 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-1db4ae30-1a67-48de-8544-e21a138eabfb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5300568337ce4298b468a3d0c8d7facd'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:10.926411 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-1db4ae30-1a67-48de-8544-e21a138eabfb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5300568337ce4298b468a3d0c8d7facd'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:10.949755 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 984/1976] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 14 17:59:10 2022] DELETE /identity/v3/users/5300568337ce4298b468a3d0c8d7facd => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:59:10.950721 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db4ae30-1a67-48de-8544-e21a138eabfb admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:10.952279 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-1db4ae30-1a67-48de-8544-e21a138eabfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:10.974393 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc91c2ec-f10e-46bf-ad46-aefc0081ae5e admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:11.023733 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db4ae30-1a67-48de-8544-e21a138eabfb admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:11.031475 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a614866-599e-476e-8e55-1c48a33244e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:11.032490 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a614866-599e-476e-8e55-1c48a33244e7 admin admin] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:11.034698 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a614866-599e-476e-8e55-1c48a33244e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:11.034698 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a614866-599e-476e-8e55-1c48a33244e7 admin admin] PATH_INFO: `/v3/users` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:11.035017 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a614866-599e-476e-8e55-1c48a33244e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:11.038537 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a614866-599e-476e-8e55-1c48a33244e7 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:11.039403 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db858ee6-9f5b-4688-b69b-5e542ebacccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:11.040479 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db858ee6-9f5b-4688-b69b-5e542ebacccd admin admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:11.040947 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db858ee6-9f5b-4688-b69b-5e542ebacccd admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:11.041397 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db858ee6-9f5b-4688-b69b-5e542ebacccd admin admin] PATH_INFO: `/v3/users` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:11.042531 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db858ee6-9f5b-4688-b69b-5e542ebacccd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:11.048768 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db858ee6-9f5b-4688-b69b-5e542ebacccd admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:11.162318 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 985/1978] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 14 17:59:10 2022] POST /identity/v3/users => generated 288 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:59:11.162491 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 993/1978] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 14 17:59:10 2022] POST /identity/v3/users => generated 289 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:59:11.163701 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff13eb71-51ec-4e97-a06a-fa92bbe02a0f None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:11.164008 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff13eb71-51ec-4e97-a06a-fa92bbe02a0f None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:11.164299 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff13eb71-51ec-4e97-a06a-fa92bbe02a0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:11.167276 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db858ee6-9f5b-4688-b69b-5e542ebacccd admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:11.179855 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db858ee6-9f5b-4688-b69b-5e542ebacccd admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:11.184249 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-ff13eb71-51ec-4e97-a06a-fa92bbe02a0f None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:59:11.185082 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ce2abe-3eeb-4880-a70c-13fed3d0e68e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:11.185493 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-ff13eb71-51ec-4e97-a06a-fa92bbe02a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:11.185770 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ce2abe-3eeb-4880-a70c-13fed3d0e68e admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:11.186058 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ce2abe-3eeb-4880-a70c-13fed3d0e68e admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:11.186339 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ce2abe-3eeb-4880-a70c-13fed3d0e68e admin admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:11.187079 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ce2abe-3eeb-4880-a70c-13fed3d0e68e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:11.189492 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ce2abe-3eeb-4880-a70c-13fed3d0e68e admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:11.194891 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 986/1979] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:59:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:59:11.195880 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff13eb71-51ec-4e97-a06a-fa92bbe02a0f None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:11.205017 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 994/1980] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 17:59:11 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 17:59:11.206905 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ce2abe-3eeb-4880-a70c-13fed3d0e68e admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:11.207612 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff13eb71-51ec-4e97-a06a-fa92bbe02a0f None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:11.210519 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-e2ce2abe-3eeb-4880-a70c-13fed3d0e68e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:11.213186 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ada8d2-8270-44b0-b255-1bbc2b391fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:11.213888 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ada8d2-8270-44b0-b255-1bbc2b391fde admin admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:11.214193 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ada8d2-8270-44b0-b255-1bbc2b391fde admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:11.214480 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ada8d2-8270-44b0-b255-1bbc2b391fde admin admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:11.215458 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ada8d2-8270-44b0-b255-1bbc2b391fde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:11.217137 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ada8d2-8270-44b0-b255-1bbc2b391fde admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:11.231422 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 987/1981] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 17:59:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 17:59:11.231422 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ada8d2-8270-44b0-b255-1bbc2b391fde admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:11.240381 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ada8d2-8270-44b0-b255-1bbc2b391fde admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:11.245150 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2763e6c-56ec-4a6d-a126-c551b979f1d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:11.245828 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2763e6c-56ec-4a6d-a126-c551b979f1d2 admin admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:11.246117 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2763e6c-56ec-4a6d-a126-c551b979f1d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:11.246398 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2763e6c-56ec-4a6d-a126-c551b979f1d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:11.247125 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2763e6c-56ec-4a6d-a126-c551b979f1d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:11.248776 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2763e6c-56ec-4a6d-a126-c551b979f1d2 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:11.263826 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 988/1982] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 17:59:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 17:59:11.263826 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2763e6c-56ec-4a6d-a126-c551b979f1d2 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:11.272770 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2763e6c-56ec-4a6d-a126-c551b979f1d2 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:11.276682 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ce2abe-3eeb-4880-a70c-13fed3d0e68e admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:11.277862 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03af68a8-d4b8-44aa-b7b4-89709b2d161c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:11.278499 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af68a8-d4b8-44aa-b7b4-89709b2d161c admin admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:11.278790 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af68a8-d4b8-44aa-b7b4-89709b2d161c admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:11.279078 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af68a8-d4b8-44aa-b7b4-89709b2d161c admin admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:11.279972 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03af68a8-d4b8-44aa-b7b4-89709b2d161c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:11.282729 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f71e21-5eae-448d-8d71-8bffe9593bd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5652329c71cd431fb579d69cef933b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:11.282729 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f71e21-5eae-448d-8d71-8bffe9593bd1 service neutron] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:11.282996 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03af68a8-d4b8-44aa-b7b4-89709b2d161c admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:11.283089 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f71e21-5eae-448d-8d71-8bffe9593bd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:11.283089 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f71e21-5eae-448d-8d71-8bffe9593bd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:11.293050 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f71e21-5eae-448d-8d71-8bffe9593bd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:11.294501 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f71e21-5eae-448d-8d71-8bffe9593bd1 service neutron] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:11.295183 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 989/1983] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 17:59:11 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 17:59:11.296056 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03af68a8-d4b8-44aa-b7b4-89709b2d161c admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:11.306367 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 995/1984] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:59:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 17:59:11.309803 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03af68a8-d4b8-44aa-b7b4-89709b2d161c admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:11.321311 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f71e21-5eae-448d-8d71-8bffe9593bd1 service neutron] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:11.321561 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93be5cb7-2377-457d-b6f4-d6883acd3cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:11.321561 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93be5cb7-2377-457d-b6f4-d6883acd3cb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:11.321561 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93be5cb7-2377-457d-b6f4-d6883acd3cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:11.321561 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93be5cb7-2377-457d-b6f4-d6883acd3cb2 admin admin] PATH_INFO: `/v3/projects/b8801efd93494e008bf2443408fda198/users/285a185a065e4f4f893b27144a7b5115/roles/9ee80134743f4c2b88525b04df2facba` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:11.325648 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f71e21-5eae-448d-8d71-8bffe9593bd1 service neutron] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:11.332303 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5790b095-28e4-4797-b249-998a14187644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:11.333357 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5790b095-28e4-4797-b249-998a14187644 admin admin] REQUEST_METHOD: `PUT` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:11.333768 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5790b095-28e4-4797-b249-998a14187644 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:11.334452 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5790b095-28e4-4797-b249-998a14187644 admin admin] PATH_INFO: `/v3/projects/3f1270f74ca54396af7c8fbfcb0de4d3/users/0aab37416308423eb0ea922ad7da1fe6/roles/9ee80134743f4c2b88525b04df2facba` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:11.335417 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93be5cb7-2377-457d-b6f4-d6883acd3cb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8801efd93494e008bf2443408fda198, user_id=285a185a065e4f4f893b27144a7b5115, role_id=9ee80134743f4c2b88525b04df2facba)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:11.338246 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93be5cb7-2377-457d-b6f4-d6883acd3cb2 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:11.352657 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5790b095-28e4-4797-b249-998a14187644 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f1270f74ca54396af7c8fbfcb0de4d3, user_id=0aab37416308423eb0ea922ad7da1fe6, role_id=9ee80134743f4c2b88525b04df2facba)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:11.355542 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5790b095-28e4-4797-b249-998a14187644 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:11.451957 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 996/1985] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 17:59:11 2022] PUT /identity/v3/projects/3f1270f74ca54396af7c8fbfcb0de4d3/users/0aab37416308423eb0ea922ad7da1fe6/roles/9ee80134743f4c2b88525b04df2facba => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:59:11.452262 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 990/1986] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 17:59:11 2022] PUT /identity/v3/projects/b8801efd93494e008bf2443408fda198/users/285a185a065e4f4f893b27144a7b5115/roles/9ee80134743f4c2b88525b04df2facba => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:59:11.463992 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ed4ccb-164e-4577-9a49-80abb15e385c None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:11.464186 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b93bdb-9ce2-47ec-9e07-50f5c6d9dc49 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:11.464279 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ed4ccb-164e-4577-9a49-80abb15e385c None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:11.464361 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b93bdb-9ce2-47ec-9e07-50f5c6d9dc49 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:11.464552 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ed4ccb-164e-4577-9a49-80abb15e385c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:11.464646 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b93bdb-9ce2-47ec-9e07-50f5c6d9dc49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:11.494742 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-a7ed4ccb-164e-4577-9a49-80abb15e385c None None] MFA Rules not processed for user `285a185a065e4f4f893b27144a7b5115`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:59:11.496050 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-a7ed4ccb-164e-4577-9a49-80abb15e385c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:11.496648 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-b2b93bdb-9ce2-47ec-9e07-50f5c6d9dc49 None None] MFA Rules not processed for user `0aab37416308423eb0ea922ad7da1fe6`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:59:11.497899 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-b2b93bdb-9ce2-47ec-9e07-50f5c6d9dc49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:11.573441 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 997/1987] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:59:11 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 17:59:11.581151 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 991/1988] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:59:11 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 17:59:11.586921 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ed4ccb-164e-4577-9a49-80abb15e385c None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:11.590950 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b93bdb-9ce2-47ec-9e07-50f5c6d9dc49 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:11.592605 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-b2b93bdb-9ce2-47ec-9e07-50f5c6d9dc49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:11.681127 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ed4ccb-164e-4577-9a49-80abb15e385c None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:11.686375 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf2acf4-f1d3-48e7-8b7b-40e79af79b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:11.687046 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf2acf4-f1d3-48e7-8b7b-40e79af79b11 admin admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:11.687908 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf2acf4-f1d3-48e7-8b7b-40e79af79b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:11.688192 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf2acf4-f1d3-48e7-8b7b-40e79af79b11 admin admin] PATH_INFO: `/v3/projects` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:11.689295 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf2acf4-f1d3-48e7-8b7b-40e79af79b11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:11.689415 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b93bdb-9ce2-47ec-9e07-50f5c6d9dc49 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:11.691171 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf2acf4-f1d3-48e7-8b7b-40e79af79b11 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:11.696765 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f31d58c-e2d0-46d5-8ad9-22b038305388 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359f5ed4eb684e769f552484ca9a34c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:11.698058 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f31d58c-e2d0-46d5-8ad9-22b038305388 service glance] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:11.698672 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f31d58c-e2d0-46d5-8ad9-22b038305388 service glance] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:11.699273 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f31d58c-e2d0-46d5-8ad9-22b038305388 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:11.715877 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f31d58c-e2d0-46d5-8ad9-22b038305388 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:11.718881 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f31d58c-e2d0-46d5-8ad9-22b038305388 service glance] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:11.738365 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 992/1989] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:59:11 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 17:59:11.781823 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 998/1990] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 14 17:59:11 2022] POST /identity/v3/projects => generated 377 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:59:11.792794 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f31d58c-e2d0-46d5-8ad9-22b038305388 service glance] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:11.809147 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f31d58c-e2d0-46d5-8ad9-22b038305388 service glance] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:11.926125 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c49304c-29de-4861-b58a-c9098fd5ec0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:11.927091 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c49304c-29de-4861-b58a-c9098fd5ec0a admin admin] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:11.927531 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c49304c-29de-4861-b58a-c9098fd5ec0a admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:11.927923 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c49304c-29de-4861-b58a-c9098fd5ec0a admin admin] PATH_INFO: `/v3/users` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:11.928793 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c49304c-29de-4861-b58a-c9098fd5ec0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:11.931409 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c49304c-29de-4861-b58a-c9098fd5ec0a admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:11.938401 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:59:12.018247 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf2acf4-f1d3-48e7-8b7b-40e79af79b11 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:12.018247 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-caf2acf4-f1d3-48e7-8b7b-40e79af79b11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:12.044065 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf2acf4-f1d3-48e7-8b7b-40e79af79b11 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:12.059986 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f439c1aa-d84b-44de-bfa8-d1a52348e2fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:12.061157 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f439c1aa-d84b-44de-bfa8-d1a52348e2fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:12.061336 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f439c1aa-d84b-44de-bfa8-d1a52348e2fc admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:12.061699 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f439c1aa-d84b-44de-bfa8-d1a52348e2fc admin admin] PATH_INFO: `/v3/projects/5a0d1ea8815e4cdba732bb43819e36e2` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:12.063118 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f439c1aa-d84b-44de-bfa8-d1a52348e2fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a0d1ea8815e4cdba732bb43819e36e2)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:12.065103 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f439c1aa-d84b-44de-bfa8-d1a52348e2fc admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:12.138751 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 993/1991] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 14 17:59:11 2022] POST /identity/v3/users => generated 289 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:59:12.139866 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c49304c-29de-4861-b58a-c9098fd5ec0a admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:12.153484 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c49304c-29de-4861-b58a-c9098fd5ec0a admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:12.159651 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8445f5f-4cf7-4458-9c25-07456f8021c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:12.160532 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8445f5f-4cf7-4458-9c25-07456f8021c1 admin admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:12.161017 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8445f5f-4cf7-4458-9c25-07456f8021c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:12.161313 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8445f5f-4cf7-4458-9c25-07456f8021c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:12.162045 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8445f5f-4cf7-4458-9c25-07456f8021c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:12.163854 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8445f5f-4cf7-4458-9c25-07456f8021c1 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:12.179828 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 994/1992] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 17:59:12 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 17:59:12.183964 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8445f5f-4cf7-4458-9c25-07456f8021c1 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:12.198404 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8445f5f-4cf7-4458-9c25-07456f8021c1 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:12.204424 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e15a101-60f3-45ca-8247-7ce3a65513cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:12.204995 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e15a101-60f3-45ca-8247-7ce3a65513cb admin admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:12.205286 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e15a101-60f3-45ca-8247-7ce3a65513cb admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:12.205573 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e15a101-60f3-45ca-8247-7ce3a65513cb admin admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:12.206303 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e15a101-60f3-45ca-8247-7ce3a65513cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:12.207957 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e15a101-60f3-45ca-8247-7ce3a65513cb admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:12.224558 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 995/1993] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 17:59:12 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 17:59:12.229732 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e15a101-60f3-45ca-8247-7ce3a65513cb admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:12.241320 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e15a101-60f3-45ca-8247-7ce3a65513cb admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:12.241634 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-f439c1aa-d84b-44de-bfa8-d1a52348e2fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a0d1ea8815e4cdba732bb43819e36e2', 'request_id': 'req-f439c1aa-d84b-44de-bfa8-d1a52348e2fc'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:12.306541 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df428eba-ef2d-4560-9f85-3c3bf931778e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:12.307491 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df428eba-ef2d-4560-9f85-3c3bf931778e admin admin] REQUEST_METHOD: `PUT` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:12.307783 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df428eba-ef2d-4560-9f85-3c3bf931778e admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:12.308059 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df428eba-ef2d-4560-9f85-3c3bf931778e admin admin] PATH_INFO: `/v3/projects/74239d5389eb44a18f8b8404efa1125a/users/9d8a5438972d4271a6b694bd7f25a451/roles/9ee80134743f4c2b88525b04df2facba` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:12.324488 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df428eba-ef2d-4560-9f85-3c3bf931778e admin admin] RBAC: Authorizing `identity:create_grant(project_id=74239d5389eb44a18f8b8404efa1125a, user_id=9d8a5438972d4271a6b694bd7f25a451, role_id=9ee80134743f4c2b88525b04df2facba)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:12.327202 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df428eba-ef2d-4560-9f85-3c3bf931778e admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:12.343387 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-f439c1aa-d84b-44de-bfa8-d1a52348e2fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a0d1ea8815e4cdba732bb43819e36e2', 'request_id': 'req-f439c1aa-d84b-44de-bfa8-d1a52348e2fc'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:12.353088 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-f439c1aa-d84b-44de-bfa8-d1a52348e2fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a0d1ea8815e4cdba732bb43819e36e2', 'request_id': 'req-f439c1aa-d84b-44de-bfa8-d1a52348e2fc'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:12.367175 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-f439c1aa-d84b-44de-bfa8-d1a52348e2fc admin admin] The token cache is being invalidate because project 5a0d1ea8815e4cdba732bb43819e36e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87019) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 17:59:12.367578 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-f439c1aa-d84b-44de-bfa8-d1a52348e2fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:12.368346 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-f439c1aa-d84b-44de-bfa8-d1a52348e2fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:12.370067 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 999/1994] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 14 17:59:12 2022] DELETE /identity/v3/projects/5a0d1ea8815e4cdba732bb43819e36e2 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:59:12.379503 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5113da32-3aa2-4745-8c0e-a3ffa1993da0 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:12.379503 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5113da32-3aa2-4745-8c0e-a3ffa1993da0 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:12.379503 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5113da32-3aa2-4745-8c0e-a3ffa1993da0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:12.407969 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-5113da32-3aa2-4745-8c0e-a3ffa1993da0 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:59:12.410186 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-5113da32-3aa2-4745-8c0e-a3ffa1993da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:12.425393 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1000/1995] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:59:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:59:12.442503 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cf23e3-a7b6-4d07-aa6f-6e4a2ceab235 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:12.442503 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cf23e3-a7b6-4d07-aa6f-6e4a2ceab235 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:12.442503 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cf23e3-a7b6-4d07-aa6f-6e4a2ceab235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:12.454522 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-32cf23e3-a7b6-4d07-aa6f-6e4a2ceab235 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:59:12.455774 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-32cf23e3-a7b6-4d07-aa6f-6e4a2ceab235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:12.465007 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1001/1996] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:59:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 17:59:12.488292 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cf23e3-a7b6-4d07-aa6f-6e4a2ceab235 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:12.498678 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cf23e3-a7b6-4d07-aa6f-6e4a2ceab235 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:12.505671 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78573c6a-ad4b-4ad0-8470-2f987c2d6db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:12.506349 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78573c6a-ad4b-4ad0-8470-2f987c2d6db5 admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:12.506633 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78573c6a-ad4b-4ad0-8470-2f987c2d6db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:12.506912 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78573c6a-ad4b-4ad0-8470-2f987c2d6db5 admin admin] PATH_INFO: `/v3/domains` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:12.507798 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78573c6a-ad4b-4ad0-8470-2f987c2d6db5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:59:12.508115 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78573c6a-ad4b-4ad0-8470-2f987c2d6db5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:12.509708 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78573c6a-ad4b-4ad0-8470-2f987c2d6db5 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:12.523079 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1002/1997] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 14 17:59:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:59:12.528652 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78573c6a-ad4b-4ad0-8470-2f987c2d6db5 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:12.540201 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78573c6a-ad4b-4ad0-8470-2f987c2d6db5 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:12.545400 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf0c207-6a1d-445b-b212-3f42dedd1a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:12.546071 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf0c207-6a1d-445b-b212-3f42dedd1a19 admin admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:12.546355 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf0c207-6a1d-445b-b212-3f42dedd1a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:12.548342 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf0c207-6a1d-445b-b212-3f42dedd1a19 admin admin] PATH_INFO: `/v3/projects` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:12.548821 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf0c207-6a1d-445b-b212-3f42dedd1a19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:12.550727 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf0c207-6a1d-445b-b212-3f42dedd1a19 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:12.719894 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 996/1998] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 17:59:12 2022] PUT /identity/v3/projects/74239d5389eb44a18f8b8404efa1125a/users/9d8a5438972d4271a6b694bd7f25a451/roles/9ee80134743f4c2b88525b04df2facba => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 17:59:12.723600 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94035c8-ec74-4a76-bb48-169a60d14d0b None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:12.724214 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94035c8-ec74-4a76-bb48-169a60d14d0b None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:12.724516 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94035c8-ec74-4a76-bb48-169a60d14d0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:12.757191 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-a94035c8-ec74-4a76-bb48-169a60d14d0b None None] MFA Rules not processed for user `9d8a5438972d4271a6b694bd7f25a451`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:59:12.758519 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-a94035c8-ec74-4a76-bb48-169a60d14d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:12.834184 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 997/1999] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:59:12 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:59:12.834184 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:59:12.846000 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1003/2000] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 14 17:59:12 2022] POST /identity/v3/projects => generated 383 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:59:12.847493 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94035c8-ec74-4a76-bb48-169a60d14d0b None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:12.848510 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf0c207-6a1d-445b-b212-3f42dedd1a19 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:12.849069 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-a94035c8-ec74-4a76-bb48-169a60d14d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:12.935282 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf0c207-6a1d-445b-b212-3f42dedd1a19 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:12.936551 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94035c8-ec74-4a76-bb48-169a60d14d0b None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:12.941910 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697ad81c-2fad-4007-b162-a3020d7a4a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:12.942155 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2ce43f-811f-49f8-a652-c2903817801e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:12.942605 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697ad81c-2fad-4007-b162-a3020d7a4a8b admin admin] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:12.942725 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2ce43f-811f-49f8-a652-c2903817801e admin admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:12.942904 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697ad81c-2fad-4007-b162-a3020d7a4a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:12.943029 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2ce43f-811f-49f8-a652-c2903817801e admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:12.943212 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697ad81c-2fad-4007-b162-a3020d7a4a8b admin admin] PATH_INFO: `/v3/projects` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:12.943338 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2ce43f-811f-49f8-a652-c2903817801e admin admin] PATH_INFO: `/v3/users` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:12.943925 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697ad81c-2fad-4007-b162-a3020d7a4a8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:12.944037 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2ce43f-811f-49f8-a652-c2903817801e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:12.946048 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697ad81c-2fad-4007-b162-a3020d7a4a8b admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:12.946172 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2ce43f-811f-49f8-a652-c2903817801e admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:13.064709 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1004/2001] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 14 17:59:12 2022] POST /identity/v3/users => generated 292 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 17:59:13.065650 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2ce43f-811f-49f8-a652-c2903817801e admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:13.077226 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2ce43f-811f-49f8-a652-c2903817801e admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:13.096009 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 998/2002] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 14 17:59:12 2022] POST /identity/v3/projects => generated 379 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 17:59:13.102557 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697ad81c-2fad-4007-b162-a3020d7a4a8b admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:13.108901 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e691fa03-e515-453e-bf34-90f20e5c800f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:13.108901 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e691fa03-e515-453e-bf34-90f20e5c800f admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:13.108901 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e691fa03-e515-453e-bf34-90f20e5c800f admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:13.108901 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e691fa03-e515-453e-bf34-90f20e5c800f admin admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:13.110266 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e691fa03-e515-453e-bf34-90f20e5c800f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:13.114453 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e691fa03-e515-453e-bf34-90f20e5c800f admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:13.139129 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1005/2003] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 17:59:13 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 14 17:59:13.146230 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e691fa03-e515-453e-bf34-90f20e5c800f admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:13.160922 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e691fa03-e515-453e-bf34-90f20e5c800f admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:13.251265 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697ad81c-2fad-4007-b162-a3020d7a4a8b admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:13.257282 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08e3253-805f-4de9-8b83-9e16e0d48c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:13.257988 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e3253-805f-4de9-8b83-9e16e0d48c44 admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:13.258369 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e3253-805f-4de9-8b83-9e16e0d48c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:13.258545 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e3253-805f-4de9-8b83-9e16e0d48c44 admin admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:13.260256 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08e3253-805f-4de9-8b83-9e16e0d48c44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:13.260910 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f1623c-f9b3-4da9-86ef-76228d04c259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:13.261858 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f1623c-f9b3-4da9-86ef-76228d04c259 admin admin] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:13.262052 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08e3253-805f-4de9-8b83-9e16e0d48c44 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:13.262467 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f1623c-f9b3-4da9-86ef-76228d04c259 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:13.263073 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f1623c-f9b3-4da9-86ef-76228d04c259 admin admin] PATH_INFO: `/v3/users` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:13.265306 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f1623c-f9b3-4da9-86ef-76228d04c259 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:13.269182 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f1623c-f9b3-4da9-86ef-76228d04c259 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:13.278849 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1006/2004] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 17:59:13 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 17:59:13.280924 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08e3253-805f-4de9-8b83-9e16e0d48c44 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:13.294717 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08e3253-805f-4de9-8b83-9e16e0d48c44 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:13.301906 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a459f1-6d32-4688-935c-fe877abbeddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:13.303198 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a459f1-6d32-4688-935c-fe877abbeddd admin admin] REQUEST_METHOD: `PUT` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:13.303198 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a459f1-6d32-4688-935c-fe877abbeddd admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:13.303445 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a459f1-6d32-4688-935c-fe877abbeddd admin admin] PATH_INFO: `/v3/projects/a8f51c28fc644e74b6f6e9663ec27a28/users/621dcddc263f48a4a0b6c41cc60dac90/roles/9ee80134743f4c2b88525b04df2facba` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:13.325001 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a459f1-6d32-4688-935c-fe877abbeddd admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8f51c28fc644e74b6f6e9663ec27a28, user_id=621dcddc263f48a4a0b6c41cc60dac90, role_id=9ee80134743f4c2b88525b04df2facba)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:13.329208 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a459f1-6d32-4688-935c-fe877abbeddd admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:13.371053 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 999/2005] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 14 17:59:13 2022] POST /identity/v3/users => generated 296 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:59:13.375701 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f1623c-f9b3-4da9-86ef-76228d04c259 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:13.390023 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f1623c-f9b3-4da9-86ef-76228d04c259 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:13.394392 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1007/2006] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 17:59:13 2022] PUT /identity/v3/projects/a8f51c28fc644e74b6f6e9663ec27a28/users/621dcddc263f48a4a0b6c41cc60dac90/roles/9ee80134743f4c2b88525b04df2facba => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 17:59:13.404704 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78117c33-35d2-4378-ae83-3bafb62d528d None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:13.404941 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78117c33-35d2-4378-ae83-3bafb62d528d None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:13.405102 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78117c33-35d2-4378-ae83-3bafb62d528d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:13.488399 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-78117c33-35d2-4378-ae83-3bafb62d528d None None] MFA Rules not processed for user `621dcddc263f48a4a0b6c41cc60dac90`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:59:13.490663 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-78117c33-35d2-4378-ae83-3bafb62d528d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:13.548755 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdd69e0-24f9-4c84-9435-4a687e8b70b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:13.548755 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdd69e0-24f9-4c84-9435-4a687e8b70b3 admin admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:13.548755 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdd69e0-24f9-4c84-9435-4a687e8b70b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:13.551364 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdd69e0-24f9-4c84-9435-4a687e8b70b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:13.552874 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdd69e0-24f9-4c84-9435-4a687e8b70b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:13.557326 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdd69e0-24f9-4c84-9435-4a687e8b70b3 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:13.595447 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1000/2007] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 17:59:13 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 14 17:59:13.599281 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1008/2008] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:59:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:59:13.600144 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdd69e0-24f9-4c84-9435-4a687e8b70b3 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:13.613282 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78117c33-35d2-4378-ae83-3bafb62d528d None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:13.614360 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdd69e0-24f9-4c84-9435-4a687e8b70b3 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:13.616085 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-78117c33-35d2-4378-ae83-3bafb62d528d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:13.620044 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fd4b76-a902-42ac-87a2-ada72c43e77f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:13.620991 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fd4b76-a902-42ac-87a2-ada72c43e77f admin admin] REQUEST_METHOD: `PUT` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:13.621282 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fd4b76-a902-42ac-87a2-ada72c43e77f admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:13.621591 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fd4b76-a902-42ac-87a2-ada72c43e77f admin admin] PATH_INFO: `/v3/projects/2c7148dc64514a2da7086c1cee1c337d/users/86d652516be74c5497a73c75b7b6a706/roles/1348580877d04014bfdec4d866b98a74` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:13.640134 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fd4b76-a902-42ac-87a2-ada72c43e77f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c7148dc64514a2da7086c1cee1c337d, user_id=86d652516be74c5497a73c75b7b6a706, role_id=1348580877d04014bfdec4d866b98a74)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:13.643881 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fd4b76-a902-42ac-87a2-ada72c43e77f admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:13.697804 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78117c33-35d2-4378-ae83-3bafb62d528d None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:13.705781 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:59:13.706792 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188c7682-2403-4f1b-b8af-b39addc19b0b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17945e7d72954b8787e0ba09a9903247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:13.707682 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188c7682-2403-4f1b-b8af-b39addc19b0b service cinder] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:13.708096 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188c7682-2403-4f1b-b8af-b39addc19b0b service cinder] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:13.708476 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188c7682-2403-4f1b-b8af-b39addc19b0b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:13.720635 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188c7682-2403-4f1b-b8af-b39addc19b0b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:13.722627 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188c7682-2403-4f1b-b8af-b39addc19b0b service cinder] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:13.737029 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1009/2009] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:59:13 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:59:13.766535 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1001/2010] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 17:59:13 2022] PUT /identity/v3/projects/2c7148dc64514a2da7086c1cee1c337d/users/86d652516be74c5497a73c75b7b6a706/roles/1348580877d04014bfdec4d866b98a74 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 17:59:13.768237 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188c7682-2403-4f1b-b8af-b39addc19b0b service cinder] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:13.778585 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188c7682-2403-4f1b-b8af-b39addc19b0b service cinder] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:13.864632 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae78853-bd0f-4049-b80e-2e314ed9805f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:13.865730 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae78853-bd0f-4049-b80e-2e314ed9805f admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:13.866188 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae78853-bd0f-4049-b80e-2e314ed9805f admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:13.866593 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae78853-bd0f-4049-b80e-2e314ed9805f admin admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:13.867888 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae78853-bd0f-4049-b80e-2e314ed9805f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:13.870748 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae78853-bd0f-4049-b80e-2e314ed9805f admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:13.885537 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1010/2011] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 17:59:13 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 17:59:13.892351 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fd4b76-a902-42ac-87a2-ada72c43e77f admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:13.910787 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fd4b76-a902-42ac-87a2-ada72c43e77f admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:13.923051 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ed50a8-4d2e-4267-bd02-1a26afa818d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:13.925354 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ed50a8-4d2e-4267-bd02-1a26afa818d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:13.925816 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ed50a8-4d2e-4267-bd02-1a26afa818d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:13.926379 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ed50a8-4d2e-4267-bd02-1a26afa818d9 admin admin] PATH_INFO: `/v3/projects/2c7148dc64514a2da7086c1cee1c337d/users/86d652516be74c5497a73c75b7b6a706/roles/1348580877d04014bfdec4d866b98a74` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:13.930420 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ed50a8-4d2e-4267-bd02-1a26afa818d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c7148dc64514a2da7086c1cee1c337d, user_id=86d652516be74c5497a73c75b7b6a706, role_id=1348580877d04014bfdec4d866b98a74)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:13.936129 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ed50a8-4d2e-4267-bd02-1a26afa818d9 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:13.958670 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1002/2012] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 17:59:13 2022] PUT /identity/v3/projects/2c7148dc64514a2da7086c1cee1c337d/users/86d652516be74c5497a73c75b7b6a706/roles/1348580877d04014bfdec4d866b98a74 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:59:13.987146 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a57a18-18c2-467d-aebb-4befc2c60a38 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:13.987146 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a57a18-18c2-467d-aebb-4befc2c60a38 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:13.987146 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a57a18-18c2-467d-aebb-4befc2c60a38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:14.020860 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-76a57a18-18c2-467d-aebb-4befc2c60a38 None None] MFA Rules not processed for user `86d652516be74c5497a73c75b7b6a706`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:59:14.022124 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-76a57a18-18c2-467d-aebb-4befc2c60a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:14.107820 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1011/2013] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:59:13 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 17:59:14.270084 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:59:14.684514 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ed50a8-4d2e-4267-bd02-1a26afa818d9 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:14.782702 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ed50a8-4d2e-4267-bd02-1a26afa818d9 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:14.787159 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0068a0d4-4486-48bd-8592-9abae1ee2d93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17945e7d72954b8787e0ba09a9903247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:14.788390 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0068a0d4-4486-48bd-8592-9abae1ee2d93 service cinder] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:14.788788 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0068a0d4-4486-48bd-8592-9abae1ee2d93 service cinder] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:14.789232 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0068a0d4-4486-48bd-8592-9abae1ee2d93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:14.801281 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0068a0d4-4486-48bd-8592-9abae1ee2d93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:14.803990 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0068a0d4-4486-48bd-8592-9abae1ee2d93 service cinder] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:14.819434 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1003/2014] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:59:14 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 17:59:14.941107 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a57a18-18c2-467d-aebb-4befc2c60a38 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:14.952730 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a57a18-18c2-467d-aebb-4befc2c60a38 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:14.957529 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04c0346-36c9-4c0a-a44a-a5eb1975a74a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17945e7d72954b8787e0ba09a9903247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:14.960682 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04c0346-36c9-4c0a-a44a-a5eb1975a74a service cinder] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:14.960682 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04c0346-36c9-4c0a-a44a-a5eb1975a74a service cinder] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:14.960682 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04c0346-36c9-4c0a-a44a-a5eb1975a74a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:14.960983 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-b04c0346-36c9-4c0a-a44a-a5eb1975a74a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:15.032749 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04c0346-36c9-4c0a-a44a-a5eb1975a74a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:15.035282 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04c0346-36c9-4c0a-a44a-a5eb1975a74a service cinder] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:15.044450 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1012/2015] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:59:14 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:59:16.165889 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:59:16.834760 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:59:18.359881 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:59:18.661974 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:59:19.160130 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:59:19.194573 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:59:19.308712 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:59:19.450284 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:59:19.571151 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:59:19.857640 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=95,keystone:DELETE=1,keystone:INSERT=4 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:59:20.069161 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:DELETE=10,keystone:SELECT=85,keystone:INSERT=5 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:59:20.126565 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:59:20.194153 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:59:20.269526 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:59:20.298165 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:59:20.421635 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:59:20.514462 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:59:20.839494 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:59:20.890177 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=5 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:59:20.948966 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:59:21.239109 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:59:21.303183 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:59:21.543423 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:59:21.612025 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:59:21.829008 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:59:22.200357 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:59:22.371832 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:59:22.491676 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:59:22.612427 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:59:22.674843 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:59:23.959879 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0068a0d4-4486-48bd-8592-9abae1ee2d93 service cinder] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:24.038467 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0068a0d4-4486-48bd-8592-9abae1ee2d93 service cinder] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:24.043570 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727106d0-d121-44c9-bbbf-8a9989d804e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:24.048190 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727106d0-d121-44c9-bbbf-8a9989d804e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:24.048190 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727106d0-d121-44c9-bbbf-8a9989d804e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:24.048190 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727106d0-d121-44c9-bbbf-8a9989d804e9 admin admin] PATH_INFO: `/v3/users/0aab37416308423eb0ea922ad7da1fe6` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:24.048190 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727106d0-d121-44c9-bbbf-8a9989d804e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0aab37416308423eb0ea922ad7da1fe6)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:24.049502 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727106d0-d121-44c9-bbbf-8a9989d804e9 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:24.301493 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-727106d0-d121-44c9-bbbf-8a9989d804e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0aab37416308423eb0ea922ad7da1fe6'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:24.302260 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-727106d0-d121-44c9-bbbf-8a9989d804e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0aab37416308423eb0ea922ad7da1fe6'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:24.302975 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-727106d0-d121-44c9-bbbf-8a9989d804e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0aab37416308423eb0ea922ad7da1fe6'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:24.388418 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-727106d0-d121-44c9-bbbf-8a9989d804e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0aab37416308423eb0ea922ad7da1fe6'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:24.399416 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-727106d0-d121-44c9-bbbf-8a9989d804e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0aab37416308423eb0ea922ad7da1fe6'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:24.445202 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1004/2016] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 14 17:59:23 2022] DELETE /identity/v3/users/0aab37416308423eb0ea922ad7da1fe6 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:59:24.449470 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791477bd-d31d-406f-b891-98b60cbe69f8 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:24.450065 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791477bd-d31d-406f-b891-98b60cbe69f8 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:24.450065 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791477bd-d31d-406f-b891-98b60cbe69f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:24.472796 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-791477bd-d31d-406f-b891-98b60cbe69f8 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:59:24.474406 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-791477bd-d31d-406f-b891-98b60cbe69f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:24.555505 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1013/2017] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:59:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:59:24.562593 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727106d0-d121-44c9-bbbf-8a9989d804e9 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:24.565003 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-727106d0-d121-44c9-bbbf-8a9989d804e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:24.636608 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727106d0-d121-44c9-bbbf-8a9989d804e9 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:24.640871 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5beb7d-4430-43dd-8163-e37904145c52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5652329c71cd431fb579d69cef933b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:24.642656 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5beb7d-4430-43dd-8163-e37904145c52 service neutron] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:24.643153 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5beb7d-4430-43dd-8163-e37904145c52 service neutron] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:24.643725 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5beb7d-4430-43dd-8163-e37904145c52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:24.654594 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5beb7d-4430-43dd-8163-e37904145c52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:24.656039 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5beb7d-4430-43dd-8163-e37904145c52 service neutron] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:24.666112 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1005/2018] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:59:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:59:24.732593 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791477bd-d31d-406f-b891-98b60cbe69f8 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:24.734783 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-791477bd-d31d-406f-b891-98b60cbe69f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:24.748708 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791477bd-d31d-406f-b891-98b60cbe69f8 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:24.755773 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91de8b56-2133-4a3c-bc72-5131a451f7c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:24.757714 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91de8b56-2133-4a3c-bc72-5131a451f7c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:24.758179 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91de8b56-2133-4a3c-bc72-5131a451f7c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:24.758476 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91de8b56-2133-4a3c-bc72-5131a451f7c9 admin admin] PATH_INFO: `/v3/users/30552d1e358c41d1b99f22ba59dbd587` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:24.760413 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91de8b56-2133-4a3c-bc72-5131a451f7c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30552d1e358c41d1b99f22ba59dbd587)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:24.762715 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91de8b56-2133-4a3c-bc72-5131a451f7c9 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:24.956217 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-91de8b56-2133-4a3c-bc72-5131a451f7c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30552d1e358c41d1b99f22ba59dbd587'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:24.957072 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-91de8b56-2133-4a3c-bc72-5131a451f7c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30552d1e358c41d1b99f22ba59dbd587'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:24.957769 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-91de8b56-2133-4a3c-bc72-5131a451f7c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30552d1e358c41d1b99f22ba59dbd587'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:25.034374 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-91de8b56-2133-4a3c-bc72-5131a451f7c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30552d1e358c41d1b99f22ba59dbd587'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:25.042151 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-91de8b56-2133-4a3c-bc72-5131a451f7c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30552d1e358c41d1b99f22ba59dbd587'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:25.062110 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1014/2019] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 14 17:59:24 2022] DELETE /identity/v3/users/30552d1e358c41d1b99f22ba59dbd587 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:59:25.138942 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5beb7d-4430-43dd-8163-e37904145c52 service neutron] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:25.141781 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-1f5beb7d-4430-43dd-8163-e37904145c52 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:25.166756 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5beb7d-4430-43dd-8163-e37904145c52 service neutron] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:25.173417 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:59:25.243158 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3386ab-5e41-4242-8d12-0cf1b1ed0144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:25.244122 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3386ab-5e41-4242-8d12-0cf1b1ed0144 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:25.244409 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3386ab-5e41-4242-8d12-0cf1b1ed0144 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:25.244775 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3386ab-5e41-4242-8d12-0cf1b1ed0144 admin admin] PATH_INFO: `/v3/projects/3f1270f74ca54396af7c8fbfcb0de4d3` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:25.246199 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3386ab-5e41-4242-8d12-0cf1b1ed0144 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f1270f74ca54396af7c8fbfcb0de4d3)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:25.248460 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3386ab-5e41-4242-8d12-0cf1b1ed0144 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:25.350596 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91de8b56-2133-4a3c-bc72-5131a451f7c9 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:25.353598 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-91de8b56-2133-4a3c-bc72-5131a451f7c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:25.366017 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91de8b56-2133-4a3c-bc72-5131a451f7c9 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:25.370766 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5885f250-4a70-404b-b870-248697eb73da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:25.371679 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5885f250-4a70-404b-b870-248697eb73da admin admin] REQUEST_METHOD: `DELETE` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:25.371962 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5885f250-4a70-404b-b870-248697eb73da admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:25.372242 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5885f250-4a70-404b-b870-248697eb73da admin admin] PATH_INFO: `/v3/projects/a58d8bbe6d8a4352bde684e9878ae6ba` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:25.373491 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5885f250-4a70-404b-b870-248697eb73da admin admin] RBAC: Authorizing `identity:delete_project(project_id=a58d8bbe6d8a4352bde684e9878ae6ba)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:25.376491 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5885f250-4a70-404b-b870-248697eb73da admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:25.412157 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-8e3386ab-5e41-4242-8d12-0cf1b1ed0144 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f1270f74ca54396af7c8fbfcb0de4d3', 'request_id': 'req-8e3386ab-5e41-4242-8d12-0cf1b1ed0144'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:25.553497 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-8e3386ab-5e41-4242-8d12-0cf1b1ed0144 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f1270f74ca54396af7c8fbfcb0de4d3', 'request_id': 'req-8e3386ab-5e41-4242-8d12-0cf1b1ed0144'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:25.562687 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-8e3386ab-5e41-4242-8d12-0cf1b1ed0144 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f1270f74ca54396af7c8fbfcb0de4d3', 'request_id': 'req-8e3386ab-5e41-4242-8d12-0cf1b1ed0144'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:25.583439 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-5885f250-4a70-404b-b870-248697eb73da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a58d8bbe6d8a4352bde684e9878ae6ba', 'request_id': 'req-5885f250-4a70-404b-b870-248697eb73da'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:25.586837 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-8e3386ab-5e41-4242-8d12-0cf1b1ed0144 admin admin] The token cache is being invalidate because project 3f1270f74ca54396af7c8fbfcb0de4d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 17:59:25.587346 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-8e3386ab-5e41-4242-8d12-0cf1b1ed0144 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:25.588383 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-8e3386ab-5e41-4242-8d12-0cf1b1ed0144 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:25.590052 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1006/2020] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 14 17:59:25 2022] DELETE /identity/v3/projects/3f1270f74ca54396af7c8fbfcb0de4d3 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:59:25.590849 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3386ab-5e41-4242-8d12-0cf1b1ed0144 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:25.592260 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-8e3386ab-5e41-4242-8d12-0cf1b1ed0144 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:25.669462 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3386ab-5e41-4242-8d12-0cf1b1ed0144 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:25.697814 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-5885f250-4a70-404b-b870-248697eb73da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a58d8bbe6d8a4352bde684e9878ae6ba', 'request_id': 'req-5885f250-4a70-404b-b870-248697eb73da'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:25.699635 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:59:25.706784 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-5885f250-4a70-404b-b870-248697eb73da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a58d8bbe6d8a4352bde684e9878ae6ba', 'request_id': 'req-5885f250-4a70-404b-b870-248697eb73da'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:25.718611 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-5885f250-4a70-404b-b870-248697eb73da admin admin] The token cache is being invalidate because project a58d8bbe6d8a4352bde684e9878ae6ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87019) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 17:59:25.719002 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-5885f250-4a70-404b-b870-248697eb73da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:25.720019 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-5885f250-4a70-404b-b870-248697eb73da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:25.721909 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1015/2021] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 14 17:59:25 2022] DELETE /identity/v3/projects/a58d8bbe6d8a4352bde684e9878ae6ba => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 17:59:25.725623 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:59:25.726716 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5885f250-4a70-404b-b870-248697eb73da admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:25.728276 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-5885f250-4a70-404b-b870-248697eb73da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:25.739151 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be48fe0-7fdb-4899-8e72-95bd52d38f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:25.740084 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be48fe0-7fdb-4899-8e72-95bd52d38f04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:25.740552 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be48fe0-7fdb-4899-8e72-95bd52d38f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:25.740839 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be48fe0-7fdb-4899-8e72-95bd52d38f04 admin admin] PATH_INFO: `/v3/users/621dcddc263f48a4a0b6c41cc60dac90` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:25.742169 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be48fe0-7fdb-4899-8e72-95bd52d38f04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=621dcddc263f48a4a0b6c41cc60dac90)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:25.744161 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be48fe0-7fdb-4899-8e72-95bd52d38f04 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:25.805960 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5885f250-4a70-404b-b870-248697eb73da admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:25.810709 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6389bf71-3eb5-41da-8ef4-173b448ec513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:25.811629 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6389bf71-3eb5-41da-8ef4-173b448ec513 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:25.811912 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6389bf71-3eb5-41da-8ef4-173b448ec513 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:25.812194 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6389bf71-3eb5-41da-8ef4-173b448ec513 admin admin] PATH_INFO: `/v3/users/9d8a5438972d4271a6b694bd7f25a451` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:25.814217 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6389bf71-3eb5-41da-8ef4-173b448ec513 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d8a5438972d4271a6b694bd7f25a451)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:25.816191 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6389bf71-3eb5-41da-8ef4-173b448ec513 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:25.947909 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-0be48fe0-7fdb-4899-8e72-95bd52d38f04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '621dcddc263f48a4a0b6c41cc60dac90'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:25.948584 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-0be48fe0-7fdb-4899-8e72-95bd52d38f04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '621dcddc263f48a4a0b6c41cc60dac90'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:25.949197 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-0be48fe0-7fdb-4899-8e72-95bd52d38f04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '621dcddc263f48a4a0b6c41cc60dac90'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:26.005874 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-0be48fe0-7fdb-4899-8e72-95bd52d38f04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '621dcddc263f48a4a0b6c41cc60dac90'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:26.013775 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-0be48fe0-7fdb-4899-8e72-95bd52d38f04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '621dcddc263f48a4a0b6c41cc60dac90'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:26.020952 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-6389bf71-3eb5-41da-8ef4-173b448ec513 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d8a5438972d4271a6b694bd7f25a451'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:26.021635 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-6389bf71-3eb5-41da-8ef4-173b448ec513 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d8a5438972d4271a6b694bd7f25a451'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:26.022288 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-6389bf71-3eb5-41da-8ef4-173b448ec513 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d8a5438972d4271a6b694bd7f25a451'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:26.032955 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1007/2022] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 14 17:59:25 2022] DELETE /identity/v3/users/621dcddc263f48a4a0b6c41cc60dac90 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:59:26.034337 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e055dd4-09ce-44cf-be7e-b20d20b2deb6 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:26.034632 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e055dd4-09ce-44cf-be7e-b20d20b2deb6 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:26.034913 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e055dd4-09ce-44cf-be7e-b20d20b2deb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:26.056974 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-9e055dd4-09ce-44cf-be7e-b20d20b2deb6 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:59:26.058239 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-9e055dd4-09ce-44cf-be7e-b20d20b2deb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:26.085793 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-6389bf71-3eb5-41da-8ef4-173b448ec513 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d8a5438972d4271a6b694bd7f25a451'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:26.093983 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-6389bf71-3eb5-41da-8ef4-173b448ec513 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d8a5438972d4271a6b694bd7f25a451'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:26.115041 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1016/2023] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 14 17:59:25 2022] DELETE /identity/v3/users/9d8a5438972d4271a6b694bd7f25a451 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:59:26.116537 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be9a417-2c26-4ba3-ab4d-d307d74ade64 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:26.116874 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be9a417-2c26-4ba3-ab4d-d307d74ade64 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:26.117204 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be9a417-2c26-4ba3-ab4d-d307d74ade64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:26.133212 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1008/2024] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:59:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:59:26.141155 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c29c1e-0618-4ed6-9a0f-a9db4083cef9 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:26.142800 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c29c1e-0618-4ed6-9a0f-a9db4083cef9 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:26.142800 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c29c1e-0618-4ed6-9a0f-a9db4083cef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:26.143286 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-3be9a417-2c26-4ba3-ab4d-d307d74ade64 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:59:26.145221 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-3be9a417-2c26-4ba3-ab4d-d307d74ade64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:26.162594 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-f9c29c1e-0618-4ed6-9a0f-a9db4083cef9 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:59:26.163879 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-f9c29c1e-0618-4ed6-9a0f-a9db4083cef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:26.215703 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1017/2025] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:59:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:59:26.226347 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be9a417-2c26-4ba3-ab4d-d307d74ade64 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:26.228607 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-3be9a417-2c26-4ba3-ab4d-d307d74ade64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:26.241910 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1009/2026] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:59:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 17:59:26.247844 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c29c1e-0618-4ed6-9a0f-a9db4083cef9 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:26.259891 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c29c1e-0618-4ed6-9a0f-a9db4083cef9 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:26.267165 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26513d81-0865-4929-8824-28d41eb2e62e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:26.268308 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26513d81-0865-4929-8824-28d41eb2e62e admin admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:26.268608 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26513d81-0865-4929-8824-28d41eb2e62e admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:26.268944 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26513d81-0865-4929-8824-28d41eb2e62e admin admin] PATH_INFO: `/v3/domains` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:26.269712 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26513d81-0865-4929-8824-28d41eb2e62e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:59:26.270035 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26513d81-0865-4929-8824-28d41eb2e62e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:26.271769 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26513d81-0865-4929-8824-28d41eb2e62e admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:26.286437 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1010/2027] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 14 17:59:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:59:26.294003 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26513d81-0865-4929-8824-28d41eb2e62e admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:26.297352 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be9a417-2c26-4ba3-ab4d-d307d74ade64 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:26.301751 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482e4d6f-9c88-4ad9-b913-27c51bc28225 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5652329c71cd431fb579d69cef933b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:26.307371 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482e4d6f-9c88-4ad9-b913-27c51bc28225 service neutron] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:26.307371 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482e4d6f-9c88-4ad9-b913-27c51bc28225 service neutron] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:26.307371 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482e4d6f-9c88-4ad9-b913-27c51bc28225 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:26.307664 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26513d81-0865-4929-8824-28d41eb2e62e admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:26.310791 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93743006-41ee-4289-9bc4-3c53ff9b1d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:26.311666 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93743006-41ee-4289-9bc4-3c53ff9b1d5b admin admin] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:26.311958 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93743006-41ee-4289-9bc4-3c53ff9b1d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:26.312328 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93743006-41ee-4289-9bc4-3c53ff9b1d5b admin admin] PATH_INFO: `/v3/projects` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:26.313136 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93743006-41ee-4289-9bc4-3c53ff9b1d5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:26.313239 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482e4d6f-9c88-4ad9-b913-27c51bc28225 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:26.314799 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482e4d6f-9c88-4ad9-b913-27c51bc28225 service neutron] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:26.315371 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93743006-41ee-4289-9bc4-3c53ff9b1d5b admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:26.325606 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1018/2028] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:59:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 17:59:26.361477 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:59:26.416459 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1011/2029] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 14 17:59:26 2022] POST /identity/v3/projects => generated 391 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:59:26.419717 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482e4d6f-9c88-4ad9-b913-27c51bc28225 service neutron] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:26.431060 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482e4d6f-9c88-4ad9-b913-27c51bc28225 service neutron] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:26.461718 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:59:26.505107 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed504ac1-e54b-4307-af38-130a89a45a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:26.506036 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed504ac1-e54b-4307-af38-130a89a45a91 admin admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:26.510421 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed504ac1-e54b-4307-af38-130a89a45a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:26.510421 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed504ac1-e54b-4307-af38-130a89a45a91 admin admin] PATH_INFO: `/v3/users` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:26.510421 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed504ac1-e54b-4307-af38-130a89a45a91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:26.510421 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed504ac1-e54b-4307-af38-130a89a45a91 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:26.652715 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93743006-41ee-4289-9bc4-3c53ff9b1d5b admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:26.654854 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-93743006-41ee-4289-9bc4-3c53ff9b1d5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:26.675674 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93743006-41ee-4289-9bc4-3c53ff9b1d5b admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:26.682134 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d81bea1-a015-4fa8-8cb9-ce183ce6fa63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:26.683532 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d81bea1-a015-4fa8-8cb9-ce183ce6fa63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:26.683941 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d81bea1-a015-4fa8-8cb9-ce183ce6fa63 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:26.684291 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d81bea1-a015-4fa8-8cb9-ce183ce6fa63 admin admin] PATH_INFO: `/v3/projects/74239d5389eb44a18f8b8404efa1125a` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:26.685595 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d81bea1-a015-4fa8-8cb9-ce183ce6fa63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74239d5389eb44a18f8b8404efa1125a)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:26.687572 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d81bea1-a015-4fa8-8cb9-ce183ce6fa63 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:26.699734 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1019/2030] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 14 17:59:26 2022] POST /identity/v3/users => generated 296 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:59:26.705994 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed504ac1-e54b-4307-af38-130a89a45a91 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:26.717408 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed504ac1-e54b-4307-af38-130a89a45a91 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:26.723904 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5b38d4-cc54-46a1-81b4-3b05af1f38a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:26.724685 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b38d4-cc54-46a1-81b4-3b05af1f38a0 admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:26.725062 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b38d4-cc54-46a1-81b4-3b05af1f38a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:26.725543 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b38d4-cc54-46a1-81b4-3b05af1f38a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:26.726367 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5b38d4-cc54-46a1-81b4-3b05af1f38a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:26.728076 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5b38d4-cc54-46a1-81b4-3b05af1f38a0 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:26.739983 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1020/2031] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 17:59:26 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 17:59:26.744290 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5b38d4-cc54-46a1-81b4-3b05af1f38a0 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:26.754724 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5b38d4-cc54-46a1-81b4-3b05af1f38a0 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:26.759643 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2d1b21-a639-44c9-9987-b4ad0f66d4b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:26.760508 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2d1b21-a639-44c9-9987-b4ad0f66d4b9 admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:26.761256 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2d1b21-a639-44c9-9987-b4ad0f66d4b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:26.761735 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2d1b21-a639-44c9-9987-b4ad0f66d4b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:26.762526 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2d1b21-a639-44c9-9987-b4ad0f66d4b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:26.764273 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2d1b21-a639-44c9-9987-b4ad0f66d4b9 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:26.776905 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1021/2032] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 17:59:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 14 17:59:26.781091 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2d1b21-a639-44c9-9987-b4ad0f66d4b9 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:26.792251 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2d1b21-a639-44c9-9987-b4ad0f66d4b9 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:26.799625 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7242dfc1-f09f-405c-b720-7839eb4c5d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:26.800784 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7242dfc1-f09f-405c-b720-7839eb4c5d48 admin admin] REQUEST_METHOD: `PUT` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:26.801076 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7242dfc1-f09f-405c-b720-7839eb4c5d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:26.801449 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7242dfc1-f09f-405c-b720-7839eb4c5d48 admin admin] PATH_INFO: `/v3/projects/6c8e2494e0744c778b32f979005ec7ab/users/7f214333671e4878bf613c26ceb1381a/roles/9ee80134743f4c2b88525b04df2facba` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:26.817945 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7242dfc1-f09f-405c-b720-7839eb4c5d48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c8e2494e0744c778b32f979005ec7ab, user_id=7f214333671e4878bf613c26ceb1381a, role_id=9ee80134743f4c2b88525b04df2facba)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:26.821009 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7242dfc1-f09f-405c-b720-7839eb4c5d48 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:26.837595 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-2d81bea1-a015-4fa8-8cb9-ce183ce6fa63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74239d5389eb44a18f8b8404efa1125a', 'request_id': 'req-2d81bea1-a015-4fa8-8cb9-ce183ce6fa63'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:26.892733 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-2d81bea1-a015-4fa8-8cb9-ce183ce6fa63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74239d5389eb44a18f8b8404efa1125a', 'request_id': 'req-2d81bea1-a015-4fa8-8cb9-ce183ce6fa63'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:26.899722 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1022/2033] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 17:59:26 2022] PUT /identity/v3/projects/6c8e2494e0744c778b32f979005ec7ab/users/7f214333671e4878bf613c26ceb1381a/roles/9ee80134743f4c2b88525b04df2facba => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 17:59:26.900484 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-2d81bea1-a015-4fa8-8cb9-ce183ce6fa63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74239d5389eb44a18f8b8404efa1125a', 'request_id': 'req-2d81bea1-a015-4fa8-8cb9-ce183ce6fa63'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:26.901106 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7242dfc1-f09f-405c-b720-7839eb4c5d48 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:26.902756 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-7242dfc1-f09f-405c-b720-7839eb4c5d48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:26.915423 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-2d81bea1-a015-4fa8-8cb9-ce183ce6fa63 admin admin] The token cache is being invalidate because project 74239d5389eb44a18f8b8404efa1125a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 17:59:26.915887 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-2d81bea1-a015-4fa8-8cb9-ce183ce6fa63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:26.916780 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-2d81bea1-a015-4fa8-8cb9-ce183ce6fa63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:26.919505 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1012/2034] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 14 17:59:26 2022] DELETE /identity/v3/projects/74239d5389eb44a18f8b8404efa1125a => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:59:26.920941 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39c6f88-38d2-44a3-952f-7beadbb4f979 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:26.921229 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39c6f88-38d2-44a3-952f-7beadbb4f979 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:26.921509 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39c6f88-38d2-44a3-952f-7beadbb4f979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:26.947940 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-c39c6f88-38d2-44a3-952f-7beadbb4f979 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:59:26.949261 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-c39c6f88-38d2-44a3-952f-7beadbb4f979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:27.006705 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7242dfc1-f09f-405c-b720-7839eb4c5d48 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:27.012035 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd8efec-fdd8-4980-aec6-2e75800fb489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:27.012912 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd8efec-fdd8-4980-aec6-2e75800fb489 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:27.013199 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd8efec-fdd8-4980-aec6-2e75800fb489 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:27.013485 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd8efec-fdd8-4980-aec6-2e75800fb489 admin admin] PATH_INFO: `/v3/projects/a8f51c28fc644e74b6f6e9663ec27a28` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:27.014832 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd8efec-fdd8-4980-aec6-2e75800fb489 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8f51c28fc644e74b6f6e9663ec27a28)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:27.018810 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd8efec-fdd8-4980-aec6-2e75800fb489 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:27.040173 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1013/2035] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:59:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:59:27.042311 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39c6f88-38d2-44a3-952f-7beadbb4f979 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:27.043710 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-c39c6f88-38d2-44a3-952f-7beadbb4f979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:27.056417 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39c6f88-38d2-44a3-952f-7beadbb4f979 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:27.062150 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602b0e36-30d3-4b55-b8fe-f20d1e4e4455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:27.063041 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602b0e36-30d3-4b55-b8fe-f20d1e4e4455 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:27.064072 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602b0e36-30d3-4b55-b8fe-f20d1e4e4455 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:27.070549 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602b0e36-30d3-4b55-b8fe-f20d1e4e4455 admin admin] PATH_INFO: `/v3/users/86d652516be74c5497a73c75b7b6a706` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:27.070549 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602b0e36-30d3-4b55-b8fe-f20d1e4e4455 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86d652516be74c5497a73c75b7b6a706)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:27.070549 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602b0e36-30d3-4b55-b8fe-f20d1e4e4455 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:27.137564 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-cbd8efec-fdd8-4980-aec6-2e75800fb489 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8f51c28fc644e74b6f6e9663ec27a28', 'request_id': 'req-cbd8efec-fdd8-4980-aec6-2e75800fb489'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:27.234514 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-cbd8efec-fdd8-4980-aec6-2e75800fb489 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8f51c28fc644e74b6f6e9663ec27a28', 'request_id': 'req-cbd8efec-fdd8-4980-aec6-2e75800fb489'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:27.242618 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-cbd8efec-fdd8-4980-aec6-2e75800fb489 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8f51c28fc644e74b6f6e9663ec27a28', 'request_id': 'req-cbd8efec-fdd8-4980-aec6-2e75800fb489'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:27.255233 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-cbd8efec-fdd8-4980-aec6-2e75800fb489 admin admin] The token cache is being invalidate because project a8f51c28fc644e74b6f6e9663ec27a28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87019) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 17:59:27.255567 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-cbd8efec-fdd8-4980-aec6-2e75800fb489 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:27.256257 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-cbd8efec-fdd8-4980-aec6-2e75800fb489 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:27.257852 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1023/2036] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 14 17:59:26 2022] DELETE /identity/v3/projects/a8f51c28fc644e74b6f6e9663ec27a28 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:59:27.258659 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd8efec-fdd8-4980-aec6-2e75800fb489 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:27.260045 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-cbd8efec-fdd8-4980-aec6-2e75800fb489 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:27.307813 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-602b0e36-30d3-4b55-b8fe-f20d1e4e4455 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86d652516be74c5497a73c75b7b6a706'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:27.308603 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-602b0e36-30d3-4b55-b8fe-f20d1e4e4455 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86d652516be74c5497a73c75b7b6a706'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:27.309305 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-602b0e36-30d3-4b55-b8fe-f20d1e4e4455 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86d652516be74c5497a73c75b7b6a706'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:27.328240 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd8efec-fdd8-4980-aec6-2e75800fb489 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:27.333182 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8bc8d3-123d-44b3-bbcf-5fc802ccaa75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5652329c71cd431fb579d69cef933b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:27.333872 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8bc8d3-123d-44b3-bbcf-5fc802ccaa75 service neutron] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:27.334310 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8bc8d3-123d-44b3-bbcf-5fc802ccaa75 service neutron] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:27.334455 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8bc8d3-123d-44b3-bbcf-5fc802ccaa75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:27.336373 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-4d8bc8d3-123d-44b3-bbcf-5fc802ccaa75 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:27.377268 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-602b0e36-30d3-4b55-b8fe-f20d1e4e4455 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86d652516be74c5497a73c75b7b6a706'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:27.385935 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-602b0e36-30d3-4b55-b8fe-f20d1e4e4455 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86d652516be74c5497a73c75b7b6a706'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:27.413348 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8bc8d3-123d-44b3-bbcf-5fc802ccaa75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:27.415046 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8bc8d3-123d-44b3-bbcf-5fc802ccaa75 service neutron] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:27.420839 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1014/2037] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 14 17:59:27 2022] DELETE /identity/v3/users/86d652516be74c5497a73c75b7b6a706 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:59:27.420839 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d4b6f9-2a73-44be-be9a-c4b11216fb29 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:27.420839 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d4b6f9-2a73-44be-be9a-c4b11216fb29 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:27.420839 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d4b6f9-2a73-44be-be9a-c4b11216fb29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:27.430617 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:59:27.444425 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-19d4b6f9-2a73-44be-be9a-c4b11216fb29 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:59:27.445059 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1024/2038] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:59:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:59:27.446064 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-19d4b6f9-2a73-44be-be9a-c4b11216fb29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:27.526123 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1015/2039] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:59:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:59:27.531268 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=84,keystone:INSERT=2,keystone:DELETE=14 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:59:27.535275 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40117f3-a6dc-4d3a-8c5f-0aa07cbaa169 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:27.535680 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40117f3-a6dc-4d3a-8c5f-0aa07cbaa169 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:27.536004 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40117f3-a6dc-4d3a-8c5f-0aa07cbaa169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:27.556109 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-f40117f3-a6dc-4d3a-8c5f-0aa07cbaa169 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:59:27.557339 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-f40117f3-a6dc-4d3a-8c5f-0aa07cbaa169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:27.566824 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1025/2040] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:59:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:59:27.571574 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d4b6f9-2a73-44be-be9a-c4b11216fb29 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:27.588986 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d4b6f9-2a73-44be-be9a-c4b11216fb29 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:27.600198 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b9b650-e6a2-4181-9f49-9fd06c2b9d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:27.601013 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b9b650-e6a2-4181-9f49-9fd06c2b9d52 admin admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:27.601426 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b9b650-e6a2-4181-9f49-9fd06c2b9d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:27.601818 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b9b650-e6a2-4181-9f49-9fd06c2b9d52 admin admin] PATH_INFO: `/v3/domains` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:27.602719 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b9b650-e6a2-4181-9f49-9fd06c2b9d52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:59:27.603625 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b9b650-e6a2-4181-9f49-9fd06c2b9d52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:27.605876 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b9b650-e6a2-4181-9f49-9fd06c2b9d52 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:27.631346 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1016/2041] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 14 17:59:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:59:27.635333 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40117f3-a6dc-4d3a-8c5f-0aa07cbaa169 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:27.647203 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40117f3-a6dc-4d3a-8c5f-0aa07cbaa169 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:27.652358 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ecd197-c554-4b5c-9bf6-65dbdb58d2a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:27.653034 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ecd197-c554-4b5c-9bf6-65dbdb58d2a7 admin admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:27.653445 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ecd197-c554-4b5c-9bf6-65dbdb58d2a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:27.653737 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ecd197-c554-4b5c-9bf6-65dbdb58d2a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:27.654717 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ecd197-c554-4b5c-9bf6-65dbdb58d2a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:27.656699 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ecd197-c554-4b5c-9bf6-65dbdb58d2a7 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:27.777605 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b9b650-e6a2-4181-9f49-9fd06c2b9d52 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:27.779507 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-17b9b650-e6a2-4181-9f49-9fd06c2b9d52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:27.794031 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1026/2042] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 14 17:59:27 2022] POST /identity/v3/projects => generated 377 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:59:27.796180 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b9b650-e6a2-4181-9f49-9fd06c2b9d52 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:27.797967 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ecd197-c554-4b5c-9bf6-65dbdb58d2a7 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:27.867380 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ecd197-c554-4b5c-9bf6-65dbdb58d2a7 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:27.872120 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24543a9-5213-4c89-a3e2-26c203fdbe4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:27.873033 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24543a9-5213-4c89-a3e2-26c203fdbe4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:27.873325 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24543a9-5213-4c89-a3e2-26c203fdbe4a admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:27.873609 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24543a9-5213-4c89-a3e2-26c203fdbe4a admin admin] PATH_INFO: `/v3/users/6621a49c8b1d42a885552b8acb18cdfd` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:27.877343 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8d0184-156d-4be2-929d-5714ae3d7966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:27.877588 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24543a9-5213-4c89-a3e2-26c203fdbe4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6621a49c8b1d42a885552b8acb18cdfd)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:27.877678 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8d0184-156d-4be2-929d-5714ae3d7966 admin admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:27.877678 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8d0184-156d-4be2-929d-5714ae3d7966 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:27.877678 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8d0184-156d-4be2-929d-5714ae3d7966 admin admin] PATH_INFO: `/v3/users` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:27.877912 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24543a9-5213-4c89-a3e2-26c203fdbe4a admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:27.877993 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8d0184-156d-4be2-929d-5714ae3d7966 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:27.879858 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8d0184-156d-4be2-929d-5714ae3d7966 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:27.978662 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1027/2043] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 14 17:59:27 2022] POST /identity/v3/users => generated 289 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 17:59:27.980634 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8d0184-156d-4be2-929d-5714ae3d7966 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:27.986490 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-1e8d0184-156d-4be2-929d-5714ae3d7966 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:27.997830 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8d0184-156d-4be2-929d-5714ae3d7966 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:28.004253 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98639a86-4633-47bb-a986-a4c9a86eaf54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:28.005140 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98639a86-4633-47bb-a986-a4c9a86eaf54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:28.005427 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98639a86-4633-47bb-a986-a4c9a86eaf54 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:28.005744 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98639a86-4633-47bb-a986-a4c9a86eaf54 admin admin] PATH_INFO: `/v3/projects/2c7148dc64514a2da7086c1cee1c337d` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:28.007016 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98639a86-4633-47bb-a986-a4c9a86eaf54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c7148dc64514a2da7086c1cee1c337d)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:28.009118 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98639a86-4633-47bb-a986-a4c9a86eaf54 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:28.262677 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-98639a86-4633-47bb-a986-a4c9a86eaf54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c7148dc64514a2da7086c1cee1c337d', 'request_id': 'req-98639a86-4633-47bb-a986-a4c9a86eaf54'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:28.265604 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-b24543a9-5213-4c89-a3e2-26c203fdbe4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6621a49c8b1d42a885552b8acb18cdfd'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:28.266904 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-b24543a9-5213-4c89-a3e2-26c203fdbe4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6621a49c8b1d42a885552b8acb18cdfd'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:28.268102 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-b24543a9-5213-4c89-a3e2-26c203fdbe4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6621a49c8b1d42a885552b8acb18cdfd'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:28.452096 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-98639a86-4633-47bb-a986-a4c9a86eaf54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c7148dc64514a2da7086c1cee1c337d', 'request_id': 'req-98639a86-4633-47bb-a986-a4c9a86eaf54'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:28.460814 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-98639a86-4633-47bb-a986-a4c9a86eaf54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c7148dc64514a2da7086c1cee1c337d', 'request_id': 'req-98639a86-4633-47bb-a986-a4c9a86eaf54'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:28.471980 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-98639a86-4633-47bb-a986-a4c9a86eaf54 admin admin] The token cache is being invalidate because project 2c7148dc64514a2da7086c1cee1c337d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87019) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 17:59:28.472273 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-98639a86-4633-47bb-a986-a4c9a86eaf54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:28.473001 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-98639a86-4633-47bb-a986-a4c9a86eaf54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:28.474554 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1028/2044] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 14 17:59:27 2022] DELETE /identity/v3/projects/2c7148dc64514a2da7086c1cee1c337d => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:59:28.475444 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98639a86-4633-47bb-a986-a4c9a86eaf54 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:28.476760 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-98639a86-4633-47bb-a986-a4c9a86eaf54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:28.550048 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98639a86-4633-47bb-a986-a4c9a86eaf54 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:28.554845 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19946e18-6bee-450a-8dfc-56cf6ec0f5c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:28.558907 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19946e18-6bee-450a-8dfc-56cf6ec0f5c7 admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:28.558907 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19946e18-6bee-450a-8dfc-56cf6ec0f5c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:28.558907 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19946e18-6bee-450a-8dfc-56cf6ec0f5c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:28.558907 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19946e18-6bee-450a-8dfc-56cf6ec0f5c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:28.558907 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19946e18-6bee-450a-8dfc-56cf6ec0f5c7 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:28.566145 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-b24543a9-5213-4c89-a3e2-26c203fdbe4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6621a49c8b1d42a885552b8acb18cdfd'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:28.570900 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1029/2045] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 17:59:28 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 17:59:28.574060 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aca875f-2b2b-4983-9abf-79989b58bd2d None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:28.574060 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aca875f-2b2b-4983-9abf-79989b58bd2d None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:28.574060 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aca875f-2b2b-4983-9abf-79989b58bd2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:28.574335 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-b24543a9-5213-4c89-a3e2-26c203fdbe4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6621a49c8b1d42a885552b8acb18cdfd'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:28.593972 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1017/2046] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 14 17:59:27 2022] DELETE /identity/v3/users/6621a49c8b1d42a885552b8acb18cdfd => generated 0 bytes in 817 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:59:28.595562 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24543a9-5213-4c89-a3e2-26c203fdbe4a admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:28.597199 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-b24543a9-5213-4c89-a3e2-26c203fdbe4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:28.603045 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-5aca875f-2b2b-4983-9abf-79989b58bd2d None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:59:28.606020 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-5aca875f-2b2b-4983-9abf-79989b58bd2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:28.684373 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24543a9-5213-4c89-a3e2-26c203fdbe4a admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:28.691906 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63499140-f322-4a94-84c7-592d48800108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:28.692739 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63499140-f322-4a94-84c7-592d48800108 admin admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:28.693089 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63499140-f322-4a94-84c7-592d48800108 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:28.693528 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63499140-f322-4a94-84c7-592d48800108 admin admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:28.694318 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63499140-f322-4a94-84c7-592d48800108 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:28.696306 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63499140-f322-4a94-84c7-592d48800108 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:28.697100 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1030/2047] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:59:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:59:28.698306 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d5b3cd-9a50-4c1b-a9f7-c57bd879cc2d None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:28.698654 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d5b3cd-9a50-4c1b-a9f7-c57bd879cc2d None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:28.698990 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d5b3cd-9a50-4c1b-a9f7-c57bd879cc2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:28.720023 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1018/2048] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 17:59:28 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 17:59:28.720023 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48aff25-42f0-41fa-b672-979573a32b6f None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:28.720023 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48aff25-42f0-41fa-b672-979573a32b6f None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:28.720023 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48aff25-42f0-41fa-b672-979573a32b6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:28.720452 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-36d5b3cd-9a50-4c1b-a9f7-c57bd879cc2d None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:59:28.720452 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-36d5b3cd-9a50-4c1b-a9f7-c57bd879cc2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:28.728712 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1031/2049] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:59:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:59:28.729338 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d5b3cd-9a50-4c1b-a9f7-c57bd879cc2d None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:28.732719 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-a48aff25-42f0-41fa-b672-979573a32b6f None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:59:28.734147 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-a48aff25-42f0-41fa-b672-979573a32b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:28.743968 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1019/2050] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:59:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:59:28.744800 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48aff25-42f0-41fa-b672-979573a32b6f None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:28.746174 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-a48aff25-42f0-41fa-b672-979573a32b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:28.748914 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d5b3cd-9a50-4c1b-a9f7-c57bd879cc2d None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:28.754479 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1f2e98-7d7b-4eaf-bdf7-26e94c24b824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:28.755487 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1f2e98-7d7b-4eaf-bdf7-26e94c24b824 admin admin] REQUEST_METHOD: `PUT` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:28.755842 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1f2e98-7d7b-4eaf-bdf7-26e94c24b824 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:28.756196 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1f2e98-7d7b-4eaf-bdf7-26e94c24b824 admin admin] PATH_INFO: `/v3/projects/34872baed02a4a18969749a02a4fede5/users/3011719a671849b79f5d8c90173cb3f5/roles/9ee80134743f4c2b88525b04df2facba` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:28.777317 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1f2e98-7d7b-4eaf-bdf7-26e94c24b824 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34872baed02a4a18969749a02a4fede5, user_id=3011719a671849b79f5d8c90173cb3f5, role_id=9ee80134743f4c2b88525b04df2facba)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:28.780205 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1f2e98-7d7b-4eaf-bdf7-26e94c24b824 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:28.787098 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:59:28.821880 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48aff25-42f0-41fa-b672-979573a32b6f None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:28.825578 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58683dec-eac0-4b9f-9739-1a4e2aa60a2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5652329c71cd431fb579d69cef933b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:28.826263 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58683dec-eac0-4b9f-9739-1a4e2aa60a2d service neutron] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:28.826555 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58683dec-eac0-4b9f-9739-1a4e2aa60a2d service neutron] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:28.826844 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58683dec-eac0-4b9f-9739-1a4e2aa60a2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:28.836844 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58683dec-eac0-4b9f-9739-1a4e2aa60a2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:28.838281 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58683dec-eac0-4b9f-9739-1a4e2aa60a2d service neutron] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:28.848798 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1020/2051] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:59:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:59:28.857332 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58683dec-eac0-4b9f-9739-1a4e2aa60a2d service neutron] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:28.859484 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58683dec-eac0-4b9f-9739-1a4e2aa60a2d service neutron] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:28.865061 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acd4683-d37d-4ff7-a98c-d7b47ec035ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:28.865746 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acd4683-d37d-4ff7-a98c-d7b47ec035ce admin admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:28.866039 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acd4683-d37d-4ff7-a98c-d7b47ec035ce admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:28.866326 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acd4683-d37d-4ff7-a98c-d7b47ec035ce admin admin] PATH_INFO: `/v3/domains` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:28.867063 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acd4683-d37d-4ff7-a98c-d7b47ec035ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:59:28.867424 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acd4683-d37d-4ff7-a98c-d7b47ec035ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:28.869038 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acd4683-d37d-4ff7-a98c-d7b47ec035ce admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:28.881428 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1021/2052] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 14 17:59:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:59:28.886032 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acd4683-d37d-4ff7-a98c-d7b47ec035ce admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:28.897688 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acd4683-d37d-4ff7-a98c-d7b47ec035ce admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:28.908352 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e296997-2512-4209-b745-35317d87af38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:28.909084 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e296997-2512-4209-b745-35317d87af38 admin admin] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:28.909374 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e296997-2512-4209-b745-35317d87af38 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:28.909843 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e296997-2512-4209-b745-35317d87af38 admin admin] PATH_INFO: `/v3/projects` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:28.910570 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e296997-2512-4209-b745-35317d87af38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:28.912588 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e296997-2512-4209-b745-35317d87af38 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:28.934498 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1032/2053] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 17:59:28 2022] PUT /identity/v3/projects/34872baed02a4a18969749a02a4fede5/users/3011719a671849b79f5d8c90173cb3f5/roles/9ee80134743f4c2b88525b04df2facba => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:59:28.944892 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00f564e-c931-4d25-b528-1dce4a98a591 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:28.945205 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00f564e-c931-4d25-b528-1dce4a98a591 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:28.945461 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00f564e-c931-4d25-b528-1dce4a98a591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:28.980267 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-d00f564e-c931-4d25-b528-1dce4a98a591 None None] MFA Rules not processed for user `3011719a671849b79f5d8c90173cb3f5`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:59:28.981492 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-d00f564e-c931-4d25-b528-1dce4a98a591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:29.039590 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1022/2054] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 14 17:59:28 2022] POST /identity/v3/projects => generated 373 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 17:59:29.043978 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e296997-2512-4209-b745-35317d87af38 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:29.057962 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1033/2055] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:59:28 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 17:59:29.059014 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00f564e-c931-4d25-b528-1dce4a98a591 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:29.126548 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e296997-2512-4209-b745-35317d87af38 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:29.131909 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465142e9-9659-4327-a505-35dcdbc14eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:29.139121 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465142e9-9659-4327-a505-35dcdbc14eb7 admin admin] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:29.139121 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465142e9-9659-4327-a505-35dcdbc14eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:29.139121 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465142e9-9659-4327-a505-35dcdbc14eb7 admin admin] PATH_INFO: `/v3/users` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:29.139121 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465142e9-9659-4327-a505-35dcdbc14eb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:29.139771 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00f564e-c931-4d25-b528-1dce4a98a591 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:29.140101 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465142e9-9659-4327-a505-35dcdbc14eb7 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:29.143065 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e335baf0-d76e-48a6-997a-318c2d6214be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:29.144047 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e335baf0-d76e-48a6-997a-318c2d6214be admin admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:29.144574 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e335baf0-d76e-48a6-997a-318c2d6214be admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:29.144856 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e335baf0-d76e-48a6-997a-318c2d6214be admin admin] PATH_INFO: `/v3/projects` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:29.146776 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e335baf0-d76e-48a6-997a-318c2d6214be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:29.149207 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e335baf0-d76e-48a6-997a-318c2d6214be admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:29.242689 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1023/2056] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 14 17:59:29 2022] POST /identity/v3/users => generated 287 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:59:29.247148 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465142e9-9659-4327-a505-35dcdbc14eb7 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:29.262447 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465142e9-9659-4327-a505-35dcdbc14eb7 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:29.268502 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec565455-3fc1-448c-a5e4-85f4d7bb2e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:29.269196 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec565455-3fc1-448c-a5e4-85f4d7bb2e80 admin admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:29.269489 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec565455-3fc1-448c-a5e4-85f4d7bb2e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:29.269777 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec565455-3fc1-448c-a5e4-85f4d7bb2e80 admin admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:29.270523 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec565455-3fc1-448c-a5e4-85f4d7bb2e80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:29.272180 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec565455-3fc1-448c-a5e4-85f4d7bb2e80 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:29.291814 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1024/2057] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 17:59:29 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 17:59:29.293161 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec565455-3fc1-448c-a5e4-85f4d7bb2e80 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:29.300833 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1034/2058] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 14 17:59:29 2022] POST /identity/v3/projects => generated 377 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 17:59:29.304581 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e335baf0-d76e-48a6-997a-318c2d6214be admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:29.308144 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec565455-3fc1-448c-a5e4-85f4d7bb2e80 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:29.371041 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2721f59e-4ceb-413b-80cd-ee1f1f75e44f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:29.372020 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2721f59e-4ceb-413b-80cd-ee1f1f75e44f admin admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:29.372460 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2721f59e-4ceb-413b-80cd-ee1f1f75e44f admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:29.372889 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2721f59e-4ceb-413b-80cd-ee1f1f75e44f admin admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:29.373821 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2721f59e-4ceb-413b-80cd-ee1f1f75e44f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:29.375534 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2721f59e-4ceb-413b-80cd-ee1f1f75e44f admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:29.378803 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e335baf0-d76e-48a6-997a-318c2d6214be admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:29.383446 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4148e83f-6153-4baf-a68c-afd59cd2d53a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:29.384276 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4148e83f-6153-4baf-a68c-afd59cd2d53a admin admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:29.384673 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4148e83f-6153-4baf-a68c-afd59cd2d53a admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:29.385183 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4148e83f-6153-4baf-a68c-afd59cd2d53a admin admin] PATH_INFO: `/v3/users` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:29.386650 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4148e83f-6153-4baf-a68c-afd59cd2d53a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:29.387670 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1025/2059] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 17:59:29 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 17:59:29.392857 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4148e83f-6153-4baf-a68c-afd59cd2d53a admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:29.393514 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2721f59e-4ceb-413b-80cd-ee1f1f75e44f admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:29.404299 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2721f59e-4ceb-413b-80cd-ee1f1f75e44f admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:29.411670 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6f8f09-7e35-4f0b-9e68-545d0a957e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:29.412489 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f8f09-7e35-4f0b-9e68-545d0a957e12 admin admin] REQUEST_METHOD: `PUT` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:29.412785 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f8f09-7e35-4f0b-9e68-545d0a957e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:29.414253 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f8f09-7e35-4f0b-9e68-545d0a957e12 admin admin] PATH_INFO: `/v3/projects/c312ee2ae2b74e7280dfc626e20fb7b7/users/9ae11208fbda4b68ac80da2ffaaa8a19/roles/9ee80134743f4c2b88525b04df2facba` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:29.430455 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:59:29.443502 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6f8f09-7e35-4f0b-9e68-545d0a957e12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c312ee2ae2b74e7280dfc626e20fb7b7, user_id=9ae11208fbda4b68ac80da2ffaaa8a19, role_id=9ee80134743f4c2b88525b04df2facba)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:29.443502 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6f8f09-7e35-4f0b-9e68-545d0a957e12 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:29.512465 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1035/2060] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 14 17:59:29 2022] POST /identity/v3/users => generated 289 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 17:59:29.512465 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4148e83f-6153-4baf-a68c-afd59cd2d53a admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:29.512747 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-4148e83f-6153-4baf-a68c-afd59cd2d53a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:29.526300 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4148e83f-6153-4baf-a68c-afd59cd2d53a admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:29.531122 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e438a82-66ea-496a-8749-1757edd2bac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:29.532612 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e438a82-66ea-496a-8749-1757edd2bac1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:29.532973 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e438a82-66ea-496a-8749-1757edd2bac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:29.533256 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e438a82-66ea-496a-8749-1757edd2bac1 admin admin] PATH_INFO: `/v3/projects/eece3051a652463590f6752a0034585c` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:29.534694 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e438a82-66ea-496a-8749-1757edd2bac1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eece3051a652463590f6752a0034585c)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:29.537176 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e438a82-66ea-496a-8749-1757edd2bac1 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:29.567388 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1026/2061] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 17:59:29 2022] PUT /identity/v3/projects/c312ee2ae2b74e7280dfc626e20fb7b7/users/9ae11208fbda4b68ac80da2ffaaa8a19/roles/9ee80134743f4c2b88525b04df2facba => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 17:59:29.568233 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6f8f09-7e35-4f0b-9e68-545d0a957e12 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:29.637507 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6f8f09-7e35-4f0b-9e68-545d0a957e12 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:29.643176 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e246f4-3ebd-451f-8af5-9517320bff4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:29.643907 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e246f4-3ebd-451f-8af5-9517320bff4f admin admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:29.644201 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e246f4-3ebd-451f-8af5-9517320bff4f admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:29.644491 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e246f4-3ebd-451f-8af5-9517320bff4f admin admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:29.645239 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e246f4-3ebd-451f-8af5-9517320bff4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:29.646879 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e246f4-3ebd-451f-8af5-9517320bff4f admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:29.660460 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1027/2062] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 17:59:29 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 17:59:29.666277 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebd4669-714d-44c9-859c-34e2c0bada10 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:29.666277 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebd4669-714d-44c9-859c-34e2c0bada10 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:29.666277 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebd4669-714d-44c9-859c-34e2c0bada10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:29.693285 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-2e438a82-66ea-496a-8749-1757edd2bac1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eece3051a652463590f6752a0034585c', 'request_id': 'req-2e438a82-66ea-496a-8749-1757edd2bac1'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:29.696139 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-4ebd4669-714d-44c9-859c-34e2c0bada10 None None] MFA Rules not processed for user `9ae11208fbda4b68ac80da2ffaaa8a19`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:59:29.697409 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-4ebd4669-714d-44c9-859c-34e2c0bada10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:29.777604 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1028/2063] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:59:29 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:59:29.778379 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebd4669-714d-44c9-859c-34e2c0bada10 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:29.822808 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-2e438a82-66ea-496a-8749-1757edd2bac1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eece3051a652463590f6752a0034585c', 'request_id': 'req-2e438a82-66ea-496a-8749-1757edd2bac1'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:29.832500 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-2e438a82-66ea-496a-8749-1757edd2bac1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eece3051a652463590f6752a0034585c', 'request_id': 'req-2e438a82-66ea-496a-8749-1757edd2bac1'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:29.845352 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebd4669-714d-44c9-859c-34e2c0bada10 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:29.845976 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-2e438a82-66ea-496a-8749-1757edd2bac1 admin admin] The token cache is being invalidate because project eece3051a652463590f6752a0034585c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87019) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 17:59:29.846285 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-2e438a82-66ea-496a-8749-1757edd2bac1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:29.846993 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-2e438a82-66ea-496a-8749-1757edd2bac1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:29.851495 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1036/2064] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 14 17:59:29 2022] DELETE /identity/v3/projects/eece3051a652463590f6752a0034585c => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:59:29.851495 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e438a82-66ea-496a-8749-1757edd2bac1 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:29.853201 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402b5b38-9a5e-4d32-b7f7-71c0da770edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:29.853413 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-2e438a82-66ea-496a-8749-1757edd2bac1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:29.853930 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b5b38-9a5e-4d32-b7f7-71c0da770edd admin admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:29.854393 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b5b38-9a5e-4d32-b7f7-71c0da770edd admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:29.854855 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b5b38-9a5e-4d32-b7f7-71c0da770edd admin admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:29.860220 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402b5b38-9a5e-4d32-b7f7-71c0da770edd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:29.865774 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402b5b38-9a5e-4d32-b7f7-71c0da770edd admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:29.871924 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e438a82-66ea-496a-8749-1757edd2bac1 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:29.879001 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c312488-a201-431a-b23d-660644d080af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:29.879921 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c312488-a201-431a-b23d-660644d080af admin admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:29.880309 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c312488-a201-431a-b23d-660644d080af admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:29.880720 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c312488-a201-431a-b23d-660644d080af admin admin] PATH_INFO: `/v3/projects` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:29.881520 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c312488-a201-431a-b23d-660644d080af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:29.883741 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c312488-a201-431a-b23d-660644d080af admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:29.915234 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1029/2065] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 17:59:29 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 17:59:29.916178 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402b5b38-9a5e-4d32-b7f7-71c0da770edd admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:29.920978 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-402b5b38-9a5e-4d32-b7f7-71c0da770edd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:29.940098 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402b5b38-9a5e-4d32-b7f7-71c0da770edd admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:29.946234 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa82d34d-a217-49ee-9513-7e8fa91251d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:29.947204 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa82d34d-a217-49ee-9513-7e8fa91251d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:29.947591 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa82d34d-a217-49ee-9513-7e8fa91251d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:29.947873 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa82d34d-a217-49ee-9513-7e8fa91251d6 admin admin] PATH_INFO: `/v3/users/0d104225eeb8478085689f5fdf52e8d7` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:29.949477 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa82d34d-a217-49ee-9513-7e8fa91251d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d104225eeb8478085689f5fdf52e8d7)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:29.952606 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa82d34d-a217-49ee-9513-7e8fa91251d6 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:30.057614 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1037/2066] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 14 17:59:29 2022] POST /identity/v3/projects => generated 373 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:59:30.057614 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c312488-a201-431a-b23d-660644d080af admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:30.057614 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-8c312488-a201-431a-b23d-660644d080af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:30.153160 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c312488-a201-431a-b23d-660644d080af admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:30.160610 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c832d81b-1f22-4520-980f-2f3fa5adaf24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:30.161672 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c832d81b-1f22-4520-980f-2f3fa5adaf24 admin admin] REQUEST_METHOD: `PUT` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:30.162088 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c832d81b-1f22-4520-980f-2f3fa5adaf24 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:30.165022 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c832d81b-1f22-4520-980f-2f3fa5adaf24 admin admin] PATH_INFO: `/v3/projects/dc3225597f4b47f6ab4c3295e8d4d10e/users/0fc14015381d4763bc538d7dce0ba3ca/roles/9ee80134743f4c2b88525b04df2facba` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:30.190255 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c832d81b-1f22-4520-980f-2f3fa5adaf24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc3225597f4b47f6ab4c3295e8d4d10e, user_id=0fc14015381d4763bc538d7dce0ba3ca, role_id=9ee80134743f4c2b88525b04df2facba)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:30.193475 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c832d81b-1f22-4520-980f-2f3fa5adaf24 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:30.246923 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-fa82d34d-a217-49ee-9513-7e8fa91251d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d104225eeb8478085689f5fdf52e8d7'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:30.247928 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-fa82d34d-a217-49ee-9513-7e8fa91251d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d104225eeb8478085689f5fdf52e8d7'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:30.249293 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-fa82d34d-a217-49ee-9513-7e8fa91251d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d104225eeb8478085689f5fdf52e8d7'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:30.303556 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1038/2067] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 17:59:30 2022] PUT /identity/v3/projects/dc3225597f4b47f6ab4c3295e8d4d10e/users/0fc14015381d4763bc538d7dce0ba3ca/roles/9ee80134743f4c2b88525b04df2facba => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:59:30.306659 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c832d81b-1f22-4520-980f-2f3fa5adaf24 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:30.306659 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-c832d81b-1f22-4520-980f-2f3fa5adaf24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:30.377538 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c832d81b-1f22-4520-980f-2f3fa5adaf24 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:30.387248 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c573a6ff-8d4d-4673-9067-efc2d93993f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:30.387991 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c573a6ff-8d4d-4673-9067-efc2d93993f9 admin admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:30.388280 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c573a6ff-8d4d-4673-9067-efc2d93993f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:30.388561 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c573a6ff-8d4d-4673-9067-efc2d93993f9 admin admin] PATH_INFO: `/v3/users` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:30.389270 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c573a6ff-8d4d-4673-9067-efc2d93993f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:30.391201 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c573a6ff-8d4d-4673-9067-efc2d93993f9 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:30.417255 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-fa82d34d-a217-49ee-9513-7e8fa91251d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d104225eeb8478085689f5fdf52e8d7'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:30.429569 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-fa82d34d-a217-49ee-9513-7e8fa91251d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d104225eeb8478085689f5fdf52e8d7'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:30.464180 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:59:30.472887 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1030/2068] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 14 17:59:29 2022] DELETE /identity/v3/users/0d104225eeb8478085689f5fdf52e8d7 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:59:30.492801 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1697eff1-94d1-4b7c-8c07-62adc5661603 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:30.493403 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1697eff1-94d1-4b7c-8c07-62adc5661603 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:30.493813 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1697eff1-94d1-4b7c-8c07-62adc5661603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:30.545804 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1039/2069] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 14 17:59:30 2022] POST /identity/v3/users => generated 293 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:59:30.550664 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c573a6ff-8d4d-4673-9067-efc2d93993f9 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:30.553642 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-1697eff1-94d1-4b7c-8c07-62adc5661603 None None] MFA Rules not processed for user `0fc14015381d4763bc538d7dce0ba3ca`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:59:30.555805 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-1697eff1-94d1-4b7c-8c07-62adc5661603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:30.572179 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c573a6ff-8d4d-4673-9067-efc2d93993f9 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:30.661506 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1031/2070] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:59:30 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:59:30.666258 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1697eff1-94d1-4b7c-8c07-62adc5661603 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:30.667802 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-1697eff1-94d1-4b7c-8c07-62adc5661603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:30.677966 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef832f5-aa16-4e35-9891-7388c9cf1ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:30.684803 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef832f5-aa16-4e35-9891-7388c9cf1ba6 admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:30.684803 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef832f5-aa16-4e35-9891-7388c9cf1ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:30.684803 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef832f5-aa16-4e35-9891-7388c9cf1ba6 admin admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:30.684803 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef832f5-aa16-4e35-9891-7388c9cf1ba6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:30.684803 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef832f5-aa16-4e35-9891-7388c9cf1ba6 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:30.706311 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1040/2071] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 17:59:30 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 17:59:30.709711 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef832f5-aa16-4e35-9891-7388c9cf1ba6 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:30.721987 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef832f5-aa16-4e35-9891-7388c9cf1ba6 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:30.727966 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c982e46-a6b2-4e73-97ae-6c0925267874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:30.728590 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c982e46-a6b2-4e73-97ae-6c0925267874 admin admin] REQUEST_METHOD: `PUT` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:30.728876 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c982e46-a6b2-4e73-97ae-6c0925267874 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:30.729163 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c982e46-a6b2-4e73-97ae-6c0925267874 admin admin] PATH_INFO: `/v3/projects/a154c204a45745e29b99234df76b4bc0/users/8262b7afca614d32b711cd3dd4ff587b/roles/1348580877d04014bfdec4d866b98a74` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:30.769989 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c982e46-a6b2-4e73-97ae-6c0925267874 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a154c204a45745e29b99234df76b4bc0, user_id=8262b7afca614d32b711cd3dd4ff587b, role_id=1348580877d04014bfdec4d866b98a74)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:30.785698 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c982e46-a6b2-4e73-97ae-6c0925267874 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:30.835794 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1697eff1-94d1-4b7c-8c07-62adc5661603 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:30.844216 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75913a93-af89-4666-b898-5fe9056ba717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:30.845785 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75913a93-af89-4666-b898-5fe9056ba717 admin admin] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:30.846299 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75913a93-af89-4666-b898-5fe9056ba717 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:30.846809 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75913a93-af89-4666-b898-5fe9056ba717 admin admin] PATH_INFO: `/v3/projects` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:30.848295 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75913a93-af89-4666-b898-5fe9056ba717 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:30.850378 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75913a93-af89-4666-b898-5fe9056ba717 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:30.921393 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1041/2072] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 17:59:30 2022] PUT /identity/v3/projects/a154c204a45745e29b99234df76b4bc0/users/8262b7afca614d32b711cd3dd4ff587b/roles/1348580877d04014bfdec4d866b98a74 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:59:30.922393 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c982e46-a6b2-4e73-97ae-6c0925267874 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:31.030347 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c982e46-a6b2-4e73-97ae-6c0925267874 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:31.039649 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1032/2073] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 14 17:59:30 2022] POST /identity/v3/projects => generated 377 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:59:31.040758 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75913a93-af89-4666-b898-5fe9056ba717 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:31.118048 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0665ad-faec-466d-925c-67b9908c8145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:31.118737 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0665ad-faec-466d-925c-67b9908c8145 admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:31.119022 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0665ad-faec-466d-925c-67b9908c8145 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:31.119333 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0665ad-faec-466d-925c-67b9908c8145 admin admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:31.120076 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0665ad-faec-466d-925c-67b9908c8145 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:31.121706 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0665ad-faec-466d-925c-67b9908c8145 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:31.136844 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1042/2074] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 17:59:30 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 17:59:31.139059 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0665ad-faec-466d-925c-67b9908c8145 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:31.141441 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75913a93-af89-4666-b898-5fe9056ba717 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:31.151987 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94fee0f-aa92-48de-86a7-42cff2ec9d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:31.151987 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94fee0f-aa92-48de-86a7-42cff2ec9d6d admin admin] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:31.151987 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94fee0f-aa92-48de-86a7-42cff2ec9d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:31.151987 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94fee0f-aa92-48de-86a7-42cff2ec9d6d admin admin] PATH_INFO: `/v3/users` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:31.152443 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94fee0f-aa92-48de-86a7-42cff2ec9d6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:31.152443 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94fee0f-aa92-48de-86a7-42cff2ec9d6d admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:31.159254 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0665ad-faec-466d-925c-67b9908c8145 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:31.170088 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9a14d9-b2b1-47b2-a15b-094bcac10751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:31.171008 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9a14d9-b2b1-47b2-a15b-094bcac10751 admin admin] REQUEST_METHOD: `PUT` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:31.171347 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9a14d9-b2b1-47b2-a15b-094bcac10751 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:31.171651 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9a14d9-b2b1-47b2-a15b-094bcac10751 admin admin] PATH_INFO: `/v3/projects/a154c204a45745e29b99234df76b4bc0/users/8262b7afca614d32b711cd3dd4ff587b/roles/1348580877d04014bfdec4d866b98a74` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:31.174700 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9a14d9-b2b1-47b2-a15b-094bcac10751 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a154c204a45745e29b99234df76b4bc0, user_id=8262b7afca614d32b711cd3dd4ff587b, role_id=1348580877d04014bfdec4d866b98a74)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:31.178559 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9a14d9-b2b1-47b2-a15b-094bcac10751 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:31.194547 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1043/2075] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 17:59:31 2022] PUT /identity/v3/projects/a154c204a45745e29b99234df76b4bc0/users/8262b7afca614d32b711cd3dd4ff587b/roles/1348580877d04014bfdec4d866b98a74 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:59:31.212949 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8e70d3-c72d-4c10-8ec1-e2b97a9464be None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:31.213449 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8e70d3-c72d-4c10-8ec1-e2b97a9464be None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:31.213909 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8e70d3-c72d-4c10-8ec1-e2b97a9464be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:31.243650 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-4f8e70d3-c72d-4c10-8ec1-e2b97a9464be None None] MFA Rules not processed for user `8262b7afca614d32b711cd3dd4ff587b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:59:31.244885 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-4f8e70d3-c72d-4c10-8ec1-e2b97a9464be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:31.289823 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1033/2076] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 14 17:59:31 2022] POST /identity/v3/users => generated 295 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 17:59:31.293108 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94fee0f-aa92-48de-86a7-42cff2ec9d6d admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:31.305314 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94fee0f-aa92-48de-86a7-42cff2ec9d6d admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:31.326641 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1044/2077] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:59:31 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 17:59:31.326641 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8e70d3-c72d-4c10-8ec1-e2b97a9464be None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:31.327492 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-4f8e70d3-c72d-4c10-8ec1-e2b97a9464be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:31.354222 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:59:31.408965 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0157ba9d-7481-4531-9169-fe5b77ee51be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:31.413366 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0157ba9d-7481-4531-9169-fe5b77ee51be admin admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:31.413366 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0157ba9d-7481-4531-9169-fe5b77ee51be admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:31.413366 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0157ba9d-7481-4531-9169-fe5b77ee51be admin admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:31.413366 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0157ba9d-7481-4531-9169-fe5b77ee51be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:31.414133 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0157ba9d-7481-4531-9169-fe5b77ee51be admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:31.431935 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8e70d3-c72d-4c10-8ec1-e2b97a9464be None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:31.433240 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1034/2078] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 17:59:31 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 17:59:31.434340 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0157ba9d-7481-4531-9169-fe5b77ee51be admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:31.439560 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-0157ba9d-7481-4531-9169-fe5b77ee51be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:31.439769 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842e9178-477f-45d4-b580-e8e8f23763ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:31.440850 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e9178-477f-45d4-b580-e8e8f23763ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:31.441254 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e9178-477f-45d4-b580-e8e8f23763ee admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:31.441593 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e9178-477f-45d4-b580-e8e8f23763ee admin admin] PATH_INFO: `/v3/projects/63930faef8184edc9c3d17e479e274f1` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:31.442935 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842e9178-477f-45d4-b580-e8e8f23763ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=63930faef8184edc9c3d17e479e274f1)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:31.444994 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842e9178-477f-45d4-b580-e8e8f23763ee admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:31.514190 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0157ba9d-7481-4531-9169-fe5b77ee51be admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:31.519414 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356bff65-bbee-42c7-84f1-d5cbe1dc9f02 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17945e7d72954b8787e0ba09a9903247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:31.520094 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356bff65-bbee-42c7-84f1-d5cbe1dc9f02 service cinder] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:31.520416 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356bff65-bbee-42c7-84f1-d5cbe1dc9f02 service cinder] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:31.520673 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356bff65-bbee-42c7-84f1-d5cbe1dc9f02 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:31.522853 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-356bff65-bbee-42c7-84f1-d5cbe1dc9f02 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:31.586608 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-842e9178-477f-45d4-b580-e8e8f23763ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63930faef8184edc9c3d17e479e274f1', 'request_id': 'req-842e9178-477f-45d4-b580-e8e8f23763ee'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:31.593272 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356bff65-bbee-42c7-84f1-d5cbe1dc9f02 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:31.594934 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356bff65-bbee-42c7-84f1-d5cbe1dc9f02 service cinder] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:31.605120 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1035/2079] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:59:31 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:59:31.605960 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356bff65-bbee-42c7-84f1-d5cbe1dc9f02 service cinder] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:31.617255 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356bff65-bbee-42c7-84f1-d5cbe1dc9f02 service cinder] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:31.686701 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-842e9178-477f-45d4-b580-e8e8f23763ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63930faef8184edc9c3d17e479e274f1', 'request_id': 'req-842e9178-477f-45d4-b580-e8e8f23763ee'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:31.691584 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72f6b94-ab37-4572-90b1-e69ef0ee8542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:31.692655 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72f6b94-ab37-4572-90b1-e69ef0ee8542 admin admin] REQUEST_METHOD: `PUT` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:31.697099 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72f6b94-ab37-4572-90b1-e69ef0ee8542 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:31.697099 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72f6b94-ab37-4572-90b1-e69ef0ee8542 admin admin] PATH_INFO: `/v3/projects/b877c1c33a1d4717aca1d02f58f84901/users/b8446cc5b1bf4778b5a8c2664fed757c/roles/1348580877d04014bfdec4d866b98a74` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:31.697529 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-842e9178-477f-45d4-b580-e8e8f23763ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63930faef8184edc9c3d17e479e274f1', 'request_id': 'req-842e9178-477f-45d4-b580-e8e8f23763ee'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:31.710963 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-842e9178-477f-45d4-b580-e8e8f23763ee admin admin] The token cache is being invalidate because project 63930faef8184edc9c3d17e479e274f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87019) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 17:59:31.711695 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-842e9178-477f-45d4-b580-e8e8f23763ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:31.712423 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-842e9178-477f-45d4-b580-e8e8f23763ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:31.715187 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1045/2080] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 14 17:59:31 2022] DELETE /identity/v3/projects/63930faef8184edc9c3d17e479e274f1 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:59:31.719251 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72f6b94-ab37-4572-90b1-e69ef0ee8542 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b877c1c33a1d4717aca1d02f58f84901, user_id=b8446cc5b1bf4778b5a8c2664fed757c, role_id=1348580877d04014bfdec4d866b98a74)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:31.726037 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c727970d-cf0d-4ef5-9629-81b909ef6208 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:31.726037 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c727970d-cf0d-4ef5-9629-81b909ef6208 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:31.726037 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c727970d-cf0d-4ef5-9629-81b909ef6208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:31.726523 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72f6b94-ab37-4572-90b1-e69ef0ee8542 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:31.763204 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-c727970d-cf0d-4ef5-9629-81b909ef6208 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:59:31.764603 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-c727970d-cf0d-4ef5-9629-81b909ef6208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:31.774240 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1046/2081] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:59:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:59:31.783891 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfbea81-2535-422a-b17a-abfb13c4dadf None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:31.784253 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfbea81-2535-422a-b17a-abfb13c4dadf None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:31.784604 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfbea81-2535-422a-b17a-abfb13c4dadf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:31.808216 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1036/2082] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 17:59:31 2022] PUT /identity/v3/projects/b877c1c33a1d4717aca1d02f58f84901/users/b8446cc5b1bf4778b5a8c2664fed757c/roles/1348580877d04014bfdec4d866b98a74 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:59:31.810965 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-5cfbea81-2535-422a-b17a-abfb13c4dadf None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:59:31.812395 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72f6b94-ab37-4572-90b1-e69ef0ee8542 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:31.813261 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-5cfbea81-2535-422a-b17a-abfb13c4dadf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:31.815277 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-f72f6b94-ab37-4572-90b1-e69ef0ee8542 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:31.923665 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1047/2083] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:59:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:59:31.931040 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfbea81-2535-422a-b17a-abfb13c4dadf None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:31.934784 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72f6b94-ab37-4572-90b1-e69ef0ee8542 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:31.942044 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262e5b07-f8fc-4805-aec8-b2c0121d5db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:31.942282 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfbea81-2535-422a-b17a-abfb13c4dadf None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:31.942498 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e5b07-f8fc-4805-aec8-b2c0121d5db3 admin admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:31.942704 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e5b07-f8fc-4805-aec8-b2c0121d5db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:31.943001 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e5b07-f8fc-4805-aec8-b2c0121d5db3 admin admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:31.944128 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262e5b07-f8fc-4805-aec8-b2c0121d5db3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:31.946350 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262e5b07-f8fc-4805-aec8-b2c0121d5db3 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:31.946848 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b876cf7c-5a45-425d-bdef-1c5c2f9543ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:31.948614 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b876cf7c-5a45-425d-bdef-1c5c2f9543ec admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:31.948915 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b876cf7c-5a45-425d-bdef-1c5c2f9543ec admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:31.949205 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b876cf7c-5a45-425d-bdef-1c5c2f9543ec admin admin] PATH_INFO: `/v3/domains` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:31.949963 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b876cf7c-5a45-425d-bdef-1c5c2f9543ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:59:31.950278 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b876cf7c-5a45-425d-bdef-1c5c2f9543ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:31.952037 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b876cf7c-5a45-425d-bdef-1c5c2f9543ec admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:31.962816 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1037/2084] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 17:59:31 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 17:59:31.971177 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262e5b07-f8fc-4805-aec8-b2c0121d5db3 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:31.982648 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1048/2085] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 14 17:59:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:59:31.987807 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b876cf7c-5a45-425d-bdef-1c5c2f9543ec admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:31.988185 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262e5b07-f8fc-4805-aec8-b2c0121d5db3 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:31.995708 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f21802f-18e5-4eca-be39-f14e01c82ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:31.997365 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f21802f-18e5-4eca-be39-f14e01c82ba7 admin admin] REQUEST_METHOD: `PUT` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:31.997869 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f21802f-18e5-4eca-be39-f14e01c82ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:31.998317 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f21802f-18e5-4eca-be39-f14e01c82ba7 admin admin] PATH_INFO: `/v3/projects/b877c1c33a1d4717aca1d02f58f84901/users/b8446cc5b1bf4778b5a8c2664fed757c/roles/1348580877d04014bfdec4d866b98a74` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:31.998917 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b876cf7c-5a45-425d-bdef-1c5c2f9543ec admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:32.002193 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f21802f-18e5-4eca-be39-f14e01c82ba7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b877c1c33a1d4717aca1d02f58f84901, user_id=b8446cc5b1bf4778b5a8c2664fed757c, role_id=1348580877d04014bfdec4d866b98a74)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:32.004789 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1d9ed4-913d-4148-84ea-3b8f4986955c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:32.005636 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1d9ed4-913d-4148-84ea-3b8f4986955c admin admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:32.005784 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f21802f-18e5-4eca-be39-f14e01c82ba7 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:32.006198 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1d9ed4-913d-4148-84ea-3b8f4986955c admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:32.006633 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1d9ed4-913d-4148-84ea-3b8f4986955c admin admin] PATH_INFO: `/v3/projects` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:32.007547 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1d9ed4-913d-4148-84ea-3b8f4986955c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:32.009611 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1d9ed4-913d-4148-84ea-3b8f4986955c admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:32.021238 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1038/2086] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 17:59:31 2022] PUT /identity/v3/projects/b877c1c33a1d4717aca1d02f58f84901/users/b8446cc5b1bf4778b5a8c2664fed757c/roles/1348580877d04014bfdec4d866b98a74 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:59:32.034878 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c19aed8-e751-49e9-9bf3-9b0aba9c4e49 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:32.035173 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c19aed8-e751-49e9-9bf3-9b0aba9c4e49 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:32.035494 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c19aed8-e751-49e9-9bf3-9b0aba9c4e49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:32.069324 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:59:32.076159 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-3c19aed8-e751-49e9-9bf3-9b0aba9c4e49 None None] MFA Rules not processed for user `b8446cc5b1bf4778b5a8c2664fed757c`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:59:32.077569 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-3c19aed8-e751-49e9-9bf3-9b0aba9c4e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:32.104614 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1049/2087] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 14 17:59:31 2022] POST /identity/v3/projects => generated 371 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:59:32.109587 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1d9ed4-913d-4148-84ea-3b8f4986955c admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:32.230599 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1d9ed4-913d-4148-84ea-3b8f4986955c admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:32.235840 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1039/2088] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:59:32 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:59:32.236880 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6f2ae2-6361-4f66-8b80-6ae07467ec4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:32.237583 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6f2ae2-6361-4f66-8b80-6ae07467ec4d admin admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:32.238259 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6f2ae2-6361-4f66-8b80-6ae07467ec4d admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:32.238259 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6f2ae2-6361-4f66-8b80-6ae07467ec4d admin admin] PATH_INFO: `/v3/users` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:32.238958 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6f2ae2-6361-4f66-8b80-6ae07467ec4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:32.242301 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6f2ae2-6361-4f66-8b80-6ae07467ec4d admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:32.248877 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c19aed8-e751-49e9-9bf3-9b0aba9c4e49 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:32.252326 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-3c19aed8-e751-49e9-9bf3-9b0aba9c4e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:32.327992 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c19aed8-e751-49e9-9bf3-9b0aba9c4e49 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:32.359014 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1050/2089] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 14 17:59:32 2022] POST /identity/v3/users => generated 286 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:59:32.360990 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6f2ae2-6361-4f66-8b80-6ae07467ec4d admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:32.372849 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6f2ae2-6361-4f66-8b80-6ae07467ec4d admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:32.379807 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70b31e2-02a4-457f-8045-bab2adcf88bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:32.380592 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70b31e2-02a4-457f-8045-bab2adcf88bb admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:32.381346 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70b31e2-02a4-457f-8045-bab2adcf88bb admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:32.381628 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70b31e2-02a4-457f-8045-bab2adcf88bb admin admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:32.382812 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70b31e2-02a4-457f-8045-bab2adcf88bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:32.402261 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70b31e2-02a4-457f-8045-bab2adcf88bb admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:32.402489 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a29bdb-7543-40c6-9eac-401b4f342879 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17945e7d72954b8787e0ba09a9903247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:32.402489 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a29bdb-7543-40c6-9eac-401b4f342879 service cinder] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:32.402489 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a29bdb-7543-40c6-9eac-401b4f342879 service cinder] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:32.402731 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a29bdb-7543-40c6-9eac-401b4f342879 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:32.405520 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-f9a29bdb-7543-40c6-9eac-401b4f342879 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:32.414483 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1051/2090] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 17:59:32 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 17:59:32.418859 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70b31e2-02a4-457f-8045-bab2adcf88bb admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:32.436683 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70b31e2-02a4-457f-8045-bab2adcf88bb admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:32.445699 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ded768-63a2-4f03-b243-48b5b29f1162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:32.446614 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ded768-63a2-4f03-b243-48b5b29f1162 admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:32.446909 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ded768-63a2-4f03-b243-48b5b29f1162 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:32.447191 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ded768-63a2-4f03-b243-48b5b29f1162 admin admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:32.447989 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ded768-63a2-4f03-b243-48b5b29f1162 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:32.449744 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ded768-63a2-4f03-b243-48b5b29f1162 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:32.475717 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1052/2091] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 17:59:32 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 17:59:32.476889 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ded768-63a2-4f03-b243-48b5b29f1162 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:32.488314 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a29bdb-7543-40c6-9eac-401b4f342879 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:32.489511 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ded768-63a2-4f03-b243-48b5b29f1162 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:32.489790 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a29bdb-7543-40c6-9eac-401b4f342879 service cinder] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:32.500003 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1040/2092] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:59:32 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:59:32.504244 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a67762-edb0-4c4f-9fed-93c8c7a98081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:32.507168 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a67762-edb0-4c4f-9fed-93c8c7a98081 admin admin] REQUEST_METHOD: `PUT` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:32.507168 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a67762-edb0-4c4f-9fed-93c8c7a98081 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:32.507168 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a67762-edb0-4c4f-9fed-93c8c7a98081 admin admin] PATH_INFO: `/v3/projects/e61f1a1a1d434fc295f07d349a416d08/users/262542074f754f0787899756038196ac/roles/9ee80134743f4c2b88525b04df2facba` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:32.547266 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a67762-edb0-4c4f-9fed-93c8c7a98081 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e61f1a1a1d434fc295f07d349a416d08, user_id=262542074f754f0787899756038196ac, role_id=9ee80134743f4c2b88525b04df2facba)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:32.551893 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a67762-edb0-4c4f-9fed-93c8c7a98081 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:32.666289 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1053/2093] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 17:59:32 2022] PUT /identity/v3/projects/e61f1a1a1d434fc295f07d349a416d08/users/262542074f754f0787899756038196ac/roles/9ee80134743f4c2b88525b04df2facba => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:59:32.679950 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c75ec27-421f-4814-9d27-9a37af917727 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:32.680246 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c75ec27-421f-4814-9d27-9a37af917727 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:32.680533 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c75ec27-421f-4814-9d27-9a37af917727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:32.747921 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-4c75ec27-421f-4814-9d27-9a37af917727 None None] MFA Rules not processed for user `262542074f754f0787899756038196ac`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:59:32.747921 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-4c75ec27-421f-4814-9d27-9a37af917727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:32.839047 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1041/2094] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:59:32 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:59:32.843494 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a67762-edb0-4c4f-9fed-93c8c7a98081 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:32.892117 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:59:32.933729 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a67762-edb0-4c4f-9fed-93c8c7a98081 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:32.939767 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8600a655-add7-41e5-82b5-095d86903be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:32.941231 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8600a655-add7-41e5-82b5-095d86903be5 admin admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:32.941231 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8600a655-add7-41e5-82b5-095d86903be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:32.941371 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8600a655-add7-41e5-82b5-095d86903be5 admin admin] PATH_INFO: `/v3/projects` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:32.942138 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8600a655-add7-41e5-82b5-095d86903be5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:32.944240 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8600a655-add7-41e5-82b5-095d86903be5 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:33.069992 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1054/2095] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 14 17:59:32 2022] POST /identity/v3/projects => generated 373 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:59:33.074640 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c75ec27-421f-4814-9d27-9a37af917727 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:33.087371 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c75ec27-421f-4814-9d27-9a37af917727 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:33.164034 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e4f3ca-a029-4633-914b-a7d30331c69b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:33.165223 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e4f3ca-a029-4633-914b-a7d30331c69b admin admin] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:33.165666 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e4f3ca-a029-4633-914b-a7d30331c69b admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:33.166134 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e4f3ca-a029-4633-914b-a7d30331c69b admin admin] PATH_INFO: `/v3/users` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:33.166986 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e4f3ca-a029-4633-914b-a7d30331c69b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:33.169215 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e4f3ca-a029-4633-914b-a7d30331c69b admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:33.286819 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1042/2096] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 14 17:59:33 2022] POST /identity/v3/users => generated 293 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:59:33.288145 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8600a655-add7-41e5-82b5-095d86903be5 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:33.301914 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8600a655-add7-41e5-82b5-095d86903be5 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:33.311701 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46613e81-dfea-406d-8fa9-a0a7fbe75861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:33.313755 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46613e81-dfea-406d-8fa9-a0a7fbe75861 admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:33.313755 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46613e81-dfea-406d-8fa9-a0a7fbe75861 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:33.313755 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46613e81-dfea-406d-8fa9-a0a7fbe75861 admin admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:33.316292 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46613e81-dfea-406d-8fa9-a0a7fbe75861 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:33.317929 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46613e81-dfea-406d-8fa9-a0a7fbe75861 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:33.337654 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1055/2097] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 17:59:33 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 17:59:33.341983 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e4f3ca-a029-4633-914b-a7d30331c69b admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:33.352913 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e4f3ca-a029-4633-914b-a7d30331c69b admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:33.358093 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f69b9e-d349-4824-9480-ddee0b920c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:33.359056 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f69b9e-d349-4824-9480-ddee0b920c05 admin admin] REQUEST_METHOD: `PUT` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:33.359446 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f69b9e-d349-4824-9480-ddee0b920c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:33.359798 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f69b9e-d349-4824-9480-ddee0b920c05 admin admin] PATH_INFO: `/v3/projects/9226519f954c49578add0253570e9b63/users/5533d1acd4384f2da0ceb75c51b6db62/roles/1348580877d04014bfdec4d866b98a74` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:33.369052 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:59:33.385015 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f69b9e-d349-4824-9480-ddee0b920c05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9226519f954c49578add0253570e9b63, user_id=5533d1acd4384f2da0ceb75c51b6db62, role_id=1348580877d04014bfdec4d866b98a74)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:33.388252 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f69b9e-d349-4824-9480-ddee0b920c05 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:33.477520 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1043/2098] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 17:59:33 2022] PUT /identity/v3/projects/9226519f954c49578add0253570e9b63/users/5533d1acd4384f2da0ceb75c51b6db62/roles/1348580877d04014bfdec4d866b98a74 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:59:33.481599 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46613e81-dfea-406d-8fa9-a0a7fbe75861 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:33.497489 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46613e81-dfea-406d-8fa9-a0a7fbe75861 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:33.572978 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95df1dfe-2382-4c40-a7a4-31dda3522974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:33.573749 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95df1dfe-2382-4c40-a7a4-31dda3522974 admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:33.574043 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95df1dfe-2382-4c40-a7a4-31dda3522974 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:33.574330 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95df1dfe-2382-4c40-a7a4-31dda3522974 admin admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:33.575350 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95df1dfe-2382-4c40-a7a4-31dda3522974 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:33.577277 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95df1dfe-2382-4c40-a7a4-31dda3522974 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:33.593364 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1056/2099] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 17:59:33 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 17:59:33.594041 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f69b9e-d349-4824-9480-ddee0b920c05 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:33.615546 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f69b9e-d349-4824-9480-ddee0b920c05 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:33.620891 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8550e486-b0ac-4636-8ed9-75c2221e8e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:33.621743 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8550e486-b0ac-4636-8ed9-75c2221e8e14 admin admin] REQUEST_METHOD: `PUT` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:33.622103 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8550e486-b0ac-4636-8ed9-75c2221e8e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:33.622302 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8550e486-b0ac-4636-8ed9-75c2221e8e14 admin admin] PATH_INFO: `/v3/projects/9226519f954c49578add0253570e9b63/users/5533d1acd4384f2da0ceb75c51b6db62/roles/1348580877d04014bfdec4d866b98a74` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:33.624593 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8550e486-b0ac-4636-8ed9-75c2221e8e14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9226519f954c49578add0253570e9b63, user_id=5533d1acd4384f2da0ceb75c51b6db62, role_id=1348580877d04014bfdec4d866b98a74)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:33.634729 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8550e486-b0ac-4636-8ed9-75c2221e8e14 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:33.647851 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1044/2100] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 17:59:33 2022] PUT /identity/v3/projects/9226519f954c49578add0253570e9b63/users/5533d1acd4384f2da0ceb75c51b6db62/roles/1348580877d04014bfdec4d866b98a74 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 17:59:33.662501 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369a7ed4-2011-4cb4-a318-3d8bcd9af871 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:33.662501 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369a7ed4-2011-4cb4-a318-3d8bcd9af871 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:33.662501 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369a7ed4-2011-4cb4-a318-3d8bcd9af871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:33.700333 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-369a7ed4-2011-4cb4-a318-3d8bcd9af871 None None] MFA Rules not processed for user `5533d1acd4384f2da0ceb75c51b6db62`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:59:33.702467 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-369a7ed4-2011-4cb4-a318-3d8bcd9af871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:33.804601 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1057/2101] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:59:33 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:59:33.816274 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8550e486-b0ac-4636-8ed9-75c2221e8e14 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:33.818032 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-8550e486-b0ac-4636-8ed9-75c2221e8e14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:33.928427 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8550e486-b0ac-4636-8ed9-75c2221e8e14 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:33.939738 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e205f592-b9ba-4d98-befe-9238ab2f1f25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17945e7d72954b8787e0ba09a9903247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:33.941016 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e205f592-b9ba-4d98-befe-9238ab2f1f25 service cinder] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:33.947138 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e205f592-b9ba-4d98-befe-9238ab2f1f25 service cinder] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:33.947138 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e205f592-b9ba-4d98-befe-9238ab2f1f25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:33.959539 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e205f592-b9ba-4d98-befe-9238ab2f1f25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:33.961011 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e205f592-b9ba-4d98-befe-9238ab2f1f25 service cinder] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:33.973396 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1045/2102] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:59:33 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:59:34.057909 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:59:34.777175 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369a7ed4-2011-4cb4-a318-3d8bcd9af871 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:34.794663 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369a7ed4-2011-4cb4-a318-3d8bcd9af871 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:34.802765 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736398fa-47ff-4ac9-8461-edd170e643ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17945e7d72954b8787e0ba09a9903247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:34.803935 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736398fa-47ff-4ac9-8461-edd170e643ec service cinder] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:34.804571 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736398fa-47ff-4ac9-8461-edd170e643ec service cinder] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:34.805009 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736398fa-47ff-4ac9-8461-edd170e643ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:34.808295 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-736398fa-47ff-4ac9-8461-edd170e643ec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:34.908101 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736398fa-47ff-4ac9-8461-edd170e643ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:34.908101 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736398fa-47ff-4ac9-8461-edd170e643ec service cinder] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:34.920514 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1058/2103] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:59:34 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:59:34.962237 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e205f592-b9ba-4d98-befe-9238ab2f1f25 service cinder] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:34.963773 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-e205f592-b9ba-4d98-befe-9238ab2f1f25 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:35.083500 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e205f592-b9ba-4d98-befe-9238ab2f1f25 service cinder] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:35.089115 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617a5987-3f39-497e-b9a2-866c697bb810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:35.093445 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617a5987-3f39-497e-b9a2-866c697bb810 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:35.093972 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617a5987-3f39-497e-b9a2-866c697bb810 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:35.095073 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617a5987-3f39-497e-b9a2-866c697bb810 admin admin] PATH_INFO: `/v3/users/9ae11208fbda4b68ac80da2ffaaa8a19` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:35.099695 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617a5987-3f39-497e-b9a2-866c697bb810 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ae11208fbda4b68ac80da2ffaaa8a19)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:35.103250 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617a5987-3f39-497e-b9a2-866c697bb810 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:35.206977 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eec686c-be25-4c23-a448-b1b67a067c01 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:35.207292 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eec686c-be25-4c23-a448-b1b67a067c01 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:35.207579 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eec686c-be25-4c23-a448-b1b67a067c01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:35.243332 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-4eec686c-be25-4c23-a448-b1b67a067c01 None None] MFA Rules not processed for user `7f214333671e4878bf613c26ceb1381a`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:59:35.244682 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-4eec686c-be25-4c23-a448-b1b67a067c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:35.318802 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1059/2104] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:59:35 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:59:35.329994 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f588185b-ed5f-4e90-a009-a1a5a4aa12da None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:35.329994 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f588185b-ed5f-4e90-a009-a1a5a4aa12da None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:35.330356 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f588185b-ed5f-4e90-a009-a1a5a4aa12da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:35.348378 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-f588185b-ed5f-4e90-a009-a1a5a4aa12da None None] MFA Rules not processed for user `7f214333671e4878bf613c26ceb1381a`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:59:35.349602 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-f588185b-ed5f-4e90-a009-a1a5a4aa12da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:35.356733 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1060/2105] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:59:35 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 17:59:35.377661 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f588185b-ed5f-4e90-a009-a1a5a4aa12da None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:35.379134 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-f588185b-ed5f-4e90-a009-a1a5a4aa12da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:35.460729 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-617a5987-3f39-497e-b9a2-866c697bb810 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ae11208fbda4b68ac80da2ffaaa8a19'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:35.461323 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f588185b-ed5f-4e90-a009-a1a5a4aa12da None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:35.461793 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-617a5987-3f39-497e-b9a2-866c697bb810 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ae11208fbda4b68ac80da2ffaaa8a19'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:35.462637 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-617a5987-3f39-497e-b9a2-866c697bb810 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ae11208fbda4b68ac80da2ffaaa8a19'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:35.468764 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de922f3-d0b5-418a-a7ae-e5ce235fb220 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4696d396adb495ab300a9a5a5727595', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:35.469951 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de922f3-d0b5-418a-a7ae-e5ce235fb220 service nova] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:35.470363 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de922f3-d0b5-418a-a7ae-e5ce235fb220 service nova] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:35.470796 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de922f3-d0b5-418a-a7ae-e5ce235fb220 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:35.472750 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-8de922f3-d0b5-418a-a7ae-e5ce235fb220 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:35.483978 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de922f3-d0b5-418a-a7ae-e5ce235fb220 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:35.486244 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de922f3-d0b5-418a-a7ae-e5ce235fb220 service nova] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:35.496506 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1061/2106] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:59:35 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 17:59:35.497339 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de922f3-d0b5-418a-a7ae-e5ce235fb220 service nova] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:35.504161 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-8de922f3-d0b5-418a-a7ae-e5ce235fb220 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:35.512639 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de922f3-d0b5-418a-a7ae-e5ce235fb220 service nova] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:35.518417 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa05d404-904d-4ae2-9a24-730f7353c81c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:35.519315 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa05d404-904d-4ae2-9a24-730f7353c81c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:35.519644 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa05d404-904d-4ae2-9a24-730f7353c81c admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:35.519919 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa05d404-904d-4ae2-9a24-730f7353c81c admin admin] PATH_INFO: `/v3/users/262542074f754f0787899756038196ac` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:35.521123 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa05d404-904d-4ae2-9a24-730f7353c81c admin admin] RBAC: Authorizing `identity:delete_user(user_id=262542074f754f0787899756038196ac)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:35.523106 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa05d404-904d-4ae2-9a24-730f7353c81c admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:35.538736 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:59:35.607474 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-617a5987-3f39-497e-b9a2-866c697bb810 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ae11208fbda4b68ac80da2ffaaa8a19'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:35.626187 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-617a5987-3f39-497e-b9a2-866c697bb810 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ae11208fbda4b68ac80da2ffaaa8a19'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:35.668177 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1046/2107] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 14 17:59:34 2022] DELETE /identity/v3/users/9ae11208fbda4b68ac80da2ffaaa8a19 => generated 0 bytes in 706 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:59:35.673521 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c15f96-ae02-4239-ac96-51b0e538b778 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:35.680079 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c15f96-ae02-4239-ac96-51b0e538b778 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:35.680552 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c15f96-ae02-4239-ac96-51b0e538b778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:35.725353 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-37c15f96-ae02-4239-ac96-51b0e538b778 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:59:35.730078 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-37c15f96-ae02-4239-ac96-51b0e538b778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:35.821015 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1047/2108] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:59:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:59:35.834506 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c15f96-ae02-4239-ac96-51b0e538b778 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:35.836002 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-37c15f96-ae02-4239-ac96-51b0e538b778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:35.863024 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-aa05d404-904d-4ae2-9a24-730f7353c81c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '262542074f754f0787899756038196ac'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:35.864303 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-aa05d404-904d-4ae2-9a24-730f7353c81c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '262542074f754f0787899756038196ac'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:35.865135 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-aa05d404-904d-4ae2-9a24-730f7353c81c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '262542074f754f0787899756038196ac'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:35.912178 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c15f96-ae02-4239-ac96-51b0e538b778 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:35.916598 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219317fa-fe82-4bc5-a83e-ad371d9204ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5652329c71cd431fb579d69cef933b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:35.916995 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219317fa-fe82-4bc5-a83e-ad371d9204ab service neutron] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:35.917284 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219317fa-fe82-4bc5-a83e-ad371d9204ab service neutron] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:35.917572 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219317fa-fe82-4bc5-a83e-ad371d9204ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:35.919511 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-219317fa-fe82-4bc5-a83e-ad371d9204ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:35.933743 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219317fa-fe82-4bc5-a83e-ad371d9204ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:35.944682 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219317fa-fe82-4bc5-a83e-ad371d9204ab service neutron] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:35.950793 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1048/2109] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:59:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 17:59:35.966704 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-aa05d404-904d-4ae2-9a24-730f7353c81c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '262542074f754f0787899756038196ac'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:35.980987 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-aa05d404-904d-4ae2-9a24-730f7353c81c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '262542074f754f0787899756038196ac'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:36.021993 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1062/2110] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 14 17:59:35 2022] DELETE /identity/v3/users/262542074f754f0787899756038196ac => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:59:36.033407 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721a6b16-d2d6-4df7-949d-bb5de5572624 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:36.033407 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721a6b16-d2d6-4df7-949d-bb5de5572624 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:36.033407 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721a6b16-d2d6-4df7-949d-bb5de5572624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:36.062211 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-721a6b16-d2d6-4df7-949d-bb5de5572624 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:59:36.062211 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-721a6b16-d2d6-4df7-949d-bb5de5572624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:36.144523 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1049/2111] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:59:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:59:36.153892 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa05d404-904d-4ae2-9a24-730f7353c81c admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:36.155462 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-aa05d404-904d-4ae2-9a24-730f7353c81c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:36.223349 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa05d404-904d-4ae2-9a24-730f7353c81c admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:36.229508 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00f8ea1-37fb-442e-bff0-eed764012aa7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5652329c71cd431fb579d69cef933b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:36.230301 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00f8ea1-37fb-442e-bff0-eed764012aa7 service neutron] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:36.231250 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00f8ea1-37fb-442e-bff0-eed764012aa7 service neutron] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:36.231558 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00f8ea1-37fb-442e-bff0-eed764012aa7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:36.242853 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00f8ea1-37fb-442e-bff0-eed764012aa7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:36.244476 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00f8ea1-37fb-442e-bff0-eed764012aa7 service neutron] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:36.263491 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1063/2112] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:59:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:59:36.474054 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90195099-b3f7-461a-bbd9-6d162a34bc62 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:36.479562 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90195099-b3f7-461a-bbd9-6d162a34bc62 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:36.479562 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90195099-b3f7-461a-bbd9-6d162a34bc62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:36.527194 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-90195099-b3f7-461a-bbd9-6d162a34bc62 None None] MFA Rules not processed for user `7f214333671e4878bf613c26ceb1381a`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:59:36.529704 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-90195099-b3f7-461a-bbd9-6d162a34bc62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:36.618828 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1050/2113] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:59:36 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:59:36.722274 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00f8ea1-37fb-442e-bff0-eed764012aa7 service neutron] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:36.724354 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-e00f8ea1-37fb-442e-bff0-eed764012aa7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:36.744411 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00f8ea1-37fb-442e-bff0-eed764012aa7 service neutron] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:36.750538 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5279a36a-6308-4b66-94e7-c191f8d8adda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:36.754080 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5279a36a-6308-4b66-94e7-c191f8d8adda admin admin] REQUEST_METHOD: `DELETE` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:36.754547 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5279a36a-6308-4b66-94e7-c191f8d8adda admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:36.754957 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5279a36a-6308-4b66-94e7-c191f8d8adda admin admin] PATH_INFO: `/v3/projects/c312ee2ae2b74e7280dfc626e20fb7b7` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:36.757311 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5279a36a-6308-4b66-94e7-c191f8d8adda admin admin] RBAC: Authorizing `identity:delete_project(project_id=c312ee2ae2b74e7280dfc626e20fb7b7)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:36.760566 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5279a36a-6308-4b66-94e7-c191f8d8adda admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:36.905347 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90195099-b3f7-461a-bbd9-6d162a34bc62 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:36.907573 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-90195099-b3f7-461a-bbd9-6d162a34bc62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:36.933447 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90195099-b3f7-461a-bbd9-6d162a34bc62 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:36.952822 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-5279a36a-6308-4b66-94e7-c191f8d8adda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c312ee2ae2b74e7280dfc626e20fb7b7', 'request_id': 'req-5279a36a-6308-4b66-94e7-c191f8d8adda'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:37.012455 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6d58e6-60bf-4dd0-b7c5-0f60e257b5c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:37.013985 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6d58e6-60bf-4dd0-b7c5-0f60e257b5c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:37.014288 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6d58e6-60bf-4dd0-b7c5-0f60e257b5c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:37.014824 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6d58e6-60bf-4dd0-b7c5-0f60e257b5c5 admin admin] PATH_INFO: `/v3/projects/e61f1a1a1d434fc295f07d349a416d08` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:37.016691 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6d58e6-60bf-4dd0-b7c5-0f60e257b5c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e61f1a1a1d434fc295f07d349a416d08)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:37.019464 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6d58e6-60bf-4dd0-b7c5-0f60e257b5c5 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:37.069134 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-5279a36a-6308-4b66-94e7-c191f8d8adda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c312ee2ae2b74e7280dfc626e20fb7b7', 'request_id': 'req-5279a36a-6308-4b66-94e7-c191f8d8adda'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:37.077525 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-5279a36a-6308-4b66-94e7-c191f8d8adda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c312ee2ae2b74e7280dfc626e20fb7b7', 'request_id': 'req-5279a36a-6308-4b66-94e7-c191f8d8adda'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:37.109532 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-5279a36a-6308-4b66-94e7-c191f8d8adda admin admin] The token cache is being invalidate because project c312ee2ae2b74e7280dfc626e20fb7b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87019) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 17:59:37.110686 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-5279a36a-6308-4b66-94e7-c191f8d8adda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:37.114422 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-5279a36a-6308-4b66-94e7-c191f8d8adda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:37.119391 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1064/2114] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 14 17:59:36 2022] DELETE /identity/v3/projects/c312ee2ae2b74e7280dfc626e20fb7b7 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:59:37.123268 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5279a36a-6308-4b66-94e7-c191f8d8adda admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:37.127341 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-5279a36a-6308-4b66-94e7-c191f8d8adda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:37.153693 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5279a36a-6308-4b66-94e7-c191f8d8adda admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:37.167452 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc2fca4-cb2b-4bcf-9417-9755ce5398ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:37.169719 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc2fca4-cb2b-4bcf-9417-9755ce5398ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:37.170373 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc2fca4-cb2b-4bcf-9417-9755ce5398ec admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:37.171985 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc2fca4-cb2b-4bcf-9417-9755ce5398ec admin admin] PATH_INFO: `/v3/users/8262b7afca614d32b711cd3dd4ff587b` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:37.176317 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc2fca4-cb2b-4bcf-9417-9755ce5398ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=8262b7afca614d32b711cd3dd4ff587b)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:37.184325 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc2fca4-cb2b-4bcf-9417-9755ce5398ec admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:37.190248 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-0e6d58e6-60bf-4dd0-b7c5-0f60e257b5c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e61f1a1a1d434fc295f07d349a416d08', 'request_id': 'req-0e6d58e6-60bf-4dd0-b7c5-0f60e257b5c5'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:37.315527 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-0e6d58e6-60bf-4dd0-b7c5-0f60e257b5c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e61f1a1a1d434fc295f07d349a416d08', 'request_id': 'req-0e6d58e6-60bf-4dd0-b7c5-0f60e257b5c5'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:37.322068 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-0e6d58e6-60bf-4dd0-b7c5-0f60e257b5c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e61f1a1a1d434fc295f07d349a416d08', 'request_id': 'req-0e6d58e6-60bf-4dd0-b7c5-0f60e257b5c5'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:37.334524 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-0e6d58e6-60bf-4dd0-b7c5-0f60e257b5c5 admin admin] The token cache is being invalidate because project e61f1a1a1d434fc295f07d349a416d08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 17:59:37.334843 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-0e6d58e6-60bf-4dd0-b7c5-0f60e257b5c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:37.335558 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-0e6d58e6-60bf-4dd0-b7c5-0f60e257b5c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:37.337112 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1051/2115] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 14 17:59:36 2022] DELETE /identity/v3/projects/e61f1a1a1d434fc295f07d349a416d08 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 17:59:37.337876 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6d58e6-60bf-4dd0-b7c5-0f60e257b5c5 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:37.339172 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-0e6d58e6-60bf-4dd0-b7c5-0f60e257b5c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:37.367933 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:59:37.429213 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6d58e6-60bf-4dd0-b7c5-0f60e257b5c5 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:37.445601 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4b1bcd-05c4-4a74-afb2-f87644c96ee6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17945e7d72954b8787e0ba09a9903247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:37.446504 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4b1bcd-05c4-4a74-afb2-f87644c96ee6 service cinder] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:37.446998 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4b1bcd-05c4-4a74-afb2-f87644c96ee6 service cinder] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:37.447553 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4b1bcd-05c4-4a74-afb2-f87644c96ee6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:37.450502 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-8d4b1bcd-05c4-4a74-afb2-f87644c96ee6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:37.507804 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-7bc2fca4-cb2b-4bcf-9417-9755ce5398ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8262b7afca614d32b711cd3dd4ff587b'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:37.508783 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-7bc2fca4-cb2b-4bcf-9417-9755ce5398ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8262b7afca614d32b711cd3dd4ff587b'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:37.509743 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-7bc2fca4-cb2b-4bcf-9417-9755ce5398ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8262b7afca614d32b711cd3dd4ff587b'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:37.569689 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4b1bcd-05c4-4a74-afb2-f87644c96ee6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:37.573005 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4b1bcd-05c4-4a74-afb2-f87644c96ee6 service cinder] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:37.617277 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1052/2116] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:59:37 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:59:37.618847 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4b1bcd-05c4-4a74-afb2-f87644c96ee6 service cinder] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:37.623817 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-8d4b1bcd-05c4-4a74-afb2-f87644c96ee6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:37.634882 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-7bc2fca4-cb2b-4bcf-9417-9755ce5398ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8262b7afca614d32b711cd3dd4ff587b'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:37.646305 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-7bc2fca4-cb2b-4bcf-9417-9755ce5398ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8262b7afca614d32b711cd3dd4ff587b'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:37.691626 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1065/2117] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 14 17:59:37 2022] DELETE /identity/v3/users/8262b7afca614d32b711cd3dd4ff587b => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:59:37.692724 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc2fca4-cb2b-4bcf-9417-9755ce5398ec admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:37.694272 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-7bc2fca4-cb2b-4bcf-9417-9755ce5398ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:37.729069 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4b1bcd-05c4-4a74-afb2-f87644c96ee6 service cinder] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:37.817211 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc2fca4-cb2b-4bcf-9417-9755ce5398ec admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:37.827833 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fd0823-6da3-4f0e-bdb4-873a32650fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:37.828829 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fd0823-6da3-4f0e-bdb4-873a32650fe0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:37.829212 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fd0823-6da3-4f0e-bdb4-873a32650fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:37.829466 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fd0823-6da3-4f0e-bdb4-873a32650fe0 admin admin] PATH_INFO: `/v3/users/285a185a065e4f4f893b27144a7b5115` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:37.831291 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fd0823-6da3-4f0e-bdb4-873a32650fe0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=285a185a065e4f4f893b27144a7b5115)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:37.833612 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fd0823-6da3-4f0e-bdb4-873a32650fe0 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:37.834329 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91feda72-9af0-455f-afea-7b46cefde61e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:37.835522 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91feda72-9af0-455f-afea-7b46cefde61e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:37.835925 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91feda72-9af0-455f-afea-7b46cefde61e admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:37.836292 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91feda72-9af0-455f-afea-7b46cefde61e admin admin] PATH_INFO: `/v3/users/5533d1acd4384f2da0ceb75c51b6db62` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:37.838468 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91feda72-9af0-455f-afea-7b46cefde61e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5533d1acd4384f2da0ceb75c51b6db62)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:37.840577 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91feda72-9af0-455f-afea-7b46cefde61e admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:38.090812 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-a4fd0823-6da3-4f0e-bdb4-873a32650fe0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '285a185a065e4f4f893b27144a7b5115'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:38.091726 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-a4fd0823-6da3-4f0e-bdb4-873a32650fe0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '285a185a065e4f4f893b27144a7b5115'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:38.092909 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-a4fd0823-6da3-4f0e-bdb4-873a32650fe0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '285a185a065e4f4f893b27144a7b5115'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:38.131285 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-91feda72-9af0-455f-afea-7b46cefde61e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5533d1acd4384f2da0ceb75c51b6db62'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:38.132102 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-91feda72-9af0-455f-afea-7b46cefde61e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5533d1acd4384f2da0ceb75c51b6db62'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:38.132799 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-91feda72-9af0-455f-afea-7b46cefde61e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5533d1acd4384f2da0ceb75c51b6db62'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:38.240140 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-a4fd0823-6da3-4f0e-bdb4-873a32650fe0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '285a185a065e4f4f893b27144a7b5115'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:38.257383 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-a4fd0823-6da3-4f0e-bdb4-873a32650fe0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '285a185a065e4f4f893b27144a7b5115'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:38.287912 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1066/2118] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 14 17:59:37 2022] DELETE /identity/v3/users/285a185a065e4f4f893b27144a7b5115 => generated 0 bytes in 596 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:59:38.291789 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fd0823-6da3-4f0e-bdb4-873a32650fe0 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:38.293622 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-a4fd0823-6da3-4f0e-bdb4-873a32650fe0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:38.325768 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-91feda72-9af0-455f-afea-7b46cefde61e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5533d1acd4384f2da0ceb75c51b6db62'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:38.340165 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-91feda72-9af0-455f-afea-7b46cefde61e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5533d1acd4384f2da0ceb75c51b6db62'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:38.349689 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:59:38.372895 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1053/2119] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 14 17:59:37 2022] DELETE /identity/v3/users/5533d1acd4384f2da0ceb75c51b6db62 => generated 0 bytes in 755 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:59:38.374287 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44650ac5-2ecc-4b00-808b-c992ed9c3f22 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:38.374686 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44650ac5-2ecc-4b00-808b-c992ed9c3f22 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:38.375065 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44650ac5-2ecc-4b00-808b-c992ed9c3f22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:38.404076 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fd0823-6da3-4f0e-bdb4-873a32650fe0 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:38.419624 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-44650ac5-2ecc-4b00-808b-c992ed9c3f22 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:59:38.421084 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-44650ac5-2ecc-4b00-808b-c992ed9c3f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:38.490411 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a07741-8d6e-4c9f-ade7-d05ef9c15895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:38.491435 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a07741-8d6e-4c9f-ade7-d05ef9c15895 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:38.492061 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a07741-8d6e-4c9f-ade7-d05ef9c15895 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:38.492061 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a07741-8d6e-4c9f-ade7-d05ef9c15895 admin admin] PATH_INFO: `/v3/projects/a154c204a45745e29b99234df76b4bc0` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:38.493332 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a07741-8d6e-4c9f-ade7-d05ef9c15895 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a154c204a45745e29b99234df76b4bc0)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:38.495411 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a07741-8d6e-4c9f-ade7-d05ef9c15895 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:38.529104 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1054/2120] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:59:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:59:38.541104 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44650ac5-2ecc-4b00-808b-c992ed9c3f22 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:38.543182 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-44650ac5-2ecc-4b00-808b-c992ed9c3f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:38.643704 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44650ac5-2ecc-4b00-808b-c992ed9c3f22 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:38.659227 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-45a07741-8d6e-4c9f-ade7-d05ef9c15895 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a154c204a45745e29b99234df76b4bc0', 'request_id': 'req-45a07741-8d6e-4c9f-ade7-d05ef9c15895'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:38.771060 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-45a07741-8d6e-4c9f-ade7-d05ef9c15895 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a154c204a45745e29b99234df76b4bc0', 'request_id': 'req-45a07741-8d6e-4c9f-ade7-d05ef9c15895'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:38.771572 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01abd1d5-fb3b-411f-bd01-5fadf98cae12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5652329c71cd431fb579d69cef933b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:38.772459 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01abd1d5-fb3b-411f-bd01-5fadf98cae12 service neutron] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:38.772844 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01abd1d5-fb3b-411f-bd01-5fadf98cae12 service neutron] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:38.773609 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01abd1d5-fb3b-411f-bd01-5fadf98cae12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:38.781886 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-45a07741-8d6e-4c9f-ade7-d05ef9c15895 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a154c204a45745e29b99234df76b4bc0', 'request_id': 'req-45a07741-8d6e-4c9f-ade7-d05ef9c15895'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:38.808540 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-45a07741-8d6e-4c9f-ade7-d05ef9c15895 admin admin] The token cache is being invalidate because project a154c204a45745e29b99234df76b4bc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87019) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 17:59:38.808834 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-45a07741-8d6e-4c9f-ade7-d05ef9c15895 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:38.809922 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-45a07741-8d6e-4c9f-ade7-d05ef9c15895 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:38.815620 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1067/2121] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 14 17:59:38 2022] DELETE /identity/v3/projects/a154c204a45745e29b99234df76b4bc0 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:59:38.820825 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa2c7c2-31e0-4404-86c2-c59ec5e1ab59 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:38.821115 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa2c7c2-31e0-4404-86c2-c59ec5e1ab59 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:38.821403 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa2c7c2-31e0-4404-86c2-c59ec5e1ab59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:38.864124 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-efa2c7c2-31e0-4404-86c2-c59ec5e1ab59 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:59:38.865618 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-efa2c7c2-31e0-4404-86c2-c59ec5e1ab59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:38.895088 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01abd1d5-fb3b-411f-bd01-5fadf98cae12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:38.896944 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01abd1d5-fb3b-411f-bd01-5fadf98cae12 service neutron] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:38.925165 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1055/2122] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:59:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:59:38.991029 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1068/2123] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:59:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:59:38.999743 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc9999d-ebf2-4225-9494-d5e82c8e5b5d None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:39.001350 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc9999d-ebf2-4225-9494-d5e82c8e5b5d None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:39.001350 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc9999d-ebf2-4225-9494-d5e82c8e5b5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:39.023167 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-ddc9999d-ebf2-4225-9494-d5e82c8e5b5d None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:59:39.024473 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-ddc9999d-ebf2-4225-9494-d5e82c8e5b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:39.044090 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1056/2124] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:59:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:59:39.046451 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa2c7c2-31e0-4404-86c2-c59ec5e1ab59 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:39.059168 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa2c7c2-31e0-4404-86c2-c59ec5e1ab59 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:39.065560 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccf3223-de9d-4fad-a1b4-9a85af463de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:39.066740 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccf3223-de9d-4fad-a1b4-9a85af463de6 admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:39.067095 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccf3223-de9d-4fad-a1b4-9a85af463de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:39.067556 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccf3223-de9d-4fad-a1b4-9a85af463de6 admin admin] PATH_INFO: `/v3/domains` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:39.068499 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccf3223-de9d-4fad-a1b4-9a85af463de6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:59:39.068914 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccf3223-de9d-4fad-a1b4-9a85af463de6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:39.070644 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccf3223-de9d-4fad-a1b4-9a85af463de6 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:39.086454 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1069/2125] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 14 17:59:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:59:39.088919 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc9999d-ebf2-4225-9494-d5e82c8e5b5d None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:39.090533 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-ddc9999d-ebf2-4225-9494-d5e82c8e5b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:39.101203 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccf3223-de9d-4fad-a1b4-9a85af463de6 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:39.115502 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc9999d-ebf2-4225-9494-d5e82c8e5b5d None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:39.125907 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccf3223-de9d-4fad-a1b4-9a85af463de6 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:39.135894 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282b69f9-f1b7-4380-94af-f3ebb3cbd7b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:39.136688 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282b69f9-f1b7-4380-94af-f3ebb3cbd7b5 admin admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:39.137038 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282b69f9-f1b7-4380-94af-f3ebb3cbd7b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:39.138279 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282b69f9-f1b7-4380-94af-f3ebb3cbd7b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:39.139200 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282b69f9-f1b7-4380-94af-f3ebb3cbd7b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:39.143079 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282b69f9-f1b7-4380-94af-f3ebb3cbd7b5 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:39.152650 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaec775-5d74-4f7f-b078-cf79bcc96751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:39.156386 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaec775-5d74-4f7f-b078-cf79bcc96751 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:39.158183 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaec775-5d74-4f7f-b078-cf79bcc96751 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:39.159236 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaec775-5d74-4f7f-b078-cf79bcc96751 admin admin] PATH_INFO: `/v3/projects/9226519f954c49578add0253570e9b63` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:39.162613 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaec775-5d74-4f7f-b078-cf79bcc96751 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9226519f954c49578add0253570e9b63)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:39.165570 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaec775-5d74-4f7f-b078-cf79bcc96751 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:39.177736 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:59:39.247406 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1070/2126] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 14 17:59:39 2022] POST /identity/v3/projects => generated 381 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:59:39.263152 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282b69f9-f1b7-4380-94af-f3ebb3cbd7b5 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:39.328028 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-caaec775-5d74-4f7f-b078-cf79bcc96751 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9226519f954c49578add0253570e9b63', 'request_id': 'req-caaec775-5d74-4f7f-b078-cf79bcc96751'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:39.380855 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-caaec775-5d74-4f7f-b078-cf79bcc96751 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9226519f954c49578add0253570e9b63', 'request_id': 'req-caaec775-5d74-4f7f-b078-cf79bcc96751'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:39.412538 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-caaec775-5d74-4f7f-b078-cf79bcc96751 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9226519f954c49578add0253570e9b63', 'request_id': 'req-caaec775-5d74-4f7f-b078-cf79bcc96751'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:39.413924 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282b69f9-f1b7-4380-94af-f3ebb3cbd7b5 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:39.473472 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-caaec775-5d74-4f7f-b078-cf79bcc96751 admin admin] The token cache is being invalidate because project 9226519f954c49578add0253570e9b63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 17:59:39.474338 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-caaec775-5d74-4f7f-b078-cf79bcc96751 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:39.480760 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-caaec775-5d74-4f7f-b078-cf79bcc96751 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:39.484888 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1057/2127] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 14 17:59:39 2022] DELETE /identity/v3/projects/9226519f954c49578add0253570e9b63 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:59:39.493535 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac03eab-9a4b-44da-903d-c264866693f3 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:39.493535 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac03eab-9a4b-44da-903d-c264866693f3 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:39.496656 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac03eab-9a4b-44da-903d-c264866693f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:39.535781 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-bac03eab-9a4b-44da-903d-c264866693f3 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:59:39.537024 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-bac03eab-9a4b-44da-903d-c264866693f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:39.550140 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81b49af-9b6b-41d8-a767-94761129629d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:39.550813 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81b49af-9b6b-41d8-a767-94761129629d admin admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:39.551109 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81b49af-9b6b-41d8-a767-94761129629d admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:39.551428 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81b49af-9b6b-41d8-a767-94761129629d admin admin] PATH_INFO: `/v3/users` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:39.552133 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81b49af-9b6b-41d8-a767-94761129629d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:39.554340 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81b49af-9b6b-41d8-a767-94761129629d admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:39.614095 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1058/2128] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:59:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:59:39.622016 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d6aa8-dd2a-4018-a1f6-9a489ec4994a None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:39.622316 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d6aa8-dd2a-4018-a1f6-9a489ec4994a None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:39.622678 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d6aa8-dd2a-4018-a1f6-9a489ec4994a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:39.626778 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:59:39.654997 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1071/2129] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 14 17:59:39 2022] POST /identity/v3/users => generated 291 bytes in 404 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:59:39.656294 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81b49af-9b6b-41d8-a767-94761129629d admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:39.658327 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-d81b49af-9b6b-41d8-a767-94761129629d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:39.668453 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-2d1d6aa8-dd2a-4018-a1f6-9a489ec4994a None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:59:39.670915 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-2d1d6aa8-dd2a-4018-a1f6-9a489ec4994a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:39.677523 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81b49af-9b6b-41d8-a767-94761129629d admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:39.684369 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b039938c-1686-4619-9af5-c4154bbc1713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:39.685197 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b039938c-1686-4619-9af5-c4154bbc1713 admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:39.685558 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b039938c-1686-4619-9af5-c4154bbc1713 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:39.685908 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b039938c-1686-4619-9af5-c4154bbc1713 admin admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:39.686892 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b039938c-1686-4619-9af5-c4154bbc1713 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:39.690021 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b039938c-1686-4619-9af5-c4154bbc1713 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:39.691233 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1059/2130] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:59:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 17:59:39.692953 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1d6aa8-dd2a-4018-a1f6-9a489ec4994a None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:39.704555 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1d6aa8-dd2a-4018-a1f6-9a489ec4994a None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:39.707016 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1072/2131] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 17:59:39 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 14 17:59:39.708209 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b039938c-1686-4619-9af5-c4154bbc1713 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:39.712124 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377c6a1e-1356-48a6-ab79-5b2f2d29275a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:39.713185 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377c6a1e-1356-48a6-ab79-5b2f2d29275a admin admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:39.713659 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377c6a1e-1356-48a6-ab79-5b2f2d29275a admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:39.714148 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377c6a1e-1356-48a6-ab79-5b2f2d29275a admin admin] PATH_INFO: `/v3/domains` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:39.715087 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377c6a1e-1356-48a6-ab79-5b2f2d29275a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:59:39.715725 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377c6a1e-1356-48a6-ab79-5b2f2d29275a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:39.718723 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377c6a1e-1356-48a6-ab79-5b2f2d29275a admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:39.719410 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b039938c-1686-4619-9af5-c4154bbc1713 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:39.726162 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a5df34-665a-40da-af77-fba83e61eff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:39.726889 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a5df34-665a-40da-af77-fba83e61eff8 admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:39.727182 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a5df34-665a-40da-af77-fba83e61eff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:39.727713 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a5df34-665a-40da-af77-fba83e61eff8 admin admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:39.728234 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a5df34-665a-40da-af77-fba83e61eff8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:39.730032 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a5df34-665a-40da-af77-fba83e61eff8 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:39.742483 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1060/2132] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 14 17:59:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:59:39.747370 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377c6a1e-1356-48a6-ab79-5b2f2d29275a admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:39.759101 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1073/2133] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 17:59:39 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 17:59:39.760164 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a5df34-665a-40da-af77-fba83e61eff8 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:39.761791 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377c6a1e-1356-48a6-ab79-5b2f2d29275a admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:39.766070 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-d7a5df34-665a-40da-af77-fba83e61eff8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:39.768528 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeffe93-411a-4602-bb12-ad3cb0c75d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:39.769326 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeffe93-411a-4602-bb12-ad3cb0c75d32 admin admin] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:39.769718 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeffe93-411a-4602-bb12-ad3cb0c75d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:39.770150 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeffe93-411a-4602-bb12-ad3cb0c75d32 admin admin] PATH_INFO: `/v3/projects` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:39.771091 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeffe93-411a-4602-bb12-ad3cb0c75d32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:39.779062 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeffe93-411a-4602-bb12-ad3cb0c75d32 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:39.808561 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a5df34-665a-40da-af77-fba83e61eff8 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:39.817207 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c03642-aa1a-471d-a3d8-74d44cf023ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:39.822654 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c03642-aa1a-471d-a3d8-74d44cf023ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:39.822654 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c03642-aa1a-471d-a3d8-74d44cf023ee admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:39.822654 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c03642-aa1a-471d-a3d8-74d44cf023ee admin admin] PATH_INFO: `/v3/projects/b8801efd93494e008bf2443408fda198` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:39.822654 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c03642-aa1a-471d-a3d8-74d44cf023ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8801efd93494e008bf2443408fda198)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:39.828426 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c03642-aa1a-471d-a3d8-74d44cf023ee admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:39.852575 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:59:39.965211 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1061/2134] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 14 17:59:39 2022] POST /identity/v3/projects => generated 377 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:59:39.965928 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeffe93-411a-4602-bb12-ad3cb0c75d32 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:40.007683 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-96c03642-aa1a-471d-a3d8-74d44cf023ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8801efd93494e008bf2443408fda198', 'request_id': 'req-96c03642-aa1a-471d-a3d8-74d44cf023ee'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:40.074486 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-96c03642-aa1a-471d-a3d8-74d44cf023ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8801efd93494e008bf2443408fda198', 'request_id': 'req-96c03642-aa1a-471d-a3d8-74d44cf023ee'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:40.085740 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-96c03642-aa1a-471d-a3d8-74d44cf023ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8801efd93494e008bf2443408fda198', 'request_id': 'req-96c03642-aa1a-471d-a3d8-74d44cf023ee'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:40.098641 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeffe93-411a-4602-bb12-ad3cb0c75d32 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:40.102763 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-96c03642-aa1a-471d-a3d8-74d44cf023ee admin admin] The token cache is being invalidate because project b8801efd93494e008bf2443408fda198 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87019) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 17:59:40.103796 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-96c03642-aa1a-471d-a3d8-74d44cf023ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:40.106697 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-96c03642-aa1a-471d-a3d8-74d44cf023ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:40.109102 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1074/2135] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 14 17:59:39 2022] DELETE /identity/v3/projects/b8801efd93494e008bf2443408fda198 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:59:40.111413 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c03642-aa1a-471d-a3d8-74d44cf023ee admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:40.114310 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-96c03642-aa1a-471d-a3d8-74d44cf023ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:40.180908 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0537fbc-3e82-45d9-aeae-b836e3914820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:40.181852 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0537fbc-3e82-45d9-aeae-b836e3914820 admin admin] REQUEST_METHOD: `PUT` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:40.182147 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0537fbc-3e82-45d9-aeae-b836e3914820 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:40.182440 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0537fbc-3e82-45d9-aeae-b836e3914820 admin admin] PATH_INFO: `/v3/projects/5a142734eadd40fb908c7bd115c81ee4/users/e73368f3ce8a43368b30985898cf7393/roles/9ee80134743f4c2b88525b04df2facba` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:40.202539 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0537fbc-3e82-45d9-aeae-b836e3914820 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a142734eadd40fb908c7bd115c81ee4, user_id=e73368f3ce8a43368b30985898cf7393, role_id=9ee80134743f4c2b88525b04df2facba)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:40.207165 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0537fbc-3e82-45d9-aeae-b836e3914820 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:40.216036 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c03642-aa1a-471d-a3d8-74d44cf023ee admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:40.221686 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ecdee7-a4b0-4937-84dd-50100a8a6b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:40.222378 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ecdee7-a4b0-4937-84dd-50100a8a6b76 admin admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:40.222670 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ecdee7-a4b0-4937-84dd-50100a8a6b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:40.222957 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ecdee7-a4b0-4937-84dd-50100a8a6b76 admin admin] PATH_INFO: `/v3/users` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:40.223702 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ecdee7-a4b0-4937-84dd-50100a8a6b76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:40.225684 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ecdee7-a4b0-4937-84dd-50100a8a6b76 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:40.350300 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1075/2137] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 14 17:59:40 2022] POST /identity/v3/users => generated 289 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:59:40.350536 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1062/2137] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 17:59:39 2022] PUT /identity/v3/projects/5a142734eadd40fb908c7bd115c81ee4/users/e73368f3ce8a43368b30985898cf7393/roles/9ee80134743f4c2b88525b04df2facba => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:59:40.351956 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d477375-d455-4978-8573-b8a40ef98d71 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:40.352259 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d477375-d455-4978-8573-b8a40ef98d71 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:40.352668 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d477375-d455-4978-8573-b8a40ef98d71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:40.354773 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ecdee7-a4b0-4937-84dd-50100a8a6b76 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:40.373728 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ecdee7-a4b0-4937-84dd-50100a8a6b76 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:40.385639 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-2d477375-d455-4978-8573-b8a40ef98d71 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:59:40.387162 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-2d477375-d455-4978-8573-b8a40ef98d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:40.449574 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68b1d4e-4912-4a11-a87f-f9a875874264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:40.450575 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68b1d4e-4912-4a11-a87f-f9a875874264 admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:40.451111 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68b1d4e-4912-4a11-a87f-f9a875874264 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:40.451450 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68b1d4e-4912-4a11-a87f-f9a875874264 admin admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:40.452387 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68b1d4e-4912-4a11-a87f-f9a875874264 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:40.455467 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68b1d4e-4912-4a11-a87f-f9a875874264 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:40.461804 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1063/2138] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:59:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:59:40.470195 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1076/2139] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 17:59:40 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 17:59:40.470195 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e89bf4e-6d05-4f62-84fc-2d0b2057ddb4 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:40.470469 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ffbb8e-d269-462e-8b98-fc97c28f41f5 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:40.470469 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ffbb8e-d269-462e-8b98-fc97c28f41f5 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:40.470469 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ffbb8e-d269-462e-8b98-fc97c28f41f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:40.470920 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e89bf4e-6d05-4f62-84fc-2d0b2057ddb4 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:40.471196 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e89bf4e-6d05-4f62-84fc-2d0b2057ddb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:40.490785 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-67ffbb8e-d269-462e-8b98-fc97c28f41f5 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:59:40.491094 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-9e89bf4e-6d05-4f62-84fc-2d0b2057ddb4 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:59:40.492023 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-67ffbb8e-d269-462e-8b98-fc97c28f41f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:40.492305 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-9e89bf4e-6d05-4f62-84fc-2d0b2057ddb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:40.500154 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1064/2140] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:59:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:59:40.500677 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1077/2141] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:59:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 17:59:40.500946 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ffbb8e-d269-462e-8b98-fc97c28f41f5 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:40.505475 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e89bf4e-6d05-4f62-84fc-2d0b2057ddb4 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:40.511401 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ffbb8e-d269-462e-8b98-fc97c28f41f5 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:40.514670 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e89bf4e-6d05-4f62-84fc-2d0b2057ddb4 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:40.516851 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a39b171-620e-4d7e-9607-6ecfc8784855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:40.518032 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a39b171-620e-4d7e-9607-6ecfc8784855 admin admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:40.518311 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a39b171-620e-4d7e-9607-6ecfc8784855 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:40.518596 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a39b171-620e-4d7e-9607-6ecfc8784855 admin admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:40.519618 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a39b171-620e-4d7e-9607-6ecfc8784855 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:40.521554 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a39b171-620e-4d7e-9607-6ecfc8784855 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:40.521760 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98163a8c-d23f-4ba4-a843-55343fec81bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:40.522493 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98163a8c-d23f-4ba4-a843-55343fec81bc admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:40.522799 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98163a8c-d23f-4ba4-a843-55343fec81bc admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:40.523089 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98163a8c-d23f-4ba4-a843-55343fec81bc admin admin] PATH_INFO: `/v3/domains` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:40.524119 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98163a8c-d23f-4ba4-a843-55343fec81bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:59:40.524224 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98163a8c-d23f-4ba4-a843-55343fec81bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:40.525862 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98163a8c-d23f-4ba4-a843-55343fec81bc admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:40.533583 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1065/2142] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 17:59:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 17:59:40.534588 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a39b171-620e-4d7e-9607-6ecfc8784855 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:40.540137 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-9a39b171-620e-4d7e-9607-6ecfc8784855 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:40.544168 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1078/2143] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 14 17:59:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:59:40.544991 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98163a8c-d23f-4ba4-a843-55343fec81bc admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:40.556112 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98163a8c-d23f-4ba4-a843-55343fec81bc admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:40.562162 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8196b0f9-a5ae-4b79-a089-73b2b75ca971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:40.563613 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8196b0f9-a5ae-4b79-a089-73b2b75ca971 admin admin] REQUEST_METHOD: `PUT` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:40.563934 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8196b0f9-a5ae-4b79-a089-73b2b75ca971 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:40.564245 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8196b0f9-a5ae-4b79-a089-73b2b75ca971 admin admin] PATH_INFO: `/v3/projects/7b82bb2e7afd47b5a36e2f674754247f/users/d8eff1894e41455288dbe30311711e90/roles/9ee80134743f4c2b88525b04df2facba` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:40.584475 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8196b0f9-a5ae-4b79-a089-73b2b75ca971 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b82bb2e7afd47b5a36e2f674754247f, user_id=d8eff1894e41455288dbe30311711e90, role_id=9ee80134743f4c2b88525b04df2facba)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:40.587401 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8196b0f9-a5ae-4b79-a089-73b2b75ca971 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:40.612662 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a39b171-620e-4d7e-9607-6ecfc8784855 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:40.616821 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80691c3c-c47e-40a2-b1e2-d39e9db3ace2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5652329c71cd431fb579d69cef933b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:40.617495 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80691c3c-c47e-40a2-b1e2-d39e9db3ace2 service neutron] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:40.617786 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80691c3c-c47e-40a2-b1e2-d39e9db3ace2 service neutron] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:40.618071 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80691c3c-c47e-40a2-b1e2-d39e9db3ace2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:40.629724 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80691c3c-c47e-40a2-b1e2-d39e9db3ace2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:40.631282 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80691c3c-c47e-40a2-b1e2-d39e9db3ace2 service neutron] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:40.645864 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1066/2144] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:59:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:59:40.646912 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80691c3c-c47e-40a2-b1e2-d39e9db3ace2 service neutron] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:40.658550 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80691c3c-c47e-40a2-b1e2-d39e9db3ace2 service neutron] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:40.664282 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c459a13-a87f-440d-9741-7a4d0cf7ec16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:40.664416 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c459a13-a87f-440d-9741-7a4d0cf7ec16 admin admin] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:40.664665 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c459a13-a87f-440d-9741-7a4d0cf7ec16 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:40.664955 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c459a13-a87f-440d-9741-7a4d0cf7ec16 admin admin] PATH_INFO: `/v3/projects` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:40.665732 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c459a13-a87f-440d-9741-7a4d0cf7ec16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:40.668167 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c459a13-a87f-440d-9741-7a4d0cf7ec16 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:40.761350 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1079/2145] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 17:59:40 2022] PUT /identity/v3/projects/7b82bb2e7afd47b5a36e2f674754247f/users/d8eff1894e41455288dbe30311711e90/roles/9ee80134743f4c2b88525b04df2facba => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:59:40.776064 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef35317-d63b-4af5-ae76-108e317fade8 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:40.776373 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef35317-d63b-4af5-ae76-108e317fade8 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:40.776680 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef35317-d63b-4af5-ae76-108e317fade8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:40.817573 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-3ef35317-d63b-4af5-ae76-108e317fade8 None None] MFA Rules not processed for user `d8eff1894e41455288dbe30311711e90`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:59:40.819479 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-3ef35317-d63b-4af5-ae76-108e317fade8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:40.920902 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1080/2146] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:59:40 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 17:59:40.922040 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef35317-d63b-4af5-ae76-108e317fade8 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:40.993528 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef35317-d63b-4af5-ae76-108e317fade8 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:40.998418 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a21fcc8-39ec-471d-b240-0cc194d938ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:40.999150 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a21fcc8-39ec-471d-b240-0cc194d938ca admin admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:40.999474 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a21fcc8-39ec-471d-b240-0cc194d938ca admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:40.999786 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a21fcc8-39ec-471d-b240-0cc194d938ca admin admin] PATH_INFO: `/v3/projects` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:41.000492 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a21fcc8-39ec-471d-b240-0cc194d938ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:41.002500 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a21fcc8-39ec-471d-b240-0cc194d938ca admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:41.012504 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1067/2147] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 14 17:59:40 2022] POST /identity/v3/projects => generated 385 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:59:41.018865 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c459a13-a87f-440d-9741-7a4d0cf7ec16 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:41.092853 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c459a13-a87f-440d-9741-7a4d0cf7ec16 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:41.101884 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eba5068-ee30-4d37-9ad5-43fade66425d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:41.102686 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eba5068-ee30-4d37-9ad5-43fade66425d admin admin] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:41.102950 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eba5068-ee30-4d37-9ad5-43fade66425d admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:41.103419 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eba5068-ee30-4d37-9ad5-43fade66425d admin admin] PATH_INFO: `/v3/users` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:41.104134 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eba5068-ee30-4d37-9ad5-43fade66425d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:41.106434 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eba5068-ee30-4d37-9ad5-43fade66425d admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:41.171367 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1081/2148] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 14 17:59:40 2022] POST /identity/v3/projects => generated 375 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 17:59:41.175342 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a21fcc8-39ec-471d-b240-0cc194d938ca admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:41.220081 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1068/2149] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 14 17:59:41 2022] POST /identity/v3/users => generated 293 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:59:41.225201 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eba5068-ee30-4d37-9ad5-43fade66425d admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:41.239219 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eba5068-ee30-4d37-9ad5-43fade66425d admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:41.257617 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a21fcc8-39ec-471d-b240-0cc194d938ca admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:41.267511 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5858cf8-0802-4724-bba1-a9ad3acb1ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:41.269655 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5858cf8-0802-4724-bba1-a9ad3acb1ccb admin admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:41.270510 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5858cf8-0802-4724-bba1-a9ad3acb1ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:41.271808 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5858cf8-0802-4724-bba1-a9ad3acb1ccb admin admin] PATH_INFO: `/v3/users` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:41.272835 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5858cf8-0802-4724-bba1-a9ad3acb1ccb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:41.277996 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5858cf8-0802-4724-bba1-a9ad3acb1ccb admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:41.341754 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43ef6e5-4cff-4c49-8802-bc5fd2a5aa7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:41.342477 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43ef6e5-4cff-4c49-8802-bc5fd2a5aa7e admin admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:41.342763 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43ef6e5-4cff-4c49-8802-bc5fd2a5aa7e admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:41.343053 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43ef6e5-4cff-4c49-8802-bc5fd2a5aa7e admin admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:41.343888 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43ef6e5-4cff-4c49-8802-bc5fd2a5aa7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:41.346056 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43ef6e5-4cff-4c49-8802-bc5fd2a5aa7e admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:41.359781 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1069/2150] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 17:59:41 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 17:59:41.362061 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43ef6e5-4cff-4c49-8802-bc5fd2a5aa7e admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:41.374248 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43ef6e5-4cff-4c49-8802-bc5fd2a5aa7e admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:41.381704 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd33973-0d6a-44fa-b150-47ddf45c43b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:41.382399 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd33973-0d6a-44fa-b150-47ddf45c43b6 admin admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:41.382721 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd33973-0d6a-44fa-b150-47ddf45c43b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:41.383001 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd33973-0d6a-44fa-b150-47ddf45c43b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:41.383957 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd33973-0d6a-44fa-b150-47ddf45c43b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:41.385376 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd33973-0d6a-44fa-b150-47ddf45c43b6 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:41.397090 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1070/2151] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 17:59:41 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 17:59:41.400885 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd33973-0d6a-44fa-b150-47ddf45c43b6 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:41.412004 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd33973-0d6a-44fa-b150-47ddf45c43b6 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:41.416978 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ec9c76-c212-42bf-b136-8fe4e80f2a6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:41.417910 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ec9c76-c212-42bf-b136-8fe4e80f2a6d admin admin] REQUEST_METHOD: `PUT` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:41.418198 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ec9c76-c212-42bf-b136-8fe4e80f2a6d admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:41.419200 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ec9c76-c212-42bf-b136-8fe4e80f2a6d admin admin] PATH_INFO: `/v3/projects/9703dd1b04904c4487490c78e5daff0c/users/1c15123c8ebd44af81818563dde06c1d/roles/9ee80134743f4c2b88525b04df2facba` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:41.435455 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ec9c76-c212-42bf-b136-8fe4e80f2a6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9703dd1b04904c4487490c78e5daff0c, user_id=1c15123c8ebd44af81818563dde06c1d, role_id=9ee80134743f4c2b88525b04df2facba)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:41.438202 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ec9c76-c212-42bf-b136-8fe4e80f2a6d admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:41.453317 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1082/2152] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 14 17:59:41 2022] POST /identity/v3/users => generated 294 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 17:59:41.458064 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5858cf8-0802-4724-bba1-a9ad3acb1ccb admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:41.468884 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5858cf8-0802-4724-bba1-a9ad3acb1ccb admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:41.475505 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd1b0fe-0c83-4a38-b7a2-c58107fc34db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:41.476200 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd1b0fe-0c83-4a38-b7a2-c58107fc34db admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:41.476616 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd1b0fe-0c83-4a38-b7a2-c58107fc34db admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:41.476771 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd1b0fe-0c83-4a38-b7a2-c58107fc34db admin admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:41.477487 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd1b0fe-0c83-4a38-b7a2-c58107fc34db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:41.479131 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd1b0fe-0c83-4a38-b7a2-c58107fc34db admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:41.492315 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1083/2153] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 17:59:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 14 17:59:41.498441 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd1b0fe-0c83-4a38-b7a2-c58107fc34db admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:41.509507 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd1b0fe-0c83-4a38-b7a2-c58107fc34db admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:41.515031 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf38af6-9545-4640-9783-83a1b689540d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:41.515880 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf38af6-9545-4640-9783-83a1b689540d admin admin] REQUEST_METHOD: `PUT` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:41.516112 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf38af6-9545-4640-9783-83a1b689540d admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:41.516484 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf38af6-9545-4640-9783-83a1b689540d admin admin] PATH_INFO: `/v3/projects/b910e2d0b73b46ea9ee2d4de491fb3eb/users/72422ce0ee5b43f98f9faee61b3d7e05/roles/1348580877d04014bfdec4d866b98a74` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:41.537860 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf38af6-9545-4640-9783-83a1b689540d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b910e2d0b73b46ea9ee2d4de491fb3eb, user_id=72422ce0ee5b43f98f9faee61b3d7e05, role_id=1348580877d04014bfdec4d866b98a74)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:41.540934 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf38af6-9545-4640-9783-83a1b689540d admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:41.561835 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1071/2154] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 17:59:41 2022] PUT /identity/v3/projects/9703dd1b04904c4487490c78e5daff0c/users/1c15123c8ebd44af81818563dde06c1d/roles/9ee80134743f4c2b88525b04df2facba => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 17:59:41.575109 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765bd1ad-ed7d-4552-b478-9af0fea6ee44 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:41.575424 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765bd1ad-ed7d-4552-b478-9af0fea6ee44 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:41.576061 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765bd1ad-ed7d-4552-b478-9af0fea6ee44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:41.613333 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-765bd1ad-ed7d-4552-b478-9af0fea6ee44 None None] MFA Rules not processed for user `1c15123c8ebd44af81818563dde06c1d`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:59:41.614743 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-765bd1ad-ed7d-4552-b478-9af0fea6ee44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:41.662428 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:59:41.699022 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1072/2155] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:59:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:59:41.710867 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765bd1ad-ed7d-4552-b478-9af0fea6ee44 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:41.712331 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-765bd1ad-ed7d-4552-b478-9af0fea6ee44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:41.750809 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1084/2156] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 17:59:41 2022] PUT /identity/v3/projects/b910e2d0b73b46ea9ee2d4de491fb3eb/users/72422ce0ee5b43f98f9faee61b3d7e05/roles/1348580877d04014bfdec4d866b98a74 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 17:59:41.754933 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf38af6-9545-4640-9783-83a1b689540d admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:41.780084 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765bd1ad-ed7d-4552-b478-9af0fea6ee44 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:41.825417 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf38af6-9545-4640-9783-83a1b689540d admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:41.830750 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e6cb07-56af-4fe9-920b-9250808687a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:41.831561 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e6cb07-56af-4fe9-920b-9250808687a2 admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:41.831881 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e6cb07-56af-4fe9-920b-9250808687a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:41.832174 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e6cb07-56af-4fe9-920b-9250808687a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:41.832905 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e6cb07-56af-4fe9-920b-9250808687a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:41.833032 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0392baf7-ba32-4265-ba18-365b63eae6bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17945e7d72954b8787e0ba09a9903247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:41.833611 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0392baf7-ba32-4265-ba18-365b63eae6bf service cinder] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:41.833902 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0392baf7-ba32-4265-ba18-365b63eae6bf service cinder] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:41.834189 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0392baf7-ba32-4265-ba18-365b63eae6bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:41.834512 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e6cb07-56af-4fe9-920b-9250808687a2 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:41.846556 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1085/2157] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 17:59:41 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 17:59:41.854367 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e6cb07-56af-4fe9-920b-9250808687a2 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:41.863190 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e6cb07-56af-4fe9-920b-9250808687a2 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:41.868631 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658631d9-8d36-43b4-b4b9-ccd5ebf93dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:41.869596 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658631d9-8d36-43b4-b4b9-ccd5ebf93dbb admin admin] REQUEST_METHOD: `PUT` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:41.869977 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658631d9-8d36-43b4-b4b9-ccd5ebf93dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:41.870268 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658631d9-8d36-43b4-b4b9-ccd5ebf93dbb admin admin] PATH_INFO: `/v3/projects/b910e2d0b73b46ea9ee2d4de491fb3eb/users/72422ce0ee5b43f98f9faee61b3d7e05/roles/1348580877d04014bfdec4d866b98a74` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:41.872372 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658631d9-8d36-43b4-b4b9-ccd5ebf93dbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=b910e2d0b73b46ea9ee2d4de491fb3eb, user_id=72422ce0ee5b43f98f9faee61b3d7e05, role_id=1348580877d04014bfdec4d866b98a74)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:41.881898 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658631d9-8d36-43b4-b4b9-ccd5ebf93dbb admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:41.914387 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:59:41.918345 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1086/2158] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 17:59:41 2022] PUT /identity/v3/projects/b910e2d0b73b46ea9ee2d4de491fb3eb/users/72422ce0ee5b43f98f9faee61b3d7e05/roles/1348580877d04014bfdec4d866b98a74 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 17:59:41.937580 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe7f4ba-1197-4633-8383-61b1c424e845 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:41.943537 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe7f4ba-1197-4633-8383-61b1c424e845 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:41.943537 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe7f4ba-1197-4633-8383-61b1c424e845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:41.943750 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0392baf7-ba32-4265-ba18-365b63eae6bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:41.943750 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0392baf7-ba32-4265-ba18-365b63eae6bf service cinder] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:41.955369 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1073/2159] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:59:41 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 17:59:41.970576 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:INSERT=6,keystone:SELECT=86,keystone:DELETE=8 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:59:41.970721 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-dfe7f4ba-1197-4633-8383-61b1c424e845 None None] MFA Rules not processed for user `72422ce0ee5b43f98f9faee61b3d7e05`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:59:41.971529 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-dfe7f4ba-1197-4633-8383-61b1c424e845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:42.075456 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1087/2160] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:59:41 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:59:42.088521 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0392baf7-ba32-4265-ba18-365b63eae6bf service cinder] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:42.090693 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-0392baf7-ba32-4265-ba18-365b63eae6bf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:42.105938 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0392baf7-ba32-4265-ba18-365b63eae6bf service cinder] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:42.213152 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b63ee1-9eff-4e30-82c6-8364902d9c13 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17945e7d72954b8787e0ba09a9903247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:42.213990 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b63ee1-9eff-4e30-82c6-8364902d9c13 service cinder] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:42.214416 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b63ee1-9eff-4e30-82c6-8364902d9c13 service cinder] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:42.225768 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b63ee1-9eff-4e30-82c6-8364902d9c13 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:42.312728 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b63ee1-9eff-4e30-82c6-8364902d9c13 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:42.315036 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b63ee1-9eff-4e30-82c6-8364902d9c13 service cinder] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:42.330615 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1074/2161] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:59:42 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:59:42.418040 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:59:43.038178 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ef87b-e645-4e3c-b31b-e87fbbb8d41b None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:43.038381 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b63ee1-9eff-4e30-82c6-8364902d9c13 service cinder] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:43.038818 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ef87b-e645-4e3c-b31b-e87fbbb8d41b None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:43.038818 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ef87b-e645-4e3c-b31b-e87fbbb8d41b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:43.040150 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-88b63ee1-9eff-4e30-82c6-8364902d9c13 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:43.074414 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-801ef87b-e645-4e3c-b31b-e87fbbb8d41b None None] MFA Rules not processed for user `e73368f3ce8a43368b30985898cf7393`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:59:43.075866 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-801ef87b-e645-4e3c-b31b-e87fbbb8d41b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:43.129275 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:59:43.187211 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b63ee1-9eff-4e30-82c6-8364902d9c13 service cinder] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:43.195149 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc17a2b8-05cb-42f4-957d-754b9242f5c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:43.196118 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc17a2b8-05cb-42f4-957d-754b9242f5c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:43.196413 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc17a2b8-05cb-42f4-957d-754b9242f5c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:43.196698 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc17a2b8-05cb-42f4-957d-754b9242f5c4 admin admin] PATH_INFO: `/v3/users/3011719a671849b79f5d8c90173cb3f5` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:43.202965 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc17a2b8-05cb-42f4-957d-754b9242f5c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3011719a671849b79f5d8c90173cb3f5)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:43.205919 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc17a2b8-05cb-42f4-957d-754b9242f5c4 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:43.255056 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1088/2162] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:59:43 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:59:43.276046 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801ef87b-e645-4e3c-b31b-e87fbbb8d41b None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:43.285613 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:59:43.299860 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801ef87b-e645-4e3c-b31b-e87fbbb8d41b None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:43.305307 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79514b11-0d49-4671-acc7-26eeca6a53f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17945e7d72954b8787e0ba09a9903247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:43.306629 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79514b11-0d49-4671-acc7-26eeca6a53f5 service cinder] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:43.307176 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79514b11-0d49-4671-acc7-26eeca6a53f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:43.307688 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79514b11-0d49-4671-acc7-26eeca6a53f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:43.324467 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79514b11-0d49-4671-acc7-26eeca6a53f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:43.326192 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79514b11-0d49-4671-acc7-26eeca6a53f5 service cinder] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:43.611614 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1089/2163] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:59:43 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 17:59:43.776264 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-bc17a2b8-05cb-42f4-957d-754b9242f5c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3011719a671849b79f5d8c90173cb3f5'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:43.776975 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-bc17a2b8-05cb-42f4-957d-754b9242f5c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3011719a671849b79f5d8c90173cb3f5'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:43.777575 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-bc17a2b8-05cb-42f4-957d-754b9242f5c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3011719a671849b79f5d8c90173cb3f5'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:43.972075 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-bc17a2b8-05cb-42f4-957d-754b9242f5c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3011719a671849b79f5d8c90173cb3f5'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:43.981617 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-bc17a2b8-05cb-42f4-957d-754b9242f5c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3011719a671849b79f5d8c90173cb3f5'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:44.008790 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1075/2164] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 14 17:59:43 2022] DELETE /identity/v3/users/3011719a671849b79f5d8c90173cb3f5 => generated 0 bytes in 971 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:59:44.013289 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a4a60a-c8a5-40bc-8cca-0339b792ac30 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:44.013579 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a4a60a-c8a5-40bc-8cca-0339b792ac30 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:44.013859 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a4a60a-c8a5-40bc-8cca-0339b792ac30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:44.035093 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-c7a4a60a-c8a5-40bc-8cca-0339b792ac30 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:59:44.036570 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-c7a4a60a-c8a5-40bc-8cca-0339b792ac30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:44.118087 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1090/2165] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:59:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 17:59:44.131790 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc17a2b8-05cb-42f4-957d-754b9242f5c4 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:44.134279 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-bc17a2b8-05cb-42f4-957d-754b9242f5c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:44.217425 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc17a2b8-05cb-42f4-957d-754b9242f5c4 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:44.223698 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47328374-9b64-4edf-96d6-1891a3c4993f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5652329c71cd431fb579d69cef933b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:44.224403 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47328374-9b64-4edf-96d6-1891a3c4993f service neutron] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:44.224697 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47328374-9b64-4edf-96d6-1891a3c4993f service neutron] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:44.224983 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47328374-9b64-4edf-96d6-1891a3c4993f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:44.236556 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47328374-9b64-4edf-96d6-1891a3c4993f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:44.238162 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47328374-9b64-4edf-96d6-1891a3c4993f service neutron] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:44.251294 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1076/2166] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:59:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:59:44.885178 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:59:44.940402 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a4a60a-c8a5-40bc-8cca-0339b792ac30 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:44.942089 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-c7a4a60a-c8a5-40bc-8cca-0339b792ac30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:44.954827 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a4a60a-c8a5-40bc-8cca-0339b792ac30 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:44.960546 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24783eba-9bbd-48f9-b812-4b82e4d3d878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:44.961581 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24783eba-9bbd-48f9-b812-4b82e4d3d878 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:44.961982 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24783eba-9bbd-48f9-b812-4b82e4d3d878 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:44.962154 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24783eba-9bbd-48f9-b812-4b82e4d3d878 admin admin] PATH_INFO: `/v3/projects/34872baed02a4a18969749a02a4fede5` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:44.963621 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24783eba-9bbd-48f9-b812-4b82e4d3d878 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34872baed02a4a18969749a02a4fede5)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:44.965567 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24783eba-9bbd-48f9-b812-4b82e4d3d878 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:45.066217 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-24783eba-9bbd-48f9-b812-4b82e4d3d878 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34872baed02a4a18969749a02a4fede5', 'request_id': 'req-24783eba-9bbd-48f9-b812-4b82e4d3d878'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:45.165880 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-24783eba-9bbd-48f9-b812-4b82e4d3d878 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34872baed02a4a18969749a02a4fede5', 'request_id': 'req-24783eba-9bbd-48f9-b812-4b82e4d3d878'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:45.175041 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-24783eba-9bbd-48f9-b812-4b82e4d3d878 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34872baed02a4a18969749a02a4fede5', 'request_id': 'req-24783eba-9bbd-48f9-b812-4b82e4d3d878'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:45.193655 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-24783eba-9bbd-48f9-b812-4b82e4d3d878 admin admin] The token cache is being invalidate because project 34872baed02a4a18969749a02a4fede5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87019) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 17:59:45.194027 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-24783eba-9bbd-48f9-b812-4b82e4d3d878 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:45.194865 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-24783eba-9bbd-48f9-b812-4b82e4d3d878 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:45.196959 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1091/2167] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 14 17:59:44 2022] DELETE /identity/v3/projects/34872baed02a4a18969749a02a4fede5 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:59:45.200475 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:59:45.200647 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47328374-9b64-4edf-96d6-1891a3c4993f service neutron] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:45.211694 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47328374-9b64-4edf-96d6-1891a3c4993f service neutron] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:45.281335 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67da9e1-ee15-4823-b235-1cca28f28def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:45.282796 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67da9e1-ee15-4823-b235-1cca28f28def admin admin] REQUEST_METHOD: `DELETE` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:45.283293 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67da9e1-ee15-4823-b235-1cca28f28def admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:45.283672 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67da9e1-ee15-4823-b235-1cca28f28def admin admin] PATH_INFO: `/v3/users/0fc14015381d4763bc538d7dce0ba3ca` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:45.285033 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67da9e1-ee15-4823-b235-1cca28f28def admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fc14015381d4763bc538d7dce0ba3ca)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:45.287762 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67da9e1-ee15-4823-b235-1cca28f28def admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:45.526140 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7be411a-6209-4444-a7e6-fa2c70cad36d None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:45.530374 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7be411a-6209-4444-a7e6-fa2c70cad36d None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:45.530374 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7be411a-6209-4444-a7e6-fa2c70cad36d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:45.545816 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-d7be411a-6209-4444-a7e6-fa2c70cad36d None None] MFA Rules not processed for user `e73368f3ce8a43368b30985898cf7393`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:59:45.549066 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-d7be411a-6209-4444-a7e6-fa2c70cad36d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:45.571699 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-f67da9e1-ee15-4823-b235-1cca28f28def admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fc14015381d4763bc538d7dce0ba3ca'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:45.572642 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-f67da9e1-ee15-4823-b235-1cca28f28def admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fc14015381d4763bc538d7dce0ba3ca'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:45.576622 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-f67da9e1-ee15-4823-b235-1cca28f28def admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fc14015381d4763bc538d7dce0ba3ca'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:45.628331 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1092/2168] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:59:45 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 17:59:45.696508 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-f67da9e1-ee15-4823-b235-1cca28f28def admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fc14015381d4763bc538d7dce0ba3ca'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:45.706312 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-f67da9e1-ee15-4823-b235-1cca28f28def admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fc14015381d4763bc538d7dce0ba3ca'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:45.730807 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1077/2169] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 14 17:59:45 2022] DELETE /identity/v3/users/0fc14015381d4763bc538d7dce0ba3ca => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:59:45.927239 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7be411a-6209-4444-a7e6-fa2c70cad36d None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:45.930004 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-d7be411a-6209-4444-a7e6-fa2c70cad36d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:45.951726 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7be411a-6209-4444-a7e6-fa2c70cad36d None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:46.049285 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e504c0-97d9-4c05-8d5b-3abe70146a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:46.050546 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e504c0-97d9-4c05-8d5b-3abe70146a2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:46.051063 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e504c0-97d9-4c05-8d5b-3abe70146a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:46.051663 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e504c0-97d9-4c05-8d5b-3abe70146a2b admin admin] PATH_INFO: `/v3/users/1c15123c8ebd44af81818563dde06c1d` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:46.053308 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e504c0-97d9-4c05-8d5b-3abe70146a2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c15123c8ebd44af81818563dde06c1d)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:46.056205 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e504c0-97d9-4c05-8d5b-3abe70146a2b admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:46.277939 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-c6e504c0-97d9-4c05-8d5b-3abe70146a2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c15123c8ebd44af81818563dde06c1d'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:46.278783 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-c6e504c0-97d9-4c05-8d5b-3abe70146a2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c15123c8ebd44af81818563dde06c1d'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:46.284564 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-c6e504c0-97d9-4c05-8d5b-3abe70146a2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c15123c8ebd44af81818563dde06c1d'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:46.428934 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-c6e504c0-97d9-4c05-8d5b-3abe70146a2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c15123c8ebd44af81818563dde06c1d'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:46.437493 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-c6e504c0-97d9-4c05-8d5b-3abe70146a2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c15123c8ebd44af81818563dde06c1d'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:46.439597 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67da9e1-ee15-4823-b235-1cca28f28def admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:46.442101 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-f67da9e1-ee15-4823-b235-1cca28f28def admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:46.458309 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1093/2170] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 14 17:59:45 2022] DELETE /identity/v3/users/1c15123c8ebd44af81818563dde06c1d => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:59:46.461978 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67da9e1-ee15-4823-b235-1cca28f28def admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:46.467334 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941b6281-68f2-424a-8966-1cee1fca4cb4 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:46.467524 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941b6281-68f2-424a-8966-1cee1fca4cb4 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:46.467721 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941b6281-68f2-424a-8966-1cee1fca4cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:46.487287 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-941b6281-68f2-424a-8966-1cee1fca4cb4 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:59:46.488545 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-941b6281-68f2-424a-8966-1cee1fca4cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:46.558843 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b9ce31-dcb8-47dc-a482-a94fad878f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:46.559825 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b9ce31-dcb8-47dc-a482-a94fad878f16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:46.560127 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b9ce31-dcb8-47dc-a482-a94fad878f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:46.560416 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b9ce31-dcb8-47dc-a482-a94fad878f16 admin admin] PATH_INFO: `/v3/projects/dc3225597f4b47f6ab4c3295e8d4d10e` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:46.561691 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b9ce31-dcb8-47dc-a482-a94fad878f16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc3225597f4b47f6ab4c3295e8d4d10e)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:46.564033 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b9ce31-dcb8-47dc-a482-a94fad878f16 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:46.579820 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1094/2171] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:59:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:59:46.592849 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941b6281-68f2-424a-8966-1cee1fca4cb4 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:46.600248 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-941b6281-68f2-424a-8966-1cee1fca4cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:46.680527 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941b6281-68f2-424a-8966-1cee1fca4cb4 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:46.695098 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-84b9ce31-dcb8-47dc-a482-a94fad878f16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc3225597f4b47f6ab4c3295e8d4d10e', 'request_id': 'req-84b9ce31-dcb8-47dc-a482-a94fad878f16'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:46.714822 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:59:46.735854 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a894ed6-f939-4ca5-874e-13d3369682da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5652329c71cd431fb579d69cef933b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:46.736420 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a894ed6-f939-4ca5-874e-13d3369682da service neutron] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:46.736711 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a894ed6-f939-4ca5-874e-13d3369682da service neutron] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:46.736999 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a894ed6-f939-4ca5-874e-13d3369682da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:46.784351 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-84b9ce31-dcb8-47dc-a482-a94fad878f16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc3225597f4b47f6ab4c3295e8d4d10e', 'request_id': 'req-84b9ce31-dcb8-47dc-a482-a94fad878f16'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:46.791807 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-84b9ce31-dcb8-47dc-a482-a94fad878f16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc3225597f4b47f6ab4c3295e8d4d10e', 'request_id': 'req-84b9ce31-dcb8-47dc-a482-a94fad878f16'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:46.803704 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-84b9ce31-dcb8-47dc-a482-a94fad878f16 admin admin] The token cache is being invalidate because project dc3225597f4b47f6ab4c3295e8d4d10e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 17:59:46.804038 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-84b9ce31-dcb8-47dc-a482-a94fad878f16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:46.804417 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a894ed6-f939-4ca5-874e-13d3369682da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:46.804913 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-84b9ce31-dcb8-47dc-a482-a94fad878f16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:46.805873 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a894ed6-f939-4ca5-874e-13d3369682da service neutron] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:46.806524 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1078/2172] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 14 17:59:46 2022] DELETE /identity/v3/projects/dc3225597f4b47f6ab4c3295e8d4d10e => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:59:46.810462 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b9ce31-dcb8-47dc-a482-a94fad878f16 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:46.811908 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-84b9ce31-dcb8-47dc-a482-a94fad878f16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:46.818105 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1095/2173] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:59:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:59:46.825097 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b9ce31-dcb8-47dc-a482-a94fad878f16 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:46.830332 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f935a5-7dc9-4eb0-a663-0e485e1ddb24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:46.831460 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f935a5-7dc9-4eb0-a663-0e485e1ddb24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:46.831823 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f935a5-7dc9-4eb0-a663-0e485e1ddb24 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:46.832199 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f935a5-7dc9-4eb0-a663-0e485e1ddb24 admin admin] PATH_INFO: `/v3/users/b8446cc5b1bf4778b5a8c2664fed757c` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:46.834121 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f935a5-7dc9-4eb0-a663-0e485e1ddb24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8446cc5b1bf4778b5a8c2664fed757c)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:46.836161 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f935a5-7dc9-4eb0-a663-0e485e1ddb24 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:47.051784 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:59:47.072374 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-64f935a5-7dc9-4eb0-a663-0e485e1ddb24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8446cc5b1bf4778b5a8c2664fed757c'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:47.073196 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-64f935a5-7dc9-4eb0-a663-0e485e1ddb24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8446cc5b1bf4778b5a8c2664fed757c'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:47.073865 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-64f935a5-7dc9-4eb0-a663-0e485e1ddb24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8446cc5b1bf4778b5a8c2664fed757c'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:47.193931 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-64f935a5-7dc9-4eb0-a663-0e485e1ddb24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8446cc5b1bf4778b5a8c2664fed757c'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:47.202487 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-64f935a5-7dc9-4eb0-a663-0e485e1ddb24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8446cc5b1bf4778b5a8c2664fed757c'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:47.227515 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1079/2174] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 14 17:59:46 2022] DELETE /identity/v3/users/b8446cc5b1bf4778b5a8c2664fed757c => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 17:59:47.320469 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a894ed6-f939-4ca5-874e-13d3369682da service neutron] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:47.322516 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-1a894ed6-f939-4ca5-874e-13d3369682da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:47.355180 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a894ed6-f939-4ca5-874e-13d3369682da service neutron] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:47.452345 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f15b2a-c1f8-497f-acb9-7a2ddbcea043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:47.467488 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f15b2a-c1f8-497f-acb9-7a2ddbcea043 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:47.467785 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f15b2a-c1f8-497f-acb9-7a2ddbcea043 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:47.468066 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f15b2a-c1f8-497f-acb9-7a2ddbcea043 admin admin] PATH_INFO: `/v3/projects/9703dd1b04904c4487490c78e5daff0c` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:47.471876 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f15b2a-c1f8-497f-acb9-7a2ddbcea043 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9703dd1b04904c4487490c78e5daff0c)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:47.476574 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f15b2a-c1f8-497f-acb9-7a2ddbcea043 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:47.723549 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-55f15b2a-c1f8-497f-acb9-7a2ddbcea043 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9703dd1b04904c4487490c78e5daff0c', 'request_id': 'req-55f15b2a-c1f8-497f-acb9-7a2ddbcea043'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:47.846259 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-55f15b2a-c1f8-497f-acb9-7a2ddbcea043 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9703dd1b04904c4487490c78e5daff0c', 'request_id': 'req-55f15b2a-c1f8-497f-acb9-7a2ddbcea043'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:47.853293 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-55f15b2a-c1f8-497f-acb9-7a2ddbcea043 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9703dd1b04904c4487490c78e5daff0c', 'request_id': 'req-55f15b2a-c1f8-497f-acb9-7a2ddbcea043'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:47.864805 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-55f15b2a-c1f8-497f-acb9-7a2ddbcea043 admin admin] The token cache is being invalidate because project 9703dd1b04904c4487490c78e5daff0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87019) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 17:59:47.865179 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-55f15b2a-c1f8-497f-acb9-7a2ddbcea043 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:47.865865 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-55f15b2a-c1f8-497f-acb9-7a2ddbcea043 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:47.878766 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1096/2175] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 14 17:59:47 2022] DELETE /identity/v3/projects/9703dd1b04904c4487490c78e5daff0c => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:59:47.997094 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f935a5-7dc9-4eb0-a663-0e485e1ddb24 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:47.999663 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-64f935a5-7dc9-4eb0-a663-0e485e1ddb24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:48.021803 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f935a5-7dc9-4eb0-a663-0e485e1ddb24 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:48.089772 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee9bb65-b447-41de-a2a5-d1b82cd47c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:48.090662 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee9bb65-b447-41de-a2a5-d1b82cd47c44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:48.090950 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee9bb65-b447-41de-a2a5-d1b82cd47c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:48.091234 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee9bb65-b447-41de-a2a5-d1b82cd47c44 admin admin] PATH_INFO: `/v3/projects/b877c1c33a1d4717aca1d02f58f84901` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:48.092472 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee9bb65-b447-41de-a2a5-d1b82cd47c44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b877c1c33a1d4717aca1d02f58f84901)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:48.094424 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee9bb65-b447-41de-a2a5-d1b82cd47c44 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:48.197046 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-9ee9bb65-b447-41de-a2a5-d1b82cd47c44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b877c1c33a1d4717aca1d02f58f84901', 'request_id': 'req-9ee9bb65-b447-41de-a2a5-d1b82cd47c44'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:48.274841 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-9ee9bb65-b447-41de-a2a5-d1b82cd47c44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b877c1c33a1d4717aca1d02f58f84901', 'request_id': 'req-9ee9bb65-b447-41de-a2a5-d1b82cd47c44'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:48.285050 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-9ee9bb65-b447-41de-a2a5-d1b82cd47c44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b877c1c33a1d4717aca1d02f58f84901', 'request_id': 'req-9ee9bb65-b447-41de-a2a5-d1b82cd47c44'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:48.287922 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:59:48.303912 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-9ee9bb65-b447-41de-a2a5-d1b82cd47c44 admin admin] The token cache is being invalidate because project b877c1c33a1d4717aca1d02f58f84901 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 17:59:48.304249 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-9ee9bb65-b447-41de-a2a5-d1b82cd47c44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:48.304985 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-9ee9bb65-b447-41de-a2a5-d1b82cd47c44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:59:48.306595 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1080/2176] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 14 17:59:47 2022] DELETE /identity/v3/projects/b877c1c33a1d4717aca1d02f58f84901 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:59:48.311966 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43d3c2f-959d-4d18-8fa5-bd49c30ef924 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:48.312495 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43d3c2f-959d-4d18-8fa5-bd49c30ef924 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:48.312998 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43d3c2f-959d-4d18-8fa5-bd49c30ef924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:48.336932 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-a43d3c2f-959d-4d18-8fa5-bd49c30ef924 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:59:48.338163 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-a43d3c2f-959d-4d18-8fa5-bd49c30ef924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:48.417284 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1097/2177] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:59:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:59:48.418839 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dd390e-f83b-4324-b266-826264bd6f7e None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:48.419137 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dd390e-f83b-4324-b266-826264bd6f7e None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:48.419466 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dd390e-f83b-4324-b266-826264bd6f7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:48.442947 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-b4dd390e-f83b-4324-b266-826264bd6f7e None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:59:48.444281 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-b4dd390e-f83b-4324-b266-826264bd6f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:48.452901 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1081/2178] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:59:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 17:59:48.458061 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43d3c2f-959d-4d18-8fa5-bd49c30ef924 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:48.468480 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43d3c2f-959d-4d18-8fa5-bd49c30ef924 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:48.474439 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9cda10-1b65-47ad-8144-967cac108727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:48.475225 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9cda10-1b65-47ad-8144-967cac108727 admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:48.475622 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9cda10-1b65-47ad-8144-967cac108727 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:48.475980 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9cda10-1b65-47ad-8144-967cac108727 admin admin] PATH_INFO: `/v3/domains` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:48.476862 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9cda10-1b65-47ad-8144-967cac108727 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:59:48.477254 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9cda10-1b65-47ad-8144-967cac108727 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:48.478969 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9cda10-1b65-47ad-8144-967cac108727 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:48.498282 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1098/2179] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 14 17:59:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:59:48.500165 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dd390e-f83b-4324-b266-826264bd6f7e None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:48.512061 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dd390e-f83b-4324-b266-826264bd6f7e None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:48.530423 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2951d61-49c0-40d7-9c12-f6f514cb6015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:48.531113 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2951d61-49c0-40d7-9c12-f6f514cb6015 admin admin] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:48.531436 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2951d61-49c0-40d7-9c12-f6f514cb6015 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:48.531723 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2951d61-49c0-40d7-9c12-f6f514cb6015 admin admin] PATH_INFO: `/v3/projects` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:48.533151 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2951d61-49c0-40d7-9c12-f6f514cb6015 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:48.535622 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2951d61-49c0-40d7-9c12-f6f514cb6015 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:48.661186 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1082/2180] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 14 17:59:48 2022] POST /identity/v3/projects => generated 373 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:59:48.664556 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:59:48.665865 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9cda10-1b65-47ad-8144-967cac108727 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:48.679270 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9cda10-1b65-47ad-8144-967cac108727 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:48.740138 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb99bd9e-89f6-41d8-9e33-aad771ddbc26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:48.740821 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb99bd9e-89f6-41d8-9e33-aad771ddbc26 admin admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:48.741109 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb99bd9e-89f6-41d8-9e33-aad771ddbc26 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:48.741589 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb99bd9e-89f6-41d8-9e33-aad771ddbc26 admin admin] PATH_INFO: `/v3/users` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:48.742149 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb99bd9e-89f6-41d8-9e33-aad771ddbc26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:48.744186 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb99bd9e-89f6-41d8-9e33-aad771ddbc26 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:48.852574 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1099/2181] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 14 17:59:48 2022] POST /identity/v3/users => generated 287 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 17:59:48.856789 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2951d61-49c0-40d7-9c12-f6f514cb6015 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:48.867883 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2951d61-49c0-40d7-9c12-f6f514cb6015 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:48.872483 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7acfcb-b6bb-44ad-b699-cd4baa43b081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:48.873215 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7acfcb-b6bb-44ad-b699-cd4baa43b081 admin admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:48.873759 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7acfcb-b6bb-44ad-b699-cd4baa43b081 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:48.874216 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7acfcb-b6bb-44ad-b699-cd4baa43b081 admin admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:48.875409 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7acfcb-b6bb-44ad-b699-cd4baa43b081 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:48.878079 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7acfcb-b6bb-44ad-b699-cd4baa43b081 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:48.889316 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1083/2182] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 17:59:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 14 17:59:48.898023 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb99bd9e-89f6-41d8-9e33-aad771ddbc26 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:48.908979 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb99bd9e-89f6-41d8-9e33-aad771ddbc26 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:48.913909 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab6bf01-7010-4ade-a23b-517ec1c4aa53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:48.914583 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab6bf01-7010-4ade-a23b-517ec1c4aa53 admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:48.914870 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab6bf01-7010-4ade-a23b-517ec1c4aa53 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:48.915284 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab6bf01-7010-4ade-a23b-517ec1c4aa53 admin admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:48.922172 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab6bf01-7010-4ade-a23b-517ec1c4aa53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:48.922172 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab6bf01-7010-4ade-a23b-517ec1c4aa53 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:48.927917 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1100/2183] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 17:59:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 17:59:48.932231 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7acfcb-b6bb-44ad-b699-cd4baa43b081 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:48.943782 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7acfcb-b6bb-44ad-b699-cd4baa43b081 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:48.948457 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb290e4f-3ed4-4262-b7b8-f398fec9ff59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:48.949352 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb290e4f-3ed4-4262-b7b8-f398fec9ff59 admin admin] REQUEST_METHOD: `PUT` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:48.949635 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb290e4f-3ed4-4262-b7b8-f398fec9ff59 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:48.949938 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb290e4f-3ed4-4262-b7b8-f398fec9ff59 admin admin] PATH_INFO: `/v3/projects/add35554d0514dc59890c61894593313/users/e6b1c08311384aa39ad01a8378c9a056/roles/9ee80134743f4c2b88525b04df2facba` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:48.967547 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb290e4f-3ed4-4262-b7b8-f398fec9ff59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=add35554d0514dc59890c61894593313, user_id=e6b1c08311384aa39ad01a8378c9a056, role_id=9ee80134743f4c2b88525b04df2facba)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:48.970289 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb290e4f-3ed4-4262-b7b8-f398fec9ff59 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:49.087019 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1084/2184] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 17:59:48 2022] PUT /identity/v3/projects/add35554d0514dc59890c61894593313/users/e6b1c08311384aa39ad01a8378c9a056/roles/9ee80134743f4c2b88525b04df2facba => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 17:59:49.092088 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12f3652-7954-4c15-8437-222f75ec2c1a None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:49.092412 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12f3652-7954-4c15-8437-222f75ec2c1a None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:49.092701 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12f3652-7954-4c15-8437-222f75ec2c1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:49.110944 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-d12f3652-7954-4c15-8437-222f75ec2c1a None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:59:49.112225 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-d12f3652-7954-4c15-8437-222f75ec2c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:49.175682 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1101/2185] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:59:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:59:49.184982 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb290e4f-3ed4-4262-b7b8-f398fec9ff59 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:49.186744 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-bb290e4f-3ed4-4262-b7b8-f398fec9ff59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:49.246761 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb290e4f-3ed4-4262-b7b8-f398fec9ff59 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:49.251237 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e9e7a7-1997-4dcf-a36b-27bcb8d4f7aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5652329c71cd431fb579d69cef933b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:49.252310 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e9e7a7-1997-4dcf-a36b-27bcb8d4f7aa service neutron] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:49.252478 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e9e7a7-1997-4dcf-a36b-27bcb8d4f7aa service neutron] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:49.252772 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e9e7a7-1997-4dcf-a36b-27bcb8d4f7aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:49.263627 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e9e7a7-1997-4dcf-a36b-27bcb8d4f7aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:49.265227 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e9e7a7-1997-4dcf-a36b-27bcb8d4f7aa service neutron] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:49.283917 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1085/2186] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:59:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:59:49.407910 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12f3652-7954-4c15-8437-222f75ec2c1a None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:49.409689 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-d12f3652-7954-4c15-8437-222f75ec2c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:49.498061 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12f3652-7954-4c15-8437-222f75ec2c1a None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:49.503246 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25d716f-d296-44b1-a010-66bd771b6375 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17945e7d72954b8787e0ba09a9903247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:49.503997 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25d716f-d296-44b1-a010-66bd771b6375 service cinder] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:49.504421 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25d716f-d296-44b1-a010-66bd771b6375 service cinder] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:49.504735 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25d716f-d296-44b1-a010-66bd771b6375 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:49.506665 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-b25d716f-d296-44b1-a010-66bd771b6375 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:49.624259 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25d716f-d296-44b1-a010-66bd771b6375 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:49.627653 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25d716f-d296-44b1-a010-66bd771b6375 service cinder] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:49.641270 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1102/2187] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 17:59:49 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:59:49.949406 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:59:51.492148 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=86,keystone:INSERT=7,keystone:DELETE=7 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:59:52.214742 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:59:52.830264 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:59:52.943221 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:59:53.630404 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:59:53.755169 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:59:54.493560 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:59:54.601381 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:59:55.129505 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:59:56.406977 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:59:56.933048 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:59:57.290424 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e22e579-4e18-4a52-967c-d3579cce25b5 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:57.290723 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e22e579-4e18-4a52-967c-d3579cce25b5 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:57.291016 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e22e579-4e18-4a52-967c-d3579cce25b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:57.329447 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-1e22e579-4e18-4a52-967c-d3579cce25b5 None None] MFA Rules not processed for user `e6b1c08311384aa39ad01a8378c9a056`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:59:57.331075 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-1e22e579-4e18-4a52-967c-d3579cce25b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:57.385310 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:59:57.474211 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1086/2188] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 17:59:57 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 17:59:57.481985 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25d716f-d296-44b1-a010-66bd771b6375 service cinder] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:57.514713 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25d716f-d296-44b1-a010-66bd771b6375 service cinder] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:57.527030 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bc77f3-5606-4034-b436-d8535aaab0bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:57.528638 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bc77f3-5606-4034-b436-d8535aaab0bd admin admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:57.529510 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bc77f3-5606-4034-b436-d8535aaab0bd admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:57.530030 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bc77f3-5606-4034-b436-d8535aaab0bd admin admin] PATH_INFO: `/v3/projects` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:57.531985 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bc77f3-5606-4034-b436-d8535aaab0bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:57.540883 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bc77f3-5606-4034-b436-d8535aaab0bd admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:57.726329 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1103/2189] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 14 17:59:57 2022] POST /identity/v3/projects => generated 373 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:59:57.730876 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e22e579-4e18-4a52-967c-d3579cce25b5 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:57.755485 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e22e579-4e18-4a52-967c-d3579cce25b5 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:57.874007 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d890ef17-700a-4e66-a643-8311249b2c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:57.875141 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d890ef17-700a-4e66-a643-8311249b2c86 admin admin] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:57.876547 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d890ef17-700a-4e66-a643-8311249b2c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:57.876987 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d890ef17-700a-4e66-a643-8311249b2c86 admin admin] PATH_INFO: `/v3/users` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:57.877922 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d890ef17-700a-4e66-a643-8311249b2c86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:57.880478 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d890ef17-700a-4e66-a643-8311249b2c86 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:58.036894 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1087/2190] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 14 17:59:57 2022] POST /identity/v3/users => generated 293 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:59:58.041642 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bc77f3-5606-4034-b436-d8535aaab0bd admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:58.066037 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bc77f3-5606-4034-b436-d8535aaab0bd admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:58.075813 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a433d66-f35c-4895-a668-26872f15b42e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:58.077062 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a433d66-f35c-4895-a668-26872f15b42e admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:58.077573 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a433d66-f35c-4895-a668-26872f15b42e admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:58.078075 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a433d66-f35c-4895-a668-26872f15b42e admin admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:58.080018 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a433d66-f35c-4895-a668-26872f15b42e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:58.083210 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a433d66-f35c-4895-a668-26872f15b42e admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:58.160938 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1104/2191] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 17:59:58 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 17:59:58.165781 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d890ef17-700a-4e66-a643-8311249b2c86 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:58.184223 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d890ef17-700a-4e66-a643-8311249b2c86 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:58.196239 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e412e719-eeb2-4df6-bfee-1d8d4c7fb618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:58.198182 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e412e719-eeb2-4df6-bfee-1d8d4c7fb618 admin admin] REQUEST_METHOD: `PUT` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:58.198808 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e412e719-eeb2-4df6-bfee-1d8d4c7fb618 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:58.199814 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e412e719-eeb2-4df6-bfee-1d8d4c7fb618 admin admin] PATH_INFO: `/v3/projects/1517fde6e66f4c0585da0a378adfaa54/users/6560a5b74b59431cbe301726e1e6822b/roles/1348580877d04014bfdec4d866b98a74` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:58.236229 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e412e719-eeb2-4df6-bfee-1d8d4c7fb618 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1517fde6e66f4c0585da0a378adfaa54, user_id=6560a5b74b59431cbe301726e1e6822b, role_id=1348580877d04014bfdec4d866b98a74)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:58.242984 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e412e719-eeb2-4df6-bfee-1d8d4c7fb618 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:58.271471 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:59:58.332566 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1088/2192] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 17:59:58 2022] PUT /identity/v3/projects/1517fde6e66f4c0585da0a378adfaa54/users/6560a5b74b59431cbe301726e1e6822b/roles/1348580877d04014bfdec4d866b98a74 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:59:58.337605 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a433d66-f35c-4895-a668-26872f15b42e admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:58.357238 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a433d66-f35c-4895-a668-26872f15b42e admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:58.472650 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa81ab5f-b516-410c-b9e8-41f9163e4a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:58.473446 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa81ab5f-b516-410c-b9e8-41f9163e4a4d admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:58.473784 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa81ab5f-b516-410c-b9e8-41f9163e4a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:58.474169 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa81ab5f-b516-410c-b9e8-41f9163e4a4d admin admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:58.475006 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa81ab5f-b516-410c-b9e8-41f9163e4a4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:58.476859 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa81ab5f-b516-410c-b9e8-41f9163e4a4d admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:58.493054 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1105/2193] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 17:59:58 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 17:59:58.498617 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e412e719-eeb2-4df6-bfee-1d8d4c7fb618 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:58.515520 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e412e719-eeb2-4df6-bfee-1d8d4c7fb618 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:58.523168 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0467124-f9ed-499d-abde-de480e49c273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:58.524205 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0467124-f9ed-499d-abde-de480e49c273 admin admin] REQUEST_METHOD: `PUT` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:58.524598 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0467124-f9ed-499d-abde-de480e49c273 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:58.524979 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0467124-f9ed-499d-abde-de480e49c273 admin admin] PATH_INFO: `/v3/projects/1517fde6e66f4c0585da0a378adfaa54/users/6560a5b74b59431cbe301726e1e6822b/roles/1348580877d04014bfdec4d866b98a74` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:58.527502 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0467124-f9ed-499d-abde-de480e49c273 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1517fde6e66f4c0585da0a378adfaa54, user_id=6560a5b74b59431cbe301726e1e6822b, role_id=1348580877d04014bfdec4d866b98a74)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:58.531689 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0467124-f9ed-499d-abde-de480e49c273 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:58.552290 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1089/2194] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 17:59:58 2022] PUT /identity/v3/projects/1517fde6e66f4c0585da0a378adfaa54/users/6560a5b74b59431cbe301726e1e6822b/roles/1348580877d04014bfdec4d866b98a74 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 18:00:00.103389 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:00:01.386143 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:00:07.636771 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44364e32-c9fd-490f-a47a-e0f2c551e7fb None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:07.637800 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44364e32-c9fd-490f-a47a-e0f2c551e7fb None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:07.637800 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44364e32-c9fd-490f-a47a-e0f2c551e7fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:07.716410 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-44364e32-c9fd-490f-a47a-e0f2c551e7fb None None] MFA Rules not processed for user `9c7ab182f1fd41718376a8e2f03ec87c`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:00:07.717886 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-44364e32-c9fd-490f-a47a-e0f2c551e7fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:07.796621 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:00:07.823177 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1106/2195] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:00:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:00:09.472217 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe58dcea-3967-437a-a4ff-3d6cf4bfe366 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:09.473735 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe58dcea-3967-437a-a4ff-3d6cf4bfe366 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:09.475258 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe58dcea-3967-437a-a4ff-3d6cf4bfe366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:09.484030 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:00:09.510223 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-fe58dcea-3967-437a-a4ff-3d6cf4bfe366 None None] MFA Rules not processed for user `6560a5b74b59431cbe301726e1e6822b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:00:09.512340 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-fe58dcea-3967-437a-a4ff-3d6cf4bfe366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:09.660387 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1090/2196] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:00:09 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:00:09.675859 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44364e32-c9fd-490f-a47a-e0f2c551e7fb None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:09.678180 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-44364e32-c9fd-490f-a47a-e0f2c551e7fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:09.842133 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44364e32-c9fd-490f-a47a-e0f2c551e7fb None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:09.858856 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c20073-f347-41d7-86d8-74e951e306a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4696d396adb495ab300a9a5a5727595', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:09.859730 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c20073-f347-41d7-86d8-74e951e306a1 service nova] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:09.861058 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c20073-f347-41d7-86d8-74e951e306a1 service nova] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:09.861550 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c20073-f347-41d7-86d8-74e951e306a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:09.950855 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c20073-f347-41d7-86d8-74e951e306a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:09.952685 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c20073-f347-41d7-86d8-74e951e306a1 service nova] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:09.977789 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1107/2197] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 18:00:09 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:00:14.523675 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7948e2ce-d6ad-4461-8db5-0d55da887dcb None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:14.525554 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7948e2ce-d6ad-4461-8db5-0d55da887dcb None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:14.526424 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7948e2ce-d6ad-4461-8db5-0d55da887dcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:14.576659 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-7948e2ce-d6ad-4461-8db5-0d55da887dcb None None] MFA Rules not processed for user `e6b1c08311384aa39ad01a8378c9a056`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:00:14.580723 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-7948e2ce-d6ad-4461-8db5-0d55da887dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:14.596504 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1091/2198] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:00:14 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:00:15.589431 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c05942a-63da-4602-b96b-c0a655af8147 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:15.591287 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c05942a-63da-4602-b96b-c0a655af8147 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:15.593078 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c05942a-63da-4602-b96b-c0a655af8147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:15.636863 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-1c05942a-63da-4602-b96b-c0a655af8147 None None] MFA Rules not processed for user `f1e32638fe5c4d2d8d3e2e4ea8250aaa`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:00:15.640706 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-1c05942a-63da-4602-b96b-c0a655af8147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:15.844183 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1108/2199] 10.222.0.36 () {58 vars in 1009 bytes} [Tue Jun 14 18:00:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:00:15.911732 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7948e2ce-d6ad-4461-8db5-0d55da887dcb None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:15.911732 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-7948e2ce-d6ad-4461-8db5-0d55da887dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:16.155854 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7948e2ce-d6ad-4461-8db5-0d55da887dcb None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:16.169584 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c4f02b-daa3-4646-a96f-548f72855de4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba38b47a31b14526be0aa2054841881b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:16.170062 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c4f02b-daa3-4646-a96f-548f72855de4 service swift] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:16.170358 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c4f02b-daa3-4646-a96f-548f72855de4 service swift] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:16.170713 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c4f02b-daa3-4646-a96f-548f72855de4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:16.211785 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c4f02b-daa3-4646-a96f-548f72855de4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:16.215036 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c4f02b-daa3-4646-a96f-548f72855de4 service swift] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:16.250909 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1092/2200] 10.222.0.36 () {60 vars in 1384 bytes} [Tue Jun 14 18:00:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 14 18:00:23.324691 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c05942a-63da-4602-b96b-c0a655af8147 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:23.327160 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-1c05942a-63da-4602-b96b-c0a655af8147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:23.379833 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:00:23.519057 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c05942a-63da-4602-b96b-c0a655af8147 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:23.524662 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fed200f-90ef-424d-82c2-c071bbd4dcc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:23.527228 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fed200f-90ef-424d-82c2-c071bbd4dcc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:23.527228 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fed200f-90ef-424d-82c2-c071bbd4dcc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:23.527228 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fed200f-90ef-424d-82c2-c071bbd4dcc9 admin admin] PATH_INFO: `/v3/users/d8eff1894e41455288dbe30311711e90` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:23.528688 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fed200f-90ef-424d-82c2-c071bbd4dcc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8eff1894e41455288dbe30311711e90)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:23.530711 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fed200f-90ef-424d-82c2-c071bbd4dcc9 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:24.071723 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-3fed200f-90ef-424d-82c2-c071bbd4dcc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8eff1894e41455288dbe30311711e90'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:24.072638 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-3fed200f-90ef-424d-82c2-c071bbd4dcc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8eff1894e41455288dbe30311711e90'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:24.073274 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-3fed200f-90ef-424d-82c2-c071bbd4dcc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8eff1894e41455288dbe30311711e90'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:24.148900 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-3fed200f-90ef-424d-82c2-c071bbd4dcc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8eff1894e41455288dbe30311711e90'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:24.163172 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-3fed200f-90ef-424d-82c2-c071bbd4dcc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8eff1894e41455288dbe30311711e90'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:24.215935 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1109/2201] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 14 18:00:23 2022] DELETE /identity/v3/users/d8eff1894e41455288dbe30311711e90 => generated 0 bytes in 889 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:00:24.217356 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2696af6-74a1-4b6a-9f3e-42728d289e25 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:24.217912 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2696af6-74a1-4b6a-9f3e-42728d289e25 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:24.217912 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2696af6-74a1-4b6a-9f3e-42728d289e25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:24.269096 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-a2696af6-74a1-4b6a-9f3e-42728d289e25 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:00:24.271125 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-a2696af6-74a1-4b6a-9f3e-42728d289e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:24.399994 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:00:24.410992 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1093/2202] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:00:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:00:24.426386 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fed200f-90ef-424d-82c2-c071bbd4dcc9 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:24.428095 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-3fed200f-90ef-424d-82c2-c071bbd4dcc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:24.617607 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:00:24.624935 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fed200f-90ef-424d-82c2-c071bbd4dcc9 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:24.630164 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57ba63b-071f-4991-ac16-88c7d94fde64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5652329c71cd431fb579d69cef933b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:24.631017 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57ba63b-071f-4991-ac16-88c7d94fde64 service neutron] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:24.631398 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57ba63b-071f-4991-ac16-88c7d94fde64 service neutron] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:24.631748 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57ba63b-071f-4991-ac16-88c7d94fde64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:24.648035 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57ba63b-071f-4991-ac16-88c7d94fde64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:24.655177 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57ba63b-071f-4991-ac16-88c7d94fde64 service neutron] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:24.663197 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1110/2203] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 18:00:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:00:25.505054 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2696af6-74a1-4b6a-9f3e-42728d289e25 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:25.508261 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-a2696af6-74a1-4b6a-9f3e-42728d289e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:25.551909 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2696af6-74a1-4b6a-9f3e-42728d289e25 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:25.591554 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fb1329-a8fa-4766-8a9a-f62fc1fd8ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:25.605803 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fb1329-a8fa-4766-8a9a-f62fc1fd8ac2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:25.606216 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fb1329-a8fa-4766-8a9a-f62fc1fd8ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:25.611348 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fb1329-a8fa-4766-8a9a-f62fc1fd8ac2 admin admin] PATH_INFO: `/v3/projects/7b82bb2e7afd47b5a36e2f674754247f` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:25.611348 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fb1329-a8fa-4766-8a9a-f62fc1fd8ac2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b82bb2e7afd47b5a36e2f674754247f)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:25.612177 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fb1329-a8fa-4766-8a9a-f62fc1fd8ac2 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:25.814326 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-87fb1329-a8fa-4766-8a9a-f62fc1fd8ac2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b82bb2e7afd47b5a36e2f674754247f', 'request_id': 'req-87fb1329-a8fa-4766-8a9a-f62fc1fd8ac2'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:25.910620 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-87fb1329-a8fa-4766-8a9a-f62fc1fd8ac2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b82bb2e7afd47b5a36e2f674754247f', 'request_id': 'req-87fb1329-a8fa-4766-8a9a-f62fc1fd8ac2'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:25.924181 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-87fb1329-a8fa-4766-8a9a-f62fc1fd8ac2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b82bb2e7afd47b5a36e2f674754247f', 'request_id': 'req-87fb1329-a8fa-4766-8a9a-f62fc1fd8ac2'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:25.944093 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-87fb1329-a8fa-4766-8a9a-f62fc1fd8ac2 admin admin] The token cache is being invalidate because project 7b82bb2e7afd47b5a36e2f674754247f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:00:25.944793 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-87fb1329-a8fa-4766-8a9a-f62fc1fd8ac2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:25.945690 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-87fb1329-a8fa-4766-8a9a-f62fc1fd8ac2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:25.947894 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1094/2204] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 14 18:00:25 2022] DELETE /identity/v3/projects/7b82bb2e7afd47b5a36e2f674754247f => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:00:25.953404 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57ba63b-071f-4991-ac16-88c7d94fde64 service neutron] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:25.978312 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57ba63b-071f-4991-ac16-88c7d94fde64 service neutron] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:26.096458 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3841fb-a330-4d32-9636-73d5a191b5e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:26.097640 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3841fb-a330-4d32-9636-73d5a191b5e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:26.097966 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3841fb-a330-4d32-9636-73d5a191b5e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:26.098469 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3841fb-a330-4d32-9636-73d5a191b5e2 admin admin] PATH_INFO: `/v3/users/72422ce0ee5b43f98f9faee61b3d7e05` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:26.108434 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3841fb-a330-4d32-9636-73d5a191b5e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72422ce0ee5b43f98f9faee61b3d7e05)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:26.115333 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3841fb-a330-4d32-9636-73d5a191b5e2 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:26.488974 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-2f3841fb-a330-4d32-9636-73d5a191b5e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72422ce0ee5b43f98f9faee61b3d7e05'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:26.494951 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-2f3841fb-a330-4d32-9636-73d5a191b5e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72422ce0ee5b43f98f9faee61b3d7e05'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:26.498195 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-2f3841fb-a330-4d32-9636-73d5a191b5e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72422ce0ee5b43f98f9faee61b3d7e05'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:26.629240 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-2f3841fb-a330-4d32-9636-73d5a191b5e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72422ce0ee5b43f98f9faee61b3d7e05'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:26.642987 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-2f3841fb-a330-4d32-9636-73d5a191b5e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72422ce0ee5b43f98f9faee61b3d7e05'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:26.701973 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1111/2205] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 14 18:00:25 2022] DELETE /identity/v3/users/72422ce0ee5b43f98f9faee61b3d7e05 => generated 0 bytes in 750 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:00:27.787889 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fb1329-a8fa-4766-8a9a-f62fc1fd8ac2 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:27.792493 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-87fb1329-a8fa-4766-8a9a-f62fc1fd8ac2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:27.893432 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fb1329-a8fa-4766-8a9a-f62fc1fd8ac2 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:28.046801 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcb6f0d-aa1a-4627-8f57-5e12fac24ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:28.048894 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb6f0d-aa1a-4627-8f57-5e12fac24ee7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:28.048894 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb6f0d-aa1a-4627-8f57-5e12fac24ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:28.049342 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb6f0d-aa1a-4627-8f57-5e12fac24ee7 admin admin] PATH_INFO: `/v3/projects/b910e2d0b73b46ea9ee2d4de491fb3eb` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:28.050840 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcb6f0d-aa1a-4627-8f57-5e12fac24ee7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b910e2d0b73b46ea9ee2d4de491fb3eb)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:28.053492 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcb6f0d-aa1a-4627-8f57-5e12fac24ee7 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:28.673546 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-0bcb6f0d-aa1a-4627-8f57-5e12fac24ee7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b910e2d0b73b46ea9ee2d4de491fb3eb', 'request_id': 'req-0bcb6f0d-aa1a-4627-8f57-5e12fac24ee7'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:28.754925 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-0bcb6f0d-aa1a-4627-8f57-5e12fac24ee7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b910e2d0b73b46ea9ee2d4de491fb3eb', 'request_id': 'req-0bcb6f0d-aa1a-4627-8f57-5e12fac24ee7'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:28.777803 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-0bcb6f0d-aa1a-4627-8f57-5e12fac24ee7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b910e2d0b73b46ea9ee2d4de491fb3eb', 'request_id': 'req-0bcb6f0d-aa1a-4627-8f57-5e12fac24ee7'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:28.804477 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-0bcb6f0d-aa1a-4627-8f57-5e12fac24ee7 admin admin] The token cache is being invalidate because project b910e2d0b73b46ea9ee2d4de491fb3eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:00:28.805607 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-0bcb6f0d-aa1a-4627-8f57-5e12fac24ee7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:28.806603 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-0bcb6f0d-aa1a-4627-8f57-5e12fac24ee7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:28.810500 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1095/2206] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 14 18:00:27 2022] DELETE /identity/v3/projects/b910e2d0b73b46ea9ee2d4de491fb3eb => generated 0 bytes in 1030 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:00:28.818296 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18eb15c-86e9-4fd9-ad33-a17e87fb93b0 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:28.819198 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18eb15c-86e9-4fd9-ad33-a17e87fb93b0 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:28.819514 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18eb15c-86e9-4fd9-ad33-a17e87fb93b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:29.050345 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-f18eb15c-86e9-4fd9-ad33-a17e87fb93b0 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:00:29.053164 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-f18eb15c-86e9-4fd9-ad33-a17e87fb93b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:29.225467 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:00:29.305104 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1112/2207] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:00:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 488 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:00:29.307032 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4e4746-0671-4f1f-bcab-4bba106726e6 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:29.307882 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4e4746-0671-4f1f-bcab-4bba106726e6 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:29.308809 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4e4746-0671-4f1f-bcab-4bba106726e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:29.395699 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-5b4e4746-0671-4f1f-bcab-4bba106726e6 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:00:29.398344 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-5b4e4746-0671-4f1f-bcab-4bba106726e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:29.464986 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1096/2208] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:00:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:00:29.474364 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18eb15c-86e9-4fd9-ad33-a17e87fb93b0 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:29.487623 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18eb15c-86e9-4fd9-ad33-a17e87fb93b0 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:29.498115 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbdf7d7-ab0b-4197-8807-e6151415e914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:29.498115 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbdf7d7-ab0b-4197-8807-e6151415e914 admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:29.498115 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbdf7d7-ab0b-4197-8807-e6151415e914 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:29.502380 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbdf7d7-ab0b-4197-8807-e6151415e914 admin admin] PATH_INFO: `/v3/domains` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:29.502380 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbdf7d7-ab0b-4197-8807-e6151415e914 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 18:00:29.502380 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbdf7d7-ab0b-4197-8807-e6151415e914 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:29.502380 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbdf7d7-ab0b-4197-8807-e6151415e914 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:29.526757 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1113/2209] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 14 18:00:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 18:00:29.535646 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4e4746-0671-4f1f-bcab-4bba106726e6 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:29.561851 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4e4746-0671-4f1f-bcab-4bba106726e6 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:29.592023 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f29fed-5475-4958-870a-bfdec449d826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:29.592023 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f29fed-5475-4958-870a-bfdec449d826 admin admin] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:29.592023 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f29fed-5475-4958-870a-bfdec449d826 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:29.592023 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f29fed-5475-4958-870a-bfdec449d826 admin admin] PATH_INFO: `/v3/projects` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:29.592406 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f29fed-5475-4958-870a-bfdec449d826 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:29.592406 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f29fed-5475-4958-870a-bfdec449d826 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:29.600124 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:00:29.730575 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1097/2210] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 14 18:00:29 2022] POST /identity/v3/projects => generated 365 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:00:29.732252 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbdf7d7-ab0b-4197-8807-e6151415e914 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:29.754979 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbdf7d7-ab0b-4197-8807-e6151415e914 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:29.917543 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ae8b26-a44c-47ac-8862-d27bd77472d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:29.918617 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ae8b26-a44c-47ac-8862-d27bd77472d2 admin admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:29.918617 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ae8b26-a44c-47ac-8862-d27bd77472d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:29.918910 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ae8b26-a44c-47ac-8862-d27bd77472d2 admin admin] PATH_INFO: `/v3/users` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:29.919610 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ae8b26-a44c-47ac-8862-d27bd77472d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:29.921720 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ae8b26-a44c-47ac-8862-d27bd77472d2 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:30.083635 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1114/2211] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 14 18:00:29 2022] POST /identity/v3/users => generated 283 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:00:30.085442 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f29fed-5475-4958-870a-bfdec449d826 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:30.115785 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f29fed-5475-4958-870a-bfdec449d826 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:30.142499 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f61347-00dd-4d33-aa56-774a7477f0c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:30.143683 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f61347-00dd-4d33-aa56-774a7477f0c0 admin admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:30.144304 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f61347-00dd-4d33-aa56-774a7477f0c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:30.145084 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f61347-00dd-4d33-aa56-774a7477f0c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:30.162762 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f61347-00dd-4d33-aa56-774a7477f0c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:30.183425 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f61347-00dd-4d33-aa56-774a7477f0c0 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:30.216670 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1098/2212] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 18:00:30 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 14 18:00:30.218512 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ae8b26-a44c-47ac-8862-d27bd77472d2 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:30.241593 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ae8b26-a44c-47ac-8862-d27bd77472d2 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:30.254044 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d946083-ec55-413b-b3c5-e10a657cc676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:30.255447 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d946083-ec55-413b-b3c5-e10a657cc676 admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:30.256011 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d946083-ec55-413b-b3c5-e10a657cc676 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:30.256622 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d946083-ec55-413b-b3c5-e10a657cc676 admin admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:30.257883 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d946083-ec55-413b-b3c5-e10a657cc676 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:30.260500 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d946083-ec55-413b-b3c5-e10a657cc676 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:30.294428 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1115/2213] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 18:00:30 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:00:30.302401 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f61347-00dd-4d33-aa56-774a7477f0c0 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:30.354049 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f61347-00dd-4d33-aa56-774a7477f0c0 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:30.354049 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc155eee-444f-4f46-9865-224d1062c24b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:30.354927 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc155eee-444f-4f46-9865-224d1062c24b admin admin] REQUEST_METHOD: `PUT` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:30.358360 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc155eee-444f-4f46-9865-224d1062c24b admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:30.359007 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc155eee-444f-4f46-9865-224d1062c24b admin admin] PATH_INFO: `/v3/projects/b66cdedecbee458a926d4cbc1d9dfa57/users/f3210a0a1d9d43878b4569b8c071309f/roles/9ee80134743f4c2b88525b04df2facba` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:30.402781 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc155eee-444f-4f46-9865-224d1062c24b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b66cdedecbee458a926d4cbc1d9dfa57, user_id=f3210a0a1d9d43878b4569b8c071309f, role_id=9ee80134743f4c2b88525b04df2facba)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:30.407331 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc155eee-444f-4f46-9865-224d1062c24b admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:30.548369 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1099/2214] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 18:00:30 2022] PUT /identity/v3/projects/b66cdedecbee458a926d4cbc1d9dfa57/users/f3210a0a1d9d43878b4569b8c071309f/roles/9ee80134743f4c2b88525b04df2facba => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:00:30.558803 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b26020-1f3d-4ef2-bedd-2e48151ff86d None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:30.559435 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b26020-1f3d-4ef2-bedd-2e48151ff86d None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:30.559954 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b26020-1f3d-4ef2-bedd-2e48151ff86d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:30.644189 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-c1b26020-1f3d-4ef2-bedd-2e48151ff86d None None] MFA Rules not processed for user `f3210a0a1d9d43878b4569b8c071309f`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:00:30.645884 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-c1b26020-1f3d-4ef2-bedd-2e48151ff86d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:30.847797 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1116/2215] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:00:30 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:00:30.852149 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc155eee-444f-4f46-9865-224d1062c24b admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:31.121542 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc155eee-444f-4f46-9865-224d1062c24b admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:31.155153 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9979c04d-21c5-4718-8078-4cc2e26a63e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:31.157556 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9979c04d-21c5-4718-8078-4cc2e26a63e0 admin admin] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:31.158428 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9979c04d-21c5-4718-8078-4cc2e26a63e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:31.159458 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9979c04d-21c5-4718-8078-4cc2e26a63e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:31.162314 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9979c04d-21c5-4718-8078-4cc2e26a63e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:31.167791 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9979c04d-21c5-4718-8078-4cc2e26a63e0 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:31.341501 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1100/2216] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 14 18:00:30 2022] POST /identity/v3/projects => generated 365 bytes in 485 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 18:00:31.343399 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b26020-1f3d-4ef2-bedd-2e48151ff86d None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:31.364153 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b26020-1f3d-4ef2-bedd-2e48151ff86d None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:31.446065 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:00:31.478813 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b6822a-fab1-4630-a221-3e19a9aa356e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:31.479548 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b6822a-fab1-4630-a221-3e19a9aa356e admin admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:31.480024 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b6822a-fab1-4630-a221-3e19a9aa356e admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:31.480638 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b6822a-fab1-4630-a221-3e19a9aa356e admin admin] PATH_INFO: `/v3/users` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:31.481541 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b6822a-fab1-4630-a221-3e19a9aa356e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:31.484251 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b6822a-fab1-4630-a221-3e19a9aa356e admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:31.686311 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1117/2217] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 14 18:00:31 2022] POST /identity/v3/users => generated 289 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 18:00:31.692633 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9979c04d-21c5-4718-8078-4cc2e26a63e0 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:31.716917 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9979c04d-21c5-4718-8078-4cc2e26a63e0 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:31.730168 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4283996a-942f-4a8d-94f6-97d12290e727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:31.731937 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4283996a-942f-4a8d-94f6-97d12290e727 admin admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:31.732365 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4283996a-942f-4a8d-94f6-97d12290e727 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:31.732864 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4283996a-942f-4a8d-94f6-97d12290e727 admin admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:31.734099 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4283996a-942f-4a8d-94f6-97d12290e727 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:31.748087 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4283996a-942f-4a8d-94f6-97d12290e727 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:31.774963 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1101/2218] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 18:00:31 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:00:31.776918 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b6822a-fab1-4630-a221-3e19a9aa356e admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:31.802777 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b6822a-fab1-4630-a221-3e19a9aa356e admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:31.814582 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5675977a-8e31-42b1-b184-83a651e3065a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:31.816509 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5675977a-8e31-42b1-b184-83a651e3065a admin admin] REQUEST_METHOD: `PUT` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:31.817007 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5675977a-8e31-42b1-b184-83a651e3065a admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:31.817487 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5675977a-8e31-42b1-b184-83a651e3065a admin admin] PATH_INFO: `/v3/projects/b52f311317324844873120c3a5a4ae9e/users/8dde5cc983e34c59a3ad26d24f9d4766/roles/1348580877d04014bfdec4d866b98a74` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:31.856362 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5675977a-8e31-42b1-b184-83a651e3065a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b52f311317324844873120c3a5a4ae9e, user_id=8dde5cc983e34c59a3ad26d24f9d4766, role_id=1348580877d04014bfdec4d866b98a74)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:31.861162 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5675977a-8e31-42b1-b184-83a651e3065a admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:32.002117 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1118/2219] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 18:00:31 2022] PUT /identity/v3/projects/b52f311317324844873120c3a5a4ae9e/users/8dde5cc983e34c59a3ad26d24f9d4766/roles/1348580877d04014bfdec4d866b98a74 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:00:32.011372 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4283996a-942f-4a8d-94f6-97d12290e727 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:32.051844 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4283996a-942f-4a8d-94f6-97d12290e727 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:32.225711 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5896233-4db6-4659-85b8-5129ce19426f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:32.226616 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5896233-4db6-4659-85b8-5129ce19426f admin admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:32.227162 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5896233-4db6-4659-85b8-5129ce19426f admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:32.227591 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5896233-4db6-4659-85b8-5129ce19426f admin admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:32.228489 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5896233-4db6-4659-85b8-5129ce19426f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:32.243669 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5896233-4db6-4659-85b8-5129ce19426f admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:32.263393 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1102/2220] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 18:00:32 2022] GET /identity/v3/roles => generated 1420 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 14 18:00:32.270108 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5675977a-8e31-42b1-b184-83a651e3065a admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:32.294812 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5675977a-8e31-42b1-b184-83a651e3065a admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:32.307102 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7c3bf3-af63-48dc-af15-b85b4b7b4352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:32.308210 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7c3bf3-af63-48dc-af15-b85b4b7b4352 admin admin] REQUEST_METHOD: `PUT` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:32.309114 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7c3bf3-af63-48dc-af15-b85b4b7b4352 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:32.309230 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7c3bf3-af63-48dc-af15-b85b4b7b4352 admin admin] PATH_INFO: `/v3/projects/b52f311317324844873120c3a5a4ae9e/users/8dde5cc983e34c59a3ad26d24f9d4766/roles/1348580877d04014bfdec4d866b98a74` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:32.313759 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7c3bf3-af63-48dc-af15-b85b4b7b4352 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b52f311317324844873120c3a5a4ae9e, user_id=8dde5cc983e34c59a3ad26d24f9d4766, role_id=1348580877d04014bfdec4d866b98a74)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:32.320243 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7c3bf3-af63-48dc-af15-b85b4b7b4352 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:32.349309 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1119/2221] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 18:00:32 2022] PUT /identity/v3/projects/b52f311317324844873120c3a5a4ae9e/users/8dde5cc983e34c59a3ad26d24f9d4766/roles/1348580877d04014bfdec4d866b98a74 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:00:32.370941 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405edc5d-ef08-41fa-904d-a5aa702ea748 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:32.372402 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405edc5d-ef08-41fa-904d-a5aa702ea748 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:32.372929 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405edc5d-ef08-41fa-904d-a5aa702ea748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:32.436741 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-405edc5d-ef08-41fa-904d-a5aa702ea748 None None] MFA Rules not processed for user `8dde5cc983e34c59a3ad26d24f9d4766`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:00:32.439627 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-405edc5d-ef08-41fa-904d-a5aa702ea748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:32.497838 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:00:32.668609 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1103/2222] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:00:32 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:00:32.688336 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7c3bf3-af63-48dc-af15-b85b4b7b4352 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:32.690301 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-9d7c3bf3-af63-48dc-af15-b85b4b7b4352 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:32.805428 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7c3bf3-af63-48dc-af15-b85b4b7b4352 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:32.814274 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f418aba-a3da-4363-9ebb-0626ffab1727 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17945e7d72954b8787e0ba09a9903247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:32.816793 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f418aba-a3da-4363-9ebb-0626ffab1727 service cinder] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:32.817299 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f418aba-a3da-4363-9ebb-0626ffab1727 service cinder] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:32.817814 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f418aba-a3da-4363-9ebb-0626ffab1727 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:32.841666 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f418aba-a3da-4363-9ebb-0626ffab1727 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:32.845090 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f418aba-a3da-4363-9ebb-0626ffab1727 service cinder] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:32.868014 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1120/2223] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 18:00:32 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:00:33.402845 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405edc5d-ef08-41fa-904d-a5aa702ea748 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:33.412138 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-405edc5d-ef08-41fa-904d-a5aa702ea748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:33.441306 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405edc5d-ef08-41fa-904d-a5aa702ea748 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:33.446472 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be343763-d13c-413c-846a-2399b45d397c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17945e7d72954b8787e0ba09a9903247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:33.448137 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be343763-d13c-413c-846a-2399b45d397c service cinder] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:33.448705 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be343763-d13c-413c-846a-2399b45d397c service cinder] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:33.449213 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be343763-d13c-413c-846a-2399b45d397c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:33.635392 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be343763-d13c-413c-846a-2399b45d397c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:33.659009 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be343763-d13c-413c-846a-2399b45d397c service cinder] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:33.661323 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1104/2224] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 18:00:33 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:00:42.527828 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f418aba-a3da-4363-9ebb-0626ffab1727 service cinder] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:42.617526 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f418aba-a3da-4363-9ebb-0626ffab1727 service cinder] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:42.623447 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ffb1af-7ee8-42cc-a5e8-307633919f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:42.624820 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ffb1af-7ee8-42cc-a5e8-307633919f6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:42.625173 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ffb1af-7ee8-42cc-a5e8-307633919f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:42.625582 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ffb1af-7ee8-42cc-a5e8-307633919f6b admin admin] PATH_INFO: `/v3/users/f3210a0a1d9d43878b4569b8c071309f` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:42.628333 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ffb1af-7ee8-42cc-a5e8-307633919f6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3210a0a1d9d43878b4569b8c071309f)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:42.630765 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ffb1af-7ee8-42cc-a5e8-307633919f6b admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:42.841154 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:00:42.851401 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-f6ffb1af-7ee8-42cc-a5e8-307633919f6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3210a0a1d9d43878b4569b8c071309f'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:42.852117 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-f6ffb1af-7ee8-42cc-a5e8-307633919f6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3210a0a1d9d43878b4569b8c071309f'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:42.852741 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-f6ffb1af-7ee8-42cc-a5e8-307633919f6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3210a0a1d9d43878b4569b8c071309f'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:42.919843 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-f6ffb1af-7ee8-42cc-a5e8-307633919f6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3210a0a1d9d43878b4569b8c071309f'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:42.930253 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-f6ffb1af-7ee8-42cc-a5e8-307633919f6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3210a0a1d9d43878b4569b8c071309f'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:42.950304 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1121/2225] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 14 18:00:42 2022] DELETE /identity/v3/users/f3210a0a1d9d43878b4569b8c071309f => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:00:42.956125 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bb85ce-5795-44f7-99f9-1d51b9879be9 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:42.956888 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bb85ce-5795-44f7-99f9-1d51b9879be9 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:42.956888 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bb85ce-5795-44f7-99f9-1d51b9879be9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:42.977368 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-e0bb85ce-5795-44f7-99f9-1d51b9879be9 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:00:42.978634 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-e0bb85ce-5795-44f7-99f9-1d51b9879be9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:43.077141 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1105/2226] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:00:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:00:43.087993 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ffb1af-7ee8-42cc-a5e8-307633919f6b admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:43.089544 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-f6ffb1af-7ee8-42cc-a5e8-307633919f6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:43.176337 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ffb1af-7ee8-42cc-a5e8-307633919f6b admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:43.180165 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788f99a8-0f7d-4e7f-9555-58d2ba578369 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5652329c71cd431fb579d69cef933b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:43.180835 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788f99a8-0f7d-4e7f-9555-58d2ba578369 service neutron] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:43.181122 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788f99a8-0f7d-4e7f-9555-58d2ba578369 service neutron] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:43.181403 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788f99a8-0f7d-4e7f-9555-58d2ba578369 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:43.199135 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788f99a8-0f7d-4e7f-9555-58d2ba578369 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:43.201976 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788f99a8-0f7d-4e7f-9555-58d2ba578369 service neutron] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:43.222693 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1122/2227] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 18:00:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:00:44.039580 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bb85ce-5795-44f7-99f9-1d51b9879be9 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:44.041821 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-e0bb85ce-5795-44f7-99f9-1d51b9879be9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:44.055660 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bb85ce-5795-44f7-99f9-1d51b9879be9 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:44.061455 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4523e99-9f99-4fe0-bebc-8c1b215b41e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:44.064070 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4523e99-9f99-4fe0-bebc-8c1b215b41e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:44.064070 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4523e99-9f99-4fe0-bebc-8c1b215b41e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:44.064070 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4523e99-9f99-4fe0-bebc-8c1b215b41e8 admin admin] PATH_INFO: `/v3/projects/b66cdedecbee458a926d4cbc1d9dfa57` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:44.065592 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4523e99-9f99-4fe0-bebc-8c1b215b41e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b66cdedecbee458a926d4cbc1d9dfa57)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:44.067648 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4523e99-9f99-4fe0-bebc-8c1b215b41e8 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:44.196454 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:00:44.215702 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-b4523e99-9f99-4fe0-bebc-8c1b215b41e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b66cdedecbee458a926d4cbc1d9dfa57', 'request_id': 'req-b4523e99-9f99-4fe0-bebc-8c1b215b41e8'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:44.292944 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-b4523e99-9f99-4fe0-bebc-8c1b215b41e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b66cdedecbee458a926d4cbc1d9dfa57', 'request_id': 'req-b4523e99-9f99-4fe0-bebc-8c1b215b41e8'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:44.302283 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-b4523e99-9f99-4fe0-bebc-8c1b215b41e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b66cdedecbee458a926d4cbc1d9dfa57', 'request_id': 'req-b4523e99-9f99-4fe0-bebc-8c1b215b41e8'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:44.317175 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-b4523e99-9f99-4fe0-bebc-8c1b215b41e8 admin admin] The token cache is being invalidate because project b66cdedecbee458a926d4cbc1d9dfa57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:00:44.317546 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-b4523e99-9f99-4fe0-bebc-8c1b215b41e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:44.318419 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-b4523e99-9f99-4fe0-bebc-8c1b215b41e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:44.325407 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1106/2228] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 14 18:00:44 2022] DELETE /identity/v3/projects/b66cdedecbee458a926d4cbc1d9dfa57 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 18:00:44.327341 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788f99a8-0f7d-4e7f-9555-58d2ba578369 service neutron] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:44.345285 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788f99a8-0f7d-4e7f-9555-58d2ba578369 service neutron] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:44.457359 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3631fbd-f694-46a1-b27c-d15ed1ace213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:44.459489 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3631fbd-f694-46a1-b27c-d15ed1ace213 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:44.460327 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3631fbd-f694-46a1-b27c-d15ed1ace213 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:44.461035 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3631fbd-f694-46a1-b27c-d15ed1ace213 admin admin] PATH_INFO: `/v3/users/8dde5cc983e34c59a3ad26d24f9d4766` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:44.464522 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3631fbd-f694-46a1-b27c-d15ed1ace213 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8dde5cc983e34c59a3ad26d24f9d4766)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:44.468909 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3631fbd-f694-46a1-b27c-d15ed1ace213 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:44.773780 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-d3631fbd-f694-46a1-b27c-d15ed1ace213 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8dde5cc983e34c59a3ad26d24f9d4766'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:44.777106 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-d3631fbd-f694-46a1-b27c-d15ed1ace213 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8dde5cc983e34c59a3ad26d24f9d4766'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:44.780058 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-d3631fbd-f694-46a1-b27c-d15ed1ace213 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8dde5cc983e34c59a3ad26d24f9d4766'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:44.857317 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-d3631fbd-f694-46a1-b27c-d15ed1ace213 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8dde5cc983e34c59a3ad26d24f9d4766'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:44.868833 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:00:44.874750 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-d3631fbd-f694-46a1-b27c-d15ed1ace213 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8dde5cc983e34c59a3ad26d24f9d4766'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:44.932900 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1123/2229] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 14 18:00:44 2022] DELETE /identity/v3/users/8dde5cc983e34c59a3ad26d24f9d4766 => generated 0 bytes in 608 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 18:00:45.690222 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4523e99-9f99-4fe0-bebc-8c1b215b41e8 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:45.693691 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-b4523e99-9f99-4fe0-bebc-8c1b215b41e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:45.724381 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4523e99-9f99-4fe0-bebc-8c1b215b41e8 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:45.856821 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0b46bd-2dce-4e1f-9b8e-4e4ed01dfa75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:45.859326 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0b46bd-2dce-4e1f-9b8e-4e4ed01dfa75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:45.860134 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0b46bd-2dce-4e1f-9b8e-4e4ed01dfa75 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:45.861421 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0b46bd-2dce-4e1f-9b8e-4e4ed01dfa75 admin admin] PATH_INFO: `/v3/projects/b52f311317324844873120c3a5a4ae9e` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:45.863733 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0b46bd-2dce-4e1f-9b8e-4e4ed01dfa75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b52f311317324844873120c3a5a4ae9e)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:45.866776 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0b46bd-2dce-4e1f-9b8e-4e4ed01dfa75 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:45.975711 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783e6dc7-8c87-4dda-b86f-3a74af0655e8 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:45.978171 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783e6dc7-8c87-4dda-b86f-3a74af0655e8 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:45.978925 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783e6dc7-8c87-4dda-b86f-3a74af0655e8 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:45.982420 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1124/2230] 10.222.0.36 () {54 vars in 921 bytes} [Tue Jun 14 18:00:45 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 14 18:00:45.996931 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c38bf73-c1a1-4605-9e5b-6e22739e6594 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:46.002157 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c38bf73-c1a1-4605-9e5b-6e22739e6594 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:46.003024 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c38bf73-c1a1-4605-9e5b-6e22739e6594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:46.097175 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-cd0b46bd-2dce-4e1f-9b8e-4e4ed01dfa75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b52f311317324844873120c3a5a4ae9e', 'request_id': 'req-cd0b46bd-2dce-4e1f-9b8e-4e4ed01dfa75'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:46.158578 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-4c38bf73-c1a1-4605-9e5b-6e22739e6594 None None] MFA Rules not processed for user `e4696d396adb495ab300a9a5a5727595`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:00:46.162183 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-4c38bf73-c1a1-4605-9e5b-6e22739e6594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:46.253291 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-cd0b46bd-2dce-4e1f-9b8e-4e4ed01dfa75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b52f311317324844873120c3a5a4ae9e', 'request_id': 'req-cd0b46bd-2dce-4e1f-9b8e-4e4ed01dfa75'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:46.303760 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-cd0b46bd-2dce-4e1f-9b8e-4e4ed01dfa75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b52f311317324844873120c3a5a4ae9e', 'request_id': 'req-cd0b46bd-2dce-4e1f-9b8e-4e4ed01dfa75'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:46.354594 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-cd0b46bd-2dce-4e1f-9b8e-4e4ed01dfa75 admin admin] The token cache is being invalidate because project b52f311317324844873120c3a5a4ae9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:00:46.354594 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-cd0b46bd-2dce-4e1f-9b8e-4e4ed01dfa75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:46.354594 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-cd0b46bd-2dce-4e1f-9b8e-4e4ed01dfa75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:46.354594 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1107/2231] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 14 18:00:45 2022] DELETE /identity/v3/projects/b52f311317324844873120c3a5a4ae9e => generated 0 bytes in 664 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:00:46.359425 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6cb6ab-255b-4665-a2b9-c2bca8d9d3df None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:46.359699 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6cb6ab-255b-4665-a2b9-c2bca8d9d3df None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:46.360597 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6cb6ab-255b-4665-a2b9-c2bca8d9d3df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:46.392522 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-3b6cb6ab-255b-4665-a2b9-c2bca8d9d3df None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:00:46.395870 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-3b6cb6ab-255b-4665-a2b9-c2bca8d9d3df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:46.517988 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1125/2232] 10.222.0.36 () {58 vars in 1018 bytes} [Tue Jun 14 18:00:45 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 523 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:00:46.569197 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c38bf73-c1a1-4605-9e5b-6e22739e6594 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:46.571893 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-4c38bf73-c1a1-4605-9e5b-6e22739e6594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:46.583231 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:00:46.625218 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1108/2233] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:00:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:00:46.627683 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba33395-c311-4870-833b-11a7af23cd89 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:46.627991 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba33395-c311-4870-833b-11a7af23cd89 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:46.628249 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba33395-c311-4870-833b-11a7af23cd89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:46.672165 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-0ba33395-c311-4870-833b-11a7af23cd89 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:00:46.679429 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-0ba33395-c311-4870-833b-11a7af23cd89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:46.713759 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1109/2234] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:00:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:00:46.715610 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba33395-c311-4870-833b-11a7af23cd89 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:46.738377 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba33395-c311-4870-833b-11a7af23cd89 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:46.745591 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d75fcd3-390d-4e6a-b7c9-322834121288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:46.749828 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d75fcd3-390d-4e6a-b7c9-322834121288 admin admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:46.750331 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d75fcd3-390d-4e6a-b7c9-322834121288 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:46.750848 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d75fcd3-390d-4e6a-b7c9-322834121288 admin admin] PATH_INFO: `/v3/domains` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:46.752234 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d75fcd3-390d-4e6a-b7c9-322834121288 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 18:00:46.752761 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d75fcd3-390d-4e6a-b7c9-322834121288 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:46.753894 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c38bf73-c1a1-4605-9e5b-6e22739e6594 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:46.755926 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d75fcd3-390d-4e6a-b7c9-322834121288 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:46.762617 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f7d465-d37f-4ac8-b3bf-3b9f67326efc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359f5ed4eb684e769f552484ca9a34c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:46.763896 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f7d465-d37f-4ac8-b3bf-3b9f67326efc service glance] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:46.764450 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f7d465-d37f-4ac8-b3bf-3b9f67326efc service glance] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:46.765466 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f7d465-d37f-4ac8-b3bf-3b9f67326efc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:46.778003 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1110/2235] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 14 18:00:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 18:00:46.783178 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d75fcd3-390d-4e6a-b7c9-322834121288 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:46.789157 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f7d465-d37f-4ac8-b3bf-3b9f67326efc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:46.792308 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f7d465-d37f-4ac8-b3bf-3b9f67326efc service glance] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:46.803374 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d75fcd3-390d-4e6a-b7c9-322834121288 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:46.811764 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85943689-a844-4d86-a950-d08d15e0e48a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:46.813013 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85943689-a844-4d86-a950-d08d15e0e48a admin admin] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:46.813463 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85943689-a844-4d86-a950-d08d15e0e48a admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:46.813941 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85943689-a844-4d86-a950-d08d15e0e48a admin admin] PATH_INFO: `/v3/projects` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:46.814931 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85943689-a844-4d86-a950-d08d15e0e48a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:46.815924 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1126/2236] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 18:00:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 18:00:46.818288 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85943689-a844-4d86-a950-d08d15e0e48a admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:46.992373 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1111/2237] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 14 18:00:46 2022] POST /identity/v3/projects => generated 373 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 18:00:46.999138 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f7d465-d37f-4ac8-b3bf-3b9f67326efc service glance] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:47.019327 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f7d465-d37f-4ac8-b3bf-3b9f67326efc service glance] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:47.056401 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:00:47.107294 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c375e02a-7b40-40bc-b3d6-a6e73474fc49 None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:47.107628 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c375e02a-7b40-40bc-b3d6-a6e73474fc49 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:47.108133 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c375e02a-7b40-40bc-b3d6-a6e73474fc49 None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:47.114878 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1112/2238] 10.222.0.36 () {54 vars in 921 bytes} [Tue Jun 14 18:00:47 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 14 18:00:47.123755 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094dcf60-dd25-449f-91a2-0b7fa9d2ad20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:47.124963 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094dcf60-dd25-449f-91a2-0b7fa9d2ad20 admin admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:47.125514 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094dcf60-dd25-449f-91a2-0b7fa9d2ad20 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:47.126530 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094dcf60-dd25-449f-91a2-0b7fa9d2ad20 admin admin] PATH_INFO: `/v3/users` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:47.127934 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094dcf60-dd25-449f-91a2-0b7fa9d2ad20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:47.131574 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094dcf60-dd25-449f-91a2-0b7fa9d2ad20 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:47.139802 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd81ab2-d54c-47f9-b03b-bb0935648dad None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:47.140328 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd81ab2-d54c-47f9-b03b-bb0935648dad None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:47.141164 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd81ab2-d54c-47f9-b03b-bb0935648dad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:47.179557 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-9bd81ab2-d54c-47f9-b03b-bb0935648dad None None] MFA Rules not processed for user `5652329c71cd431fb579d69cef933b37`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:00:47.181861 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-9bd81ab2-d54c-47f9-b03b-bb0935648dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:47.254136 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1127/2239] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 14 18:00:46 2022] POST /identity/v3/users => generated 287 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:00:47.256307 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094dcf60-dd25-449f-91a2-0b7fa9d2ad20 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:47.276334 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094dcf60-dd25-449f-91a2-0b7fa9d2ad20 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:47.288341 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8a23fe-ee80-4d50-afef-632226760dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:47.289164 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8a23fe-ee80-4d50-afef-632226760dcb admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:47.289657 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8a23fe-ee80-4d50-afef-632226760dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:47.295470 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8a23fe-ee80-4d50-afef-632226760dcb admin admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:47.297087 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8a23fe-ee80-4d50-afef-632226760dcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:47.302675 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8a23fe-ee80-4d50-afef-632226760dcb admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:47.330726 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1113/2240] 10.222.0.36 () {58 vars in 1018 bytes} [Tue Jun 14 18:00:47 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 18:00:47.357706 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1128/2241] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 18:00:47 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 14 18:00:47.362103 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd81ab2-d54c-47f9-b03b-bb0935648dad None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:47.408471 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd81ab2-d54c-47f9-b03b-bb0935648dad None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:47.420845 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ea3710-e9d6-4739-bfc6-8b607e899426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:47.423281 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ea3710-e9d6-4739-bfc6-8b607e899426 admin admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:47.424003 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ea3710-e9d6-4739-bfc6-8b607e899426 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:47.424453 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ea3710-e9d6-4739-bfc6-8b607e899426 admin admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:47.425983 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ea3710-e9d6-4739-bfc6-8b607e899426 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:47.429250 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ea3710-e9d6-4739-bfc6-8b607e899426 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:47.459062 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1114/2242] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 18:00:47 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:00:47.465660 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8a23fe-ee80-4d50-afef-632226760dcb admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:47.469003 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ea3710-e9d6-4739-bfc6-8b607e899426 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:47.473550 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-62ea3710-e9d6-4739-bfc6-8b607e899426 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:47.504139 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8a23fe-ee80-4d50-afef-632226760dcb admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:47.516262 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ea3710-e9d6-4739-bfc6-8b607e899426 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:47.516262 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08127160-f1f6-4263-b6ff-90bb8c8a48fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5652329c71cd431fb579d69cef933b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:47.516262 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08127160-f1f6-4263-b6ff-90bb8c8a48fc service neutron] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:47.516262 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08127160-f1f6-4263-b6ff-90bb8c8a48fc service neutron] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:47.518754 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08127160-f1f6-4263-b6ff-90bb8c8a48fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:47.530782 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8736794-3dfe-4463-adc0-e08d36cf76ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:47.530782 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8736794-3dfe-4463-adc0-e08d36cf76ea admin admin] REQUEST_METHOD: `PUT` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:47.530782 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8736794-3dfe-4463-adc0-e08d36cf76ea admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:47.530782 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8736794-3dfe-4463-adc0-e08d36cf76ea admin admin] PATH_INFO: `/v3/projects/3412103661474550b6c9926648e13ab6/users/4fdef75ae06e47a5a2632acd314d3de6/roles/9ee80134743f4c2b88525b04df2facba` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:47.532350 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08127160-f1f6-4263-b6ff-90bb8c8a48fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:47.539431 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08127160-f1f6-4263-b6ff-90bb8c8a48fc service neutron] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:47.563569 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1115/2243] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 18:00:47 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:00:47.570577 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8736794-3dfe-4463-adc0-e08d36cf76ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=3412103661474550b6c9926648e13ab6, user_id=4fdef75ae06e47a5a2632acd314d3de6, role_id=9ee80134743f4c2b88525b04df2facba)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:47.576498 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8736794-3dfe-4463-adc0-e08d36cf76ea admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:47.706378 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1129/2244] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 18:00:47 2022] PUT /identity/v3/projects/3412103661474550b6c9926648e13ab6/users/4fdef75ae06e47a5a2632acd314d3de6/roles/9ee80134743f4c2b88525b04df2facba => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:00:47.713965 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfc4eef-2e7b-4c84-8085-4e473b5a8307 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:47.714519 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfc4eef-2e7b-4c84-8085-4e473b5a8307 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:47.714519 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfc4eef-2e7b-4c84-8085-4e473b5a8307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:47.737487 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-bdfc4eef-2e7b-4c84-8085-4e473b5a8307 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:00:47.738765 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-bdfc4eef-2e7b-4c84-8085-4e473b5a8307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:47.826359 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1116/2245] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:00:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:00:47.841613 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8736794-3dfe-4463-adc0-e08d36cf76ea admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:47.845634 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-e8736794-3dfe-4463-adc0-e08d36cf76ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:47.975118 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a368ba1-bcbf-42e9-8365-3aa9e02e31c4 None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:47.975847 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a368ba1-bcbf-42e9-8365-3aa9e02e31c4 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:47.976486 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a368ba1-bcbf-42e9-8365-3aa9e02e31c4 None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:47.980382 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1117/2246] 10.222.0.36 () {54 vars in 921 bytes} [Tue Jun 14 18:00:47 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 18:00:47.991361 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3947d14c-14f3-4e01-8c34-a3f43dec7405 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:47.993627 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3947d14c-14f3-4e01-8c34-a3f43dec7405 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:47.994495 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3947d14c-14f3-4e01-8c34-a3f43dec7405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:48.003272 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8736794-3dfe-4463-adc0-e08d36cf76ea admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:48.016225 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92b8a68-95e5-4c27-b7ce-4b9420e01a40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5652329c71cd431fb579d69cef933b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:48.017170 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92b8a68-95e5-4c27-b7ce-4b9420e01a40 service neutron] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:48.017482 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92b8a68-95e5-4c27-b7ce-4b9420e01a40 service neutron] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:48.017767 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92b8a68-95e5-4c27-b7ce-4b9420e01a40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:48.046529 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92b8a68-95e5-4c27-b7ce-4b9420e01a40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:48.058374 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92b8a68-95e5-4c27-b7ce-4b9420e01a40 service neutron] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:48.066737 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-3947d14c-14f3-4e01-8c34-a3f43dec7405 None None] MFA Rules not processed for user `e4696d396adb495ab300a9a5a5727595`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:00:48.068062 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-3947d14c-14f3-4e01-8c34-a3f43dec7405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:48.104743 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1130/2247] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 18:00:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 18:00:48.179902 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:00:48.226851 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1118/2248] 10.222.0.36 () {58 vars in 1018 bytes} [Tue Jun 14 18:00:47 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:00:48.245061 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92b8a68-95e5-4c27-b7ce-4b9420e01a40 service neutron] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:48.279472 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92b8a68-95e5-4c27-b7ce-4b9420e01a40 service neutron] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:48.295636 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f8b060-b8cd-41a1-8670-d5851046dcdc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5652329c71cd431fb579d69cef933b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:48.296955 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f8b060-b8cd-41a1-8670-d5851046dcdc service neutron] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:48.298370 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f8b060-b8cd-41a1-8670-d5851046dcdc service neutron] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:48.298558 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f8b060-b8cd-41a1-8670-d5851046dcdc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:48.325114 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f8b060-b8cd-41a1-8670-d5851046dcdc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:48.327356 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f8b060-b8cd-41a1-8670-d5851046dcdc service neutron] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:48.349391 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1131/2249] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 18:00:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:00:50.787162 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d41737-0b61-40ec-ad21-b70a82be7f28 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:50.787162 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d41737-0b61-40ec-ad21-b70a82be7f28 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:50.787162 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d41737-0b61-40ec-ad21-b70a82be7f28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:50.841570 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-24d41737-0b61-40ec-ad21-b70a82be7f28 None None] MFA Rules not processed for user `4fdef75ae06e47a5a2632acd314d3de6`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:00:50.843915 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-24d41737-0b61-40ec-ad21-b70a82be7f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:50.947680 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1119/2250] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:00:50 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:00:50.960591 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f8b060-b8cd-41a1-8670-d5851046dcdc service neutron] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:50.962116 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-72f8b060-b8cd-41a1-8670-d5851046dcdc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:51.079671 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:00:51.087435 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f8b060-b8cd-41a1-8670-d5851046dcdc service neutron] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:51.093745 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9114a895-3635-4252-9bb7-14ee66c4e637 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17945e7d72954b8787e0ba09a9903247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:51.095542 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9114a895-3635-4252-9bb7-14ee66c4e637 service cinder] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:51.096045 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9114a895-3635-4252-9bb7-14ee66c4e637 service cinder] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:51.096551 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9114a895-3635-4252-9bb7-14ee66c4e637 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:51.113655 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9114a895-3635-4252-9bb7-14ee66c4e637 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:51.116616 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9114a895-3635-4252-9bb7-14ee66c4e637 service cinder] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:51.134523 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1132/2251] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 18:00:50 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:00:53.287480 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebe17e3-6083-49ec-b45f-61a1f1a22baf None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:53.288020 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebe17e3-6083-49ec-b45f-61a1f1a22baf None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:53.288107 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebe17e3-6083-49ec-b45f-61a1f1a22baf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:53.308169 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-eebe17e3-6083-49ec-b45f-61a1f1a22baf None None] MFA Rules not processed for user `4fdef75ae06e47a5a2632acd314d3de6`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:00:53.314774 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-eebe17e3-6083-49ec-b45f-61a1f1a22baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:53.321773 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1120/2252] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:00:53 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:01:02.154244 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=5 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:01:03.301355 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=47 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:01:04.930788 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9114a895-3635-4252-9bb7-14ee66c4e637 service cinder] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:04.944040 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9114a895-3635-4252-9bb7-14ee66c4e637 service cinder] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:04.947799 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b3917b-26d4-4d6b-b577-4407de8c8030 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5652329c71cd431fb579d69cef933b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:04.948460 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b3917b-26d4-4d6b-b577-4407de8c8030 service neutron] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:04.948742 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b3917b-26d4-4d6b-b577-4407de8c8030 service neutron] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:04.949025 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b3917b-26d4-4d6b-b577-4407de8c8030 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:04.951806 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-a5b3917b-26d4-4d6b-b577-4407de8c8030 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:05.023039 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b3917b-26d4-4d6b-b577-4407de8c8030 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:05.024529 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b3917b-26d4-4d6b-b577-4407de8c8030 service neutron] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:05.035924 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1133/2253] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 18:01:04 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:01:15.031256 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=30 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:01:15.320799 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bdb40e-a807-4087-bf6f-13fb7de631f2 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:15.322132 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bdb40e-a807-4087-bf6f-13fb7de631f2 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:15.322792 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bdb40e-a807-4087-bf6f-13fb7de631f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:15.468632 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-97bdb40e-a807-4087-bf6f-13fb7de631f2 None None] MFA Rules not processed for user `f1e32638fe5c4d2d8d3e2e4ea8250aaa`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:01:15.470376 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-97bdb40e-a807-4087-bf6f-13fb7de631f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:15.554042 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1121/2254] 10.222.0.36 () {58 vars in 1009 bytes} [Tue Jun 14 18:01:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:01:15.569489 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b3917b-26d4-4d6b-b577-4407de8c8030 service neutron] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:15.571202 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-a5b3917b-26d4-4d6b-b577-4407de8c8030 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:15.702010 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b3917b-26d4-4d6b-b577-4407de8c8030 service neutron] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:15.710078 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4d881a-bcf1-4498-8797-d32da20ba6c2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba38b47a31b14526be0aa2054841881b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:15.715809 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4d881a-bcf1-4498-8797-d32da20ba6c2 service swift] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:15.715809 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4d881a-bcf1-4498-8797-d32da20ba6c2 service swift] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:15.715809 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4d881a-bcf1-4498-8797-d32da20ba6c2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:15.726387 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4d881a-bcf1-4498-8797-d32da20ba6c2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:15.729832 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4d881a-bcf1-4498-8797-d32da20ba6c2 service swift] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:15.747730 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1134/2255] 10.222.0.36 () {60 vars in 1384 bytes} [Tue Jun 14 18:01:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 14 18:01:25.550117 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=40 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:01:25.740267 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=41 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:01:29.320897 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bdb40e-a807-4087-bf6f-13fb7de631f2 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:29.324600 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-97bdb40e-a807-4087-bf6f-13fb7de631f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:29.548364 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bdb40e-a807-4087-bf6f-13fb7de631f2 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:29.557316 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5cb502-01c2-4ee9-8132-59e220acd703 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a8049f9c66b4b5185c26084fd8239ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:29.560465 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5cb502-01c2-4ee9-8132-59e220acd703 service placement] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:29.560465 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5cb502-01c2-4ee9-8132-59e220acd703 service placement] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:29.560465 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5cb502-01c2-4ee9-8132-59e220acd703 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:29.562532 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-dd5cb502-01c2-4ee9-8132-59e220acd703 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:29.582129 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5cb502-01c2-4ee9-8132-59e220acd703 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:29.589078 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5cb502-01c2-4ee9-8132-59e220acd703 service placement] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:29.596123 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1122/2256] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 18:01:29 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:01:39.591163 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=41 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:01:42.984990 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0731c3bd-035c-41a2-b7b7-fb4652818b53 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:42.986053 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0731c3bd-035c-41a2-b7b7-fb4652818b53 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:42.991719 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0731c3bd-035c-41a2-b7b7-fb4652818b53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:43.033720 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-0731c3bd-035c-41a2-b7b7-fb4652818b53 None None] MFA Rules not processed for user `7f214333671e4878bf613c26ceb1381a`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:01:43.037032 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-0731c3bd-035c-41a2-b7b7-fb4652818b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:43.130874 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1135/2257] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:01:42 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:01:43.884249 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988d5876-581e-4c64-8870-47eaf5c19861 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:43.885150 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988d5876-581e-4c64-8870-47eaf5c19861 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:43.885576 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988d5876-581e-4c64-8870-47eaf5c19861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:43.934753 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-988d5876-581e-4c64-8870-47eaf5c19861 None None] MFA Rules not processed for user `4fdef75ae06e47a5a2632acd314d3de6`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:01:43.950454 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-988d5876-581e-4c64-8870-47eaf5c19861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:43.999964 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1123/2258] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:01:43 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:01:48.212694 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078fad6c-f13f-4418-88b7-a3982530d3c6 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:48.217274 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078fad6c-f13f-4418-88b7-a3982530d3c6 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:48.217274 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078fad6c-f13f-4418-88b7-a3982530d3c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:48.252892 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-078fad6c-f13f-4418-88b7-a3982530d3c6 None None] MFA Rules not processed for user `f1e32638fe5c4d2d8d3e2e4ea8250aaa`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:01:48.255115 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-078fad6c-f13f-4418-88b7-a3982530d3c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:48.268204 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1136/2259] 10.222.0.36 () {58 vars in 967 bytes} [Tue Jun 14 18:01:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:01:48.298759 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988d5876-581e-4c64-8870-47eaf5c19861 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:48.312387 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988d5876-581e-4c64-8870-47eaf5c19861 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:48.318508 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f7e616-e46f-445e-af17-4b6a73ec42f6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba38b47a31b14526be0aa2054841881b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:48.319357 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f7e616-e46f-445e-af17-4b6a73ec42f6 service swift] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:48.319652 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f7e616-e46f-445e-af17-4b6a73ec42f6 service swift] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:48.319938 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f7e616-e46f-445e-af17-4b6a73ec42f6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:48.330366 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f7e616-e46f-445e-af17-4b6a73ec42f6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:48.332368 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f7e616-e46f-445e-af17-4b6a73ec42f6 service swift] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:48.342797 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1124/2260] 10.222.0.36 () {60 vars in 1384 bytes} [Tue Jun 14 18:01:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 14 18:01:55.585273 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386732fc-51e2-4fea-91ee-f4dff03d05aa None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:55.586242 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386732fc-51e2-4fea-91ee-f4dff03d05aa None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:55.588333 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386732fc-51e2-4fea-91ee-f4dff03d05aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:55.636850 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-386732fc-51e2-4fea-91ee-f4dff03d05aa None None] MFA Rules not processed for user `e73368f3ce8a43368b30985898cf7393`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:01:55.647168 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-386732fc-51e2-4fea-91ee-f4dff03d05aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:55.804765 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1137/2261] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:01:55 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 18:01:58.338554 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=9 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:02:05.790160 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=53 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:02:09.949735 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a6befa-6176-4346-a671-8bb6b3e1a50a None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:09.950565 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a6befa-6176-4346-a671-8bb6b3e1a50a None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:09.950802 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a6befa-6176-4346-a671-8bb6b3e1a50a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:09.972959 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-d6a6befa-6176-4346-a671-8bb6b3e1a50a None None] MFA Rules not processed for user `9c7ab182f1fd41718376a8e2f03ec87c`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:02:09.974213 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-d6a6befa-6176-4346-a671-8bb6b3e1a50a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:02:10.056644 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1125/2262] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:02:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:02:20.045777 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=25 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:02:24.099913 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c379287-cc1d-495a-82d1-22772a8e060a None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:24.100512 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c379287-cc1d-495a-82d1-22772a8e060a None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:24.100512 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c379287-cc1d-495a-82d1-22772a8e060a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:24.120706 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-6c379287-cc1d-495a-82d1-22772a8e060a None None] MFA Rules not processed for user `f1e32638fe5c4d2d8d3e2e4ea8250aaa`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:02:24.122025 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-6c379287-cc1d-495a-82d1-22772a8e060a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:02:24.129834 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1138/2263] 10.222.0.36 () {58 vars in 1009 bytes} [Tue Jun 14 18:02:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 18:02:24.143430 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a6befa-6176-4346-a671-8bb6b3e1a50a None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:02:24.159369 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a6befa-6176-4346-a671-8bb6b3e1a50a None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:02:24.165428 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f29175-789f-47c7-a3d1-195311a86922 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba38b47a31b14526be0aa2054841881b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:02:24.166260 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f29175-789f-47c7-a3d1-195311a86922 service swift] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:24.166664 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f29175-789f-47c7-a3d1-195311a86922 service swift] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:24.167987 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f29175-789f-47c7-a3d1-195311a86922 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:24.178767 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f29175-789f-47c7-a3d1-195311a86922 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:02:24.180639 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f29175-789f-47c7-a3d1-195311a86922 service swift] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:02:24.191162 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1126/2264] 10.222.0.36 () {60 vars in 1384 bytes} [Tue Jun 14 18:02:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 14 18:02:34.114653 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=3 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:02:34.187199 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=6 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:02:43.774047 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75af1b0-a78a-4e06-b4ca-5bb526620223 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:43.774870 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75af1b0-a78a-4e06-b4ca-5bb526620223 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:43.774870 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75af1b0-a78a-4e06-b4ca-5bb526620223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:43.800080 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-f75af1b0-a78a-4e06-b4ca-5bb526620223 None None] MFA Rules not processed for user `f1e32638fe5c4d2d8d3e2e4ea8250aaa`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:02:43.801806 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-f75af1b0-a78a-4e06-b4ca-5bb526620223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:02:43.811180 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1139/2265] 10.222.0.36 () {58 vars in 967 bytes} [Tue Jun 14 18:02:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 18:02:43.830646 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f29175-789f-47c7-a3d1-195311a86922 service swift] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:02:43.842751 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f29175-789f-47c7-a3d1-195311a86922 service swift] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:02:43.849539 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116126f1-b815-4070-8fa0-43455bd52445 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba38b47a31b14526be0aa2054841881b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:02:43.850256 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116126f1-b815-4070-8fa0-43455bd52445 service swift] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:43.850543 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116126f1-b815-4070-8fa0-43455bd52445 service swift] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:43.851830 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116126f1-b815-4070-8fa0-43455bd52445 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:43.861311 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116126f1-b815-4070-8fa0-43455bd52445 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:02:43.863083 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116126f1-b815-4070-8fa0-43455bd52445 service swift] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:02:43.872501 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1127/2266] 10.222.0.36 () {60 vars in 1384 bytes} [Tue Jun 14 18:02:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 14 18:02:47.954719 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75af1b0-a78a-4e06-b4ca-5bb526620223 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:02:47.974695 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75af1b0-a78a-4e06-b4ca-5bb526620223 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:02:47.982691 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f98c209-a212-4a63-8955-f1ef92facdef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:02:47.984452 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f98c209-a212-4a63-8955-f1ef92facdef admin admin] REQUEST_METHOD: `DELETE` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:47.985100 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f98c209-a212-4a63-8955-f1ef92facdef admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:47.985669 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f98c209-a212-4a63-8955-f1ef92facdef admin admin] PATH_INFO: `/v3/users/4fdef75ae06e47a5a2632acd314d3de6` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:47.988915 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f98c209-a212-4a63-8955-f1ef92facdef admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fdef75ae06e47a5a2632acd314d3de6)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:02:47.992875 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f98c209-a212-4a63-8955-f1ef92facdef admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:02:48.294322 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-7f98c209-a212-4a63-8955-f1ef92facdef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fdef75ae06e47a5a2632acd314d3de6'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:02:48.295180 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-7f98c209-a212-4a63-8955-f1ef92facdef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fdef75ae06e47a5a2632acd314d3de6'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:02:48.295947 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-7f98c209-a212-4a63-8955-f1ef92facdef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fdef75ae06e47a5a2632acd314d3de6'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:02:48.395029 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-7f98c209-a212-4a63-8955-f1ef92facdef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fdef75ae06e47a5a2632acd314d3de6'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:02:48.404692 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-7f98c209-a212-4a63-8955-f1ef92facdef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fdef75ae06e47a5a2632acd314d3de6'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:02:48.427583 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1140/2267] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 14 18:02:47 2022] DELETE /identity/v3/users/4fdef75ae06e47a5a2632acd314d3de6 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:02:48.746707 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116126f1-b815-4070-8fa0-43455bd52445 service swift] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:02:48.767984 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116126f1-b815-4070-8fa0-43455bd52445 service swift] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:02:48.872853 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0a6f28-4fcc-4793-a3ea-9f393b397866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:02:48.873848 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0a6f28-4fcc-4793-a3ea-9f393b397866 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:48.874204 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0a6f28-4fcc-4793-a3ea-9f393b397866 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:48.877408 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0a6f28-4fcc-4793-a3ea-9f393b397866 admin admin] PATH_INFO: `/v3/projects/3412103661474550b6c9926648e13ab6` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:48.877408 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0a6f28-4fcc-4793-a3ea-9f393b397866 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3412103661474550b6c9926648e13ab6)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:02:48.878436 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0a6f28-4fcc-4793-a3ea-9f393b397866 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:02:49.003694 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-8d0a6f28-4fcc-4793-a3ea-9f393b397866 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3412103661474550b6c9926648e13ab6', 'request_id': 'req-8d0a6f28-4fcc-4793-a3ea-9f393b397866'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:02:49.103835 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-8d0a6f28-4fcc-4793-a3ea-9f393b397866 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3412103661474550b6c9926648e13ab6', 'request_id': 'req-8d0a6f28-4fcc-4793-a3ea-9f393b397866'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:02:49.113719 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-8d0a6f28-4fcc-4793-a3ea-9f393b397866 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3412103661474550b6c9926648e13ab6', 'request_id': 'req-8d0a6f28-4fcc-4793-a3ea-9f393b397866'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:02:49.130558 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-8d0a6f28-4fcc-4793-a3ea-9f393b397866 admin admin] The token cache is being invalidate because project 3412103661474550b6c9926648e13ab6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:02:49.131063 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-8d0a6f28-4fcc-4793-a3ea-9f393b397866 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:02:49.132206 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-8d0a6f28-4fcc-4793-a3ea-9f393b397866 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:02:49.134883 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1128/2268] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 14 18:02:48 2022] DELETE /identity/v3/projects/3412103661474550b6c9926648e13ab6 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:02:49.141229 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04785b0b-275a-4e37-af98-78a8d1868696 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:49.141990 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04785b0b-275a-4e37-af98-78a8d1868696 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:49.142413 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04785b0b-275a-4e37-af98-78a8d1868696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:49.171384 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-04785b0b-275a-4e37-af98-78a8d1868696 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:02:49.173317 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-04785b0b-275a-4e37-af98-78a8d1868696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:02:49.272461 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1141/2269] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:02:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:02:49.281194 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779e085b-ef75-40a3-a824-e83d30bc2069 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:49.281509 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779e085b-ef75-40a3-a824-e83d30bc2069 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:49.282451 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779e085b-ef75-40a3-a824-e83d30bc2069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:49.303149 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-779e085b-ef75-40a3-a824-e83d30bc2069 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:02:49.305371 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-779e085b-ef75-40a3-a824-e83d30bc2069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:02:49.313472 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1129/2270] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:02:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:02:49.320193 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04785b0b-275a-4e37-af98-78a8d1868696 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:02:49.331151 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04785b0b-275a-4e37-af98-78a8d1868696 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:02:49.336375 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcaba80-483e-44a6-9423-ee7f335fb4a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:02:49.337274 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcaba80-483e-44a6-9423-ee7f335fb4a3 admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:49.337570 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcaba80-483e-44a6-9423-ee7f335fb4a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:49.337853 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcaba80-483e-44a6-9423-ee7f335fb4a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:49.338626 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcaba80-483e-44a6-9423-ee7f335fb4a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 18:02:49.338939 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcaba80-483e-44a6-9423-ee7f335fb4a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:02:49.341362 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcaba80-483e-44a6-9423-ee7f335fb4a3 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:02:49.356212 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1142/2271] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 14 18:02:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 18:02:49.361831 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779e085b-ef75-40a3-a824-e83d30bc2069 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:02:49.372514 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779e085b-ef75-40a3-a824-e83d30bc2069 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:02:49.378775 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23303d29-154e-4238-8df8-b6abbcbbb248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:02:49.379630 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23303d29-154e-4238-8df8-b6abbcbbb248 admin admin] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:49.381147 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23303d29-154e-4238-8df8-b6abbcbbb248 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:49.381147 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23303d29-154e-4238-8df8-b6abbcbbb248 admin admin] PATH_INFO: `/v3/projects` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:49.381147 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23303d29-154e-4238-8df8-b6abbcbbb248 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:02:49.383204 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23303d29-154e-4238-8df8-b6abbcbbb248 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:02:49.489685 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1130/2272] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 14 18:02:49 2022] POST /identity/v3/projects => generated 367 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:02:49.495033 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcaba80-483e-44a6-9423-ee7f335fb4a3 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:02:49.507612 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcaba80-483e-44a6-9423-ee7f335fb4a3 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:02:49.590792 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:02:49.604157 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc95255f-a1ce-4b63-8101-a303548da163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:02:49.607755 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc95255f-a1ce-4b63-8101-a303548da163 admin admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:49.607755 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc95255f-a1ce-4b63-8101-a303548da163 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:49.607755 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc95255f-a1ce-4b63-8101-a303548da163 admin admin] PATH_INFO: `/v3/users` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:49.607755 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc95255f-a1ce-4b63-8101-a303548da163 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:02:49.609484 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc95255f-a1ce-4b63-8101-a303548da163 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:02:49.720495 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1143/2273] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 14 18:02:49 2022] POST /identity/v3/users => generated 284 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:02:49.725500 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23303d29-154e-4238-8df8-b6abbcbbb248 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:02:49.735513 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23303d29-154e-4238-8df8-b6abbcbbb248 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:02:49.741861 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863ad013-09f6-48ba-9a13-14fdf41d1e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:02:49.742723 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863ad013-09f6-48ba-9a13-14fdf41d1e17 admin admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:49.743117 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863ad013-09f6-48ba-9a13-14fdf41d1e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:49.743542 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863ad013-09f6-48ba-9a13-14fdf41d1e17 admin admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:49.744399 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863ad013-09f6-48ba-9a13-14fdf41d1e17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:02:49.746386 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863ad013-09f6-48ba-9a13-14fdf41d1e17 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:02:49.761807 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1131/2274] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 18:02:49 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:02:49.768231 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc95255f-a1ce-4b63-8101-a303548da163 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:02:49.790008 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc95255f-a1ce-4b63-8101-a303548da163 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:02:49.799825 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2714dcf2-0100-4eaf-82cb-ddc473161ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:02:49.801006 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2714dcf2-0100-4eaf-82cb-ddc473161ed6 admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:49.801530 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2714dcf2-0100-4eaf-82cb-ddc473161ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:49.801950 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2714dcf2-0100-4eaf-82cb-ddc473161ed6 admin admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:49.803284 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2714dcf2-0100-4eaf-82cb-ddc473161ed6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:02:49.806265 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2714dcf2-0100-4eaf-82cb-ddc473161ed6 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:02:49.826725 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1144/2275] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 18:02:49 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:02:49.832256 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863ad013-09f6-48ba-9a13-14fdf41d1e17 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:02:49.848093 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863ad013-09f6-48ba-9a13-14fdf41d1e17 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:02:49.853858 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027e4fd1-f56f-44fc-9091-84095ce53ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:02:49.854901 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027e4fd1-f56f-44fc-9091-84095ce53ef2 admin admin] REQUEST_METHOD: `PUT` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:49.855335 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027e4fd1-f56f-44fc-9091-84095ce53ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:49.855880 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027e4fd1-f56f-44fc-9091-84095ce53ef2 admin admin] PATH_INFO: `/v3/projects/ae8a323850ca4bfd889b1b4723b19b7d/users/d58aad34d097456d88cd564e581c9ebf/roles/9ee80134743f4c2b88525b04df2facba` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:49.881376 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027e4fd1-f56f-44fc-9091-84095ce53ef2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae8a323850ca4bfd889b1b4723b19b7d, user_id=d58aad34d097456d88cd564e581c9ebf, role_id=9ee80134743f4c2b88525b04df2facba)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:02:49.887032 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027e4fd1-f56f-44fc-9091-84095ce53ef2 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:02:50.008729 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1132/2276] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 18:02:49 2022] PUT /identity/v3/projects/ae8a323850ca4bfd889b1b4723b19b7d/users/d58aad34d097456d88cd564e581c9ebf/roles/9ee80134743f4c2b88525b04df2facba => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:02:50.020690 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b22389-a71c-41ea-bcfa-7f8fdae06c2a None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:50.024093 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b22389-a71c-41ea-bcfa-7f8fdae06c2a None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:50.024623 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b22389-a71c-41ea-bcfa-7f8fdae06c2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:50.083902 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-31b22389-a71c-41ea-bcfa-7f8fdae06c2a None None] MFA Rules not processed for user `d58aad34d097456d88cd564e581c9ebf`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:02:50.085810 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-31b22389-a71c-41ea-bcfa-7f8fdae06c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:02:50.177758 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1145/2277] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:02:50 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 18:02:50.186122 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027e4fd1-f56f-44fc-9091-84095ce53ef2 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:02:50.190005 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-027e4fd1-f56f-44fc-9091-84095ce53ef2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:02:50.216786 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:02:50.341506 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027e4fd1-f56f-44fc-9091-84095ce53ef2 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:02:50.346926 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538e4ac1-c7a9-4fe1-b0ea-0ab01742ca4b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359f5ed4eb684e769f552484ca9a34c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:02:50.348150 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e4ac1-c7a9-4fe1-b0ea-0ab01742ca4b service glance] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:50.348586 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e4ac1-c7a9-4fe1-b0ea-0ab01742ca4b service glance] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:50.348991 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e4ac1-c7a9-4fe1-b0ea-0ab01742ca4b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:50.361996 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538e4ac1-c7a9-4fe1-b0ea-0ab01742ca4b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:02:50.363938 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538e4ac1-c7a9-4fe1-b0ea-0ab01742ca4b service glance] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:02:50.374927 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1133/2278] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 18:02:50 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 18:02:55.282208 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416dedaa-0d8e-4af9-9088-333e069acf5b None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:55.283864 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416dedaa-0d8e-4af9-9088-333e069acf5b None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:55.283864 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416dedaa-0d8e-4af9-9088-333e069acf5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:55.304597 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-416dedaa-0d8e-4af9-9088-333e069acf5b None None] MFA Rules not processed for user `0b64d79cbd27413cb9d6064e7b9c88e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:02:55.306065 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-416dedaa-0d8e-4af9-9088-333e069acf5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:02:55.379511 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1146/2279] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:02:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 18:03:00.645901 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=29 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:03:05.371359 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=67,keystone:INSERT=3 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:03:10.498406 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538e4ac1-c7a9-4fe1-b0ea-0ab01742ca4b service glance] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:03:10.500029 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-538e4ac1-c7a9-4fe1-b0ea-0ab01742ca4b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:03:10.568984 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538e4ac1-c7a9-4fe1-b0ea-0ab01742ca4b service glance] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:03:10.572754 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67804ce6-1926-4ddf-8720-fc70e22b7355 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5652329c71cd431fb579d69cef933b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:03:10.573406 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67804ce6-1926-4ddf-8720-fc70e22b7355 service neutron] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:10.573691 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67804ce6-1926-4ddf-8720-fc70e22b7355 service neutron] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:10.573971 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67804ce6-1926-4ddf-8720-fc70e22b7355 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:10.575846 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-67804ce6-1926-4ddf-8720-fc70e22b7355 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:03:10.653248 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67804ce6-1926-4ddf-8720-fc70e22b7355 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:03:10.654904 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67804ce6-1926-4ddf-8720-fc70e22b7355 service neutron] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:03:10.667245 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1134/2280] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 18:03:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:03:13.059841 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416dedaa-0d8e-4af9-9088-333e069acf5b None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:03:13.061614 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-416dedaa-0d8e-4af9-9088-333e069acf5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:03:13.075324 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416dedaa-0d8e-4af9-9088-333e069acf5b None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:03:13.079666 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745a633d-28fc-4bf3-9f7a-68452d9a211c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5652329c71cd431fb579d69cef933b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:03:13.080416 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a633d-28fc-4bf3-9f7a-68452d9a211c service neutron] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:13.080793 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a633d-28fc-4bf3-9f7a-68452d9a211c service neutron] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:13.081319 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a633d-28fc-4bf3-9f7a-68452d9a211c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:13.083244 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-745a633d-28fc-4bf3-9f7a-68452d9a211c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:03:13.098144 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745a633d-28fc-4bf3-9f7a-68452d9a211c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:03:13.099711 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745a633d-28fc-4bf3-9f7a-68452d9a211c service neutron] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:03:13.112437 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1147/2281] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 18:03:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:03:20.662430 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=54 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:03:23.106242 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=6 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:03:23.174600 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404bd754-b1d3-4449-b8b9-cab275f13523 None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:23.175120 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404bd754-b1d3-4449-b8b9-cab275f13523 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:23.175278 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404bd754-b1d3-4449-b8b9-cab275f13523 None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:23.177044 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1135/2282] 10.222.0.36 () {54 vars in 921 bytes} [Tue Jun 14 18:03:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 18:03:23.198321 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4263c82c-7c22-46b5-beed-f9f5d56b5aa6 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:23.198565 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4263c82c-7c22-46b5-beed-f9f5d56b5aa6 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:23.198872 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4263c82c-7c22-46b5-beed-f9f5d56b5aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:23.243931 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-4263c82c-7c22-46b5-beed-f9f5d56b5aa6 None None] MFA Rules not processed for user `6a8049f9c66b4b5185c26084fd8239ab`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:03:23.245287 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-4263c82c-7c22-46b5-beed-f9f5d56b5aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:03:23.338018 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1148/2283] 10.222.0.36 () {58 vars in 1018 bytes} [Tue Jun 14 18:03:23 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:03:23.357719 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404bd754-b1d3-4449-b8b9-cab275f13523 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:03:23.359767 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-404bd754-b1d3-4449-b8b9-cab275f13523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:03:23.381748 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404bd754-b1d3-4449-b8b9-cab275f13523 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:03:23.387600 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9c2ca2-4cb0-42ee-91a5-b24f96f3bc8b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a8049f9c66b4b5185c26084fd8239ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:03:23.387976 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9c2ca2-4cb0-42ee-91a5-b24f96f3bc8b service placement] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:23.388458 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9c2ca2-4cb0-42ee-91a5-b24f96f3bc8b service placement] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:23.388745 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9c2ca2-4cb0-42ee-91a5-b24f96f3bc8b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:23.400715 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9c2ca2-4cb0-42ee-91a5-b24f96f3bc8b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:03:23.402895 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9c2ca2-4cb0-42ee-91a5-b24f96f3bc8b service placement] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:03:23.415255 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1136/2284] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 18:03:23 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:03:23.463281 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4263c82c-7c22-46b5-beed-f9f5d56b5aa6 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:03:23.464811 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-4263c82c-7c22-46b5-beed-f9f5d56b5aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:03:23.565618 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4263c82c-7c22-46b5-beed-f9f5d56b5aa6 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:03:23.574556 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c5ee01-eea3-405f-8e48-0451547eff41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:03:23.576362 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c5ee01-eea3-405f-8e48-0451547eff41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:23.577552 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c5ee01-eea3-405f-8e48-0451547eff41 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:23.577552 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c5ee01-eea3-405f-8e48-0451547eff41 admin admin] PATH_INFO: `/v3/users/e73368f3ce8a43368b30985898cf7393` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:23.580407 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c5ee01-eea3-405f-8e48-0451547eff41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e73368f3ce8a43368b30985898cf7393)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:03:23.583977 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c5ee01-eea3-405f-8e48-0451547eff41 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:03:23.813212 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-79c5ee01-eea3-405f-8e48-0451547eff41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e73368f3ce8a43368b30985898cf7393'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:03:23.815030 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-79c5ee01-eea3-405f-8e48-0451547eff41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e73368f3ce8a43368b30985898cf7393'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:03:23.816183 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-79c5ee01-eea3-405f-8e48-0451547eff41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e73368f3ce8a43368b30985898cf7393'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:03:23.903444 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-79c5ee01-eea3-405f-8e48-0451547eff41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e73368f3ce8a43368b30985898cf7393'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:03:23.913710 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-79c5ee01-eea3-405f-8e48-0451547eff41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e73368f3ce8a43368b30985898cf7393'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:03:23.933785 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1149/2285] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 14 18:03:23 2022] DELETE /identity/v3/users/e73368f3ce8a43368b30985898cf7393 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:03:24.294057 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9c2ca2-4cb0-42ee-91a5-b24f96f3bc8b service placement] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:03:24.305972 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9c2ca2-4cb0-42ee-91a5-b24f96f3bc8b service placement] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:03:24.378757 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304f37b7-0f4a-40ea-a628-287c0eaca9b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:03:24.379622 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304f37b7-0f4a-40ea-a628-287c0eaca9b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:24.379916 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304f37b7-0f4a-40ea-a628-287c0eaca9b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:24.380203 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304f37b7-0f4a-40ea-a628-287c0eaca9b9 admin admin] PATH_INFO: `/v3/projects/5a142734eadd40fb908c7bd115c81ee4` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:24.381443 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304f37b7-0f4a-40ea-a628-287c0eaca9b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a142734eadd40fb908c7bd115c81ee4)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:03:24.383435 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304f37b7-0f4a-40ea-a628-287c0eaca9b9 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:03:24.511093 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-304f37b7-0f4a-40ea-a628-287c0eaca9b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a142734eadd40fb908c7bd115c81ee4', 'request_id': 'req-304f37b7-0f4a-40ea-a628-287c0eaca9b9'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:03:24.589338 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-304f37b7-0f4a-40ea-a628-287c0eaca9b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a142734eadd40fb908c7bd115c81ee4', 'request_id': 'req-304f37b7-0f4a-40ea-a628-287c0eaca9b9'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:03:24.598126 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-304f37b7-0f4a-40ea-a628-287c0eaca9b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a142734eadd40fb908c7bd115c81ee4', 'request_id': 'req-304f37b7-0f4a-40ea-a628-287c0eaca9b9'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:03:24.612738 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-304f37b7-0f4a-40ea-a628-287c0eaca9b9 admin admin] The token cache is being invalidate because project 5a142734eadd40fb908c7bd115c81ee4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:03:24.613024 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-304f37b7-0f4a-40ea-a628-287c0eaca9b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:03:24.613741 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-304f37b7-0f4a-40ea-a628-287c0eaca9b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:03:24.616286 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1137/2286] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 14 18:03:24 2022] DELETE /identity/v3/projects/5a142734eadd40fb908c7bd115c81ee4 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 18:03:28.014263 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c5ee01-eea3-405f-8e48-0451547eff41 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:03:28.016760 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-79c5ee01-eea3-405f-8e48-0451547eff41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:03:28.026658 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:03:28.099250 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c5ee01-eea3-405f-8e48-0451547eff41 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:03:28.153402 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18428f1-40d3-417c-9efb-60272f9ddd20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17945e7d72954b8787e0ba09a9903247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:03:28.154077 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18428f1-40d3-417c-9efb-60272f9ddd20 service cinder] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:28.154352 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18428f1-40d3-417c-9efb-60272f9ddd20 service cinder] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:28.154637 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18428f1-40d3-417c-9efb-60272f9ddd20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:28.156573 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-c18428f1-40d3-417c-9efb-60272f9ddd20 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:03:28.227439 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18428f1-40d3-417c-9efb-60272f9ddd20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:03:28.228912 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18428f1-40d3-417c-9efb-60272f9ddd20 service cinder] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:03:28.239393 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1150/2287] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 18:03:28 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:03:32.352186 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304f37b7-0f4a-40ea-a628-287c0eaca9b9 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:03:32.353679 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-304f37b7-0f4a-40ea-a628-287c0eaca9b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:03:32.435618 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304f37b7-0f4a-40ea-a628-287c0eaca9b9 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:03:32.440706 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e988bcbc-3494-4778-ae06-a3ca89c6bae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:03:32.441683 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e988bcbc-3494-4778-ae06-a3ca89c6bae2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:32.442095 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e988bcbc-3494-4778-ae06-a3ca89c6bae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:32.442812 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e988bcbc-3494-4778-ae06-a3ca89c6bae2 admin admin] PATH_INFO: `/v3/users/d58aad34d097456d88cd564e581c9ebf` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:32.443640 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e988bcbc-3494-4778-ae06-a3ca89c6bae2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d58aad34d097456d88cd564e581c9ebf)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:03:32.445666 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e988bcbc-3494-4778-ae06-a3ca89c6bae2 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:03:32.468518 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:03:32.559229 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdcedb9-25b7-48f1-9857-cf181e1007b9 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:32.559812 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdcedb9-25b7-48f1-9857-cf181e1007b9 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:32.559913 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdcedb9-25b7-48f1-9857-cf181e1007b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:32.579778 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-0cdcedb9-25b7-48f1-9857-cf181e1007b9 None None] MFA Rules not processed for user `41680577c34d4b9090270d3097a7e02c`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:03:32.582343 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-0cdcedb9-25b7-48f1-9857-cf181e1007b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:03:32.653441 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1151/2288] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:03:32 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 18:03:32.741434 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-e988bcbc-3494-4778-ae06-a3ca89c6bae2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd58aad34d097456d88cd564e581c9ebf'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:03:32.742165 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-e988bcbc-3494-4778-ae06-a3ca89c6bae2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd58aad34d097456d88cd564e581c9ebf'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:03:32.742801 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-e988bcbc-3494-4778-ae06-a3ca89c6bae2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd58aad34d097456d88cd564e581c9ebf'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:03:32.766636 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdcedb9-25b7-48f1-9857-cf181e1007b9 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:03:32.768770 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-0cdcedb9-25b7-48f1-9857-cf181e1007b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:03:32.794811 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:03:32.833741 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-e988bcbc-3494-4778-ae06-a3ca89c6bae2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd58aad34d097456d88cd564e581c9ebf'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:03:32.841388 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-e988bcbc-3494-4778-ae06-a3ca89c6bae2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd58aad34d097456d88cd564e581c9ebf'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:03:32.851476 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdcedb9-25b7-48f1-9857-cf181e1007b9 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:03:32.857100 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31c0f6d-cb39-4c42-9b8c-e9b248781d6a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4696d396adb495ab300a9a5a5727595', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:03:32.857763 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31c0f6d-cb39-4c42-9b8c-e9b248781d6a service nova] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:32.858080 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31c0f6d-cb39-4c42-9b8c-e9b248781d6a service nova] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:32.858370 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31c0f6d-cb39-4c42-9b8c-e9b248781d6a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:32.863357 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1138/2289] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 14 18:03:32 2022] DELETE /identity/v3/users/d58aad34d097456d88cd564e581c9ebf => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:03:32.864166 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-d31c0f6d-cb39-4c42-9b8c-e9b248781d6a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:03:32.864969 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17798d95-1078-4edd-a6e1-fe843a0e5cbc None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:32.865264 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17798d95-1078-4edd-a6e1-fe843a0e5cbc None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:32.865556 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17798d95-1078-4edd-a6e1-fe843a0e5cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:32.872159 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31c0f6d-cb39-4c42-9b8c-e9b248781d6a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:03:32.873986 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31c0f6d-cb39-4c42-9b8c-e9b248781d6a service nova] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:03:32.884301 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1152/2290] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 18:03:32 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:03:32.886866 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-17798d95-1078-4edd-a6e1-fe843a0e5cbc None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:03:32.888343 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-17798d95-1078-4edd-a6e1-fe843a0e5cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:03:32.958847 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1139/2291] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:03:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:03:32.971715 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31c0f6d-cb39-4c42-9b8c-e9b248781d6a service nova] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:03:32.973225 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-d31c0f6d-cb39-4c42-9b8c-e9b248781d6a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:03:33.044951 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31c0f6d-cb39-4c42-9b8c-e9b248781d6a service nova] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:03:33.098109 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae66fec2-860b-4be9-a238-a85e13236de0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5652329c71cd431fb579d69cef933b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:03:33.098776 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae66fec2-860b-4be9-a238-a85e13236de0 service neutron] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:33.099074 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae66fec2-860b-4be9-a238-a85e13236de0 service neutron] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:33.099386 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae66fec2-860b-4be9-a238-a85e13236de0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:33.110028 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae66fec2-860b-4be9-a238-a85e13236de0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:03:33.110927 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae66fec2-860b-4be9-a238-a85e13236de0 service neutron] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:03:33.122297 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1153/2292] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 18:03:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:03:33.680706 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17798d95-1078-4edd-a6e1-fe843a0e5cbc None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:03:33.684723 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae66fec2-860b-4be9-a238-a85e13236de0 service neutron] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:03:33.688352 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-17798d95-1078-4edd-a6e1-fe843a0e5cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:03:33.688480 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-ae66fec2-860b-4be9-a238-a85e13236de0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:03:33.701201 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae66fec2-860b-4be9-a238-a85e13236de0 service neutron] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:03:33.721117 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5330705c-3dd6-450c-b824-f514f0c84a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:03:33.721764 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5330705c-3dd6-450c-b824-f514f0c84a68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:33.722065 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5330705c-3dd6-450c-b824-f514f0c84a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:33.722379 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5330705c-3dd6-450c-b824-f514f0c84a68 admin admin] PATH_INFO: `/v3/projects/ae8a323850ca4bfd889b1b4723b19b7d` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:33.724293 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5330705c-3dd6-450c-b824-f514f0c84a68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae8a323850ca4bfd889b1b4723b19b7d)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:03:33.726216 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5330705c-3dd6-450c-b824-f514f0c84a68 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:03:33.784805 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17798d95-1078-4edd-a6e1-fe843a0e5cbc None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:03:33.791619 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeef7bf-c849-4a4b-8306-976ea09b36a3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a8049f9c66b4b5185c26084fd8239ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:03:33.792206 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeef7bf-c849-4a4b-8306-976ea09b36a3 service placement] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:33.792655 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeef7bf-c849-4a4b-8306-976ea09b36a3 service placement] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:33.792905 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeef7bf-c849-4a4b-8306-976ea09b36a3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:33.795192 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-ebeef7bf-c849-4a4b-8306-976ea09b36a3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:03:33.809513 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeef7bf-c849-4a4b-8306-976ea09b36a3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:03:33.811578 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeef7bf-c849-4a4b-8306-976ea09b36a3 service placement] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:03:33.824242 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1140/2293] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 18:03:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:03:33.875101 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-5330705c-3dd6-450c-b824-f514f0c84a68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae8a323850ca4bfd889b1b4723b19b7d', 'request_id': 'req-5330705c-3dd6-450c-b824-f514f0c84a68'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:03:33.977546 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-5330705c-3dd6-450c-b824-f514f0c84a68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae8a323850ca4bfd889b1b4723b19b7d', 'request_id': 'req-5330705c-3dd6-450c-b824-f514f0c84a68'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:03:33.979003 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:03:33.994394 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-5330705c-3dd6-450c-b824-f514f0c84a68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae8a323850ca4bfd889b1b4723b19b7d', 'request_id': 'req-5330705c-3dd6-450c-b824-f514f0c84a68'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:03:34.006500 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-5330705c-3dd6-450c-b824-f514f0c84a68 admin admin] The token cache is being invalidate because project ae8a323850ca4bfd889b1b4723b19b7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87019) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:03:34.007008 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-5330705c-3dd6-450c-b824-f514f0c84a68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:03:34.007859 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-5330705c-3dd6-450c-b824-f514f0c84a68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:03:34.009935 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1154/2294] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 14 18:03:33 2022] DELETE /identity/v3/projects/ae8a323850ca4bfd889b1b4723b19b7d => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:03:34.015002 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a9526b-634c-43fd-9fc4-62afe8eb5750 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:34.015710 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a9526b-634c-43fd-9fc4-62afe8eb5750 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:34.015996 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a9526b-634c-43fd-9fc4-62afe8eb5750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:34.052885 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-d0a9526b-634c-43fd-9fc4-62afe8eb5750 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:03:34.054184 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-d0a9526b-634c-43fd-9fc4-62afe8eb5750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:03:34.081836 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:03:34.125877 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1141/2295] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:03:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:03:34.135453 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fd4945-0d5f-4e08-b218-510ad60f3af1 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:34.135773 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fd4945-0d5f-4e08-b218-510ad60f3af1 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:34.136115 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fd4945-0d5f-4e08-b218-510ad60f3af1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:34.160018 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-57fd4945-0d5f-4e08-b218-510ad60f3af1 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:03:34.161878 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-57fd4945-0d5f-4e08-b218-510ad60f3af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:03:34.171019 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1155/2296] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:03:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:03:34.178059 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a9526b-634c-43fd-9fc4-62afe8eb5750 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:03:34.191348 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a9526b-634c-43fd-9fc4-62afe8eb5750 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:03:34.197638 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f036145-b461-4766-8b82-ee1134b08ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:03:34.198407 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f036145-b461-4766-8b82-ee1134b08ecf admin admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:34.198697 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f036145-b461-4766-8b82-ee1134b08ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:34.198978 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f036145-b461-4766-8b82-ee1134b08ecf admin admin] PATH_INFO: `/v3/domains` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:34.199948 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f036145-b461-4766-8b82-ee1134b08ecf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 18:03:34.200468 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f036145-b461-4766-8b82-ee1134b08ecf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:03:34.202237 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f036145-b461-4766-8b82-ee1134b08ecf admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:03:34.216718 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1142/2297] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 14 18:03:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 18:03:34.222331 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fd4945-0d5f-4e08-b218-510ad60f3af1 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:03:34.232281 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fd4945-0d5f-4e08-b218-510ad60f3af1 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:03:34.237857 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1126fa61-ba07-4cec-bfbc-803d73887ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:03:34.238705 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1126fa61-ba07-4cec-bfbc-803d73887ed6 admin admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:34.239452 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1126fa61-ba07-4cec-bfbc-803d73887ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:34.239822 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1126fa61-ba07-4cec-bfbc-803d73887ed6 admin admin] PATH_INFO: `/v3/projects` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:34.240524 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1126fa61-ba07-4cec-bfbc-803d73887ed6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:03:34.242562 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1126fa61-ba07-4cec-bfbc-803d73887ed6 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:03:34.372216 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1156/2298] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 14 18:03:34 2022] POST /identity/v3/projects => generated 399 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:03:34.376270 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f036145-b461-4766-8b82-ee1134b08ecf admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:03:34.387751 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f036145-b461-4766-8b82-ee1134b08ecf admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:03:34.453986 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae971373-e035-4936-9cb1-ed480abc507e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:03:34.455236 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae971373-e035-4936-9cb1-ed480abc507e admin admin] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:34.455698 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae971373-e035-4936-9cb1-ed480abc507e admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:34.455961 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae971373-e035-4936-9cb1-ed480abc507e admin admin] PATH_INFO: `/v3/users` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:34.456633 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae971373-e035-4936-9cb1-ed480abc507e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:03:34.458590 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae971373-e035-4936-9cb1-ed480abc507e admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:03:34.568529 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1143/2299] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 14 18:03:34 2022] POST /identity/v3/users => generated 300 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:03:34.573525 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1126fa61-ba07-4cec-bfbc-803d73887ed6 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:03:34.585934 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1126fa61-ba07-4cec-bfbc-803d73887ed6 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:03:34.592218 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c591624f-e71b-4a1b-9c95-1b3e417b7d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:03:34.592900 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c591624f-e71b-4a1b-9c95-1b3e417b7d1d admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:34.593195 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c591624f-e71b-4a1b-9c95-1b3e417b7d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:34.600128 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c591624f-e71b-4a1b-9c95-1b3e417b7d1d admin admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:34.601003 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c591624f-e71b-4a1b-9c95-1b3e417b7d1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:03:34.603691 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c591624f-e71b-4a1b-9c95-1b3e417b7d1d admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:03:34.616613 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1157/2300] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 18:03:34 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 14 18:03:34.620475 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae971373-e035-4936-9cb1-ed480abc507e admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:03:34.633500 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae971373-e035-4936-9cb1-ed480abc507e admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:03:34.639454 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd93c1e-067d-40e1-8be9-4d66ea3d2bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:03:34.640669 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd93c1e-067d-40e1-8be9-4d66ea3d2bc7 admin admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:34.640969 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd93c1e-067d-40e1-8be9-4d66ea3d2bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:34.641239 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd93c1e-067d-40e1-8be9-4d66ea3d2bc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:34.642751 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd93c1e-067d-40e1-8be9-4d66ea3d2bc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:03:34.644525 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd93c1e-067d-40e1-8be9-4d66ea3d2bc7 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:03:34.658041 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1144/2301] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 18:03:34 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 14 18:03:34.662570 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c591624f-e71b-4a1b-9c95-1b3e417b7d1d admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:03:34.676458 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c591624f-e71b-4a1b-9c95-1b3e417b7d1d admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:03:34.681371 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48097a9-24f7-4b26-b195-f2483b6b848b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:03:34.682437 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48097a9-24f7-4b26-b195-f2483b6b848b admin admin] REQUEST_METHOD: `PUT` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:34.682723 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48097a9-24f7-4b26-b195-f2483b6b848b admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:34.683029 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48097a9-24f7-4b26-b195-f2483b6b848b admin admin] PATH_INFO: `/v3/projects/8416ca0c374e47fc9cae7ce04d0de7b3/users/9ea30656245048b096d93d1e1f124658/roles/9ee80134743f4c2b88525b04df2facba` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:34.700345 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48097a9-24f7-4b26-b195-f2483b6b848b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8416ca0c374e47fc9cae7ce04d0de7b3, user_id=9ea30656245048b096d93d1e1f124658, role_id=9ee80134743f4c2b88525b04df2facba)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:03:34.703008 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48097a9-24f7-4b26-b195-f2483b6b848b admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:03:34.823404 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1158/2302] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 18:03:34 2022] PUT /identity/v3/projects/8416ca0c374e47fc9cae7ce04d0de7b3/users/9ea30656245048b096d93d1e1f124658/roles/9ee80134743f4c2b88525b04df2facba => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:03:34.830501 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbcaf89-c552-48d9-aaee-5202166a4148 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:34.833173 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbcaf89-c552-48d9-aaee-5202166a4148 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:34.833173 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbcaf89-c552-48d9-aaee-5202166a4148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:34.860801 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-0dbcaf89-c552-48d9-aaee-5202166a4148 None None] MFA Rules not processed for user `9ea30656245048b096d93d1e1f124658`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:03:34.862172 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-0dbcaf89-c552-48d9-aaee-5202166a4148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:03:34.952308 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1145/2303] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:03:34 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:03:34.965228 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48097a9-24f7-4b26-b195-f2483b6b848b admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:03:34.966906 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-b48097a9-24f7-4b26-b195-f2483b6b848b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:03:34.984152 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbcaf89-c552-48d9-aaee-5202166a4148 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:03:34.986476 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-0dbcaf89-c552-48d9-aaee-5202166a4148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:03:35.017355 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:03:35.034811 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48097a9-24f7-4b26-b195-f2483b6b848b admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:03:35.043179 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cf26fd-d41c-4ee2-aba4-a274b53b3dd5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17945e7d72954b8787e0ba09a9903247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:03:35.046452 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cf26fd-d41c-4ee2-aba4-a274b53b3dd5 service cinder] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:35.046452 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cf26fd-d41c-4ee2-aba4-a274b53b3dd5 service cinder] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:35.046672 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cf26fd-d41c-4ee2-aba4-a274b53b3dd5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:35.054900 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbcaf89-c552-48d9-aaee-5202166a4148 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:03:35.060528 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a38dd5-2678-4c2d-8c99-426e3d5d6b3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5652329c71cd431fb579d69cef933b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:03:35.063098 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a38dd5-2678-4c2d-8c99-426e3d5d6b3c service neutron] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:35.066497 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a38dd5-2678-4c2d-8c99-426e3d5d6b3c service neutron] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:35.068290 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a38dd5-2678-4c2d-8c99-426e3d5d6b3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:35.070620 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cf26fd-d41c-4ee2-aba4-a274b53b3dd5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:03:35.072759 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-b2a38dd5-2678-4c2d-8c99-426e3d5d6b3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:03:35.074555 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cf26fd-d41c-4ee2-aba4-a274b53b3dd5 service cinder] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:03:35.090780 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a38dd5-2678-4c2d-8c99-426e3d5d6b3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:03:35.097373 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1159/2304] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 18:03:34 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:03:35.097640 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a38dd5-2678-4c2d-8c99-426e3d5d6b3c service neutron] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:03:35.124409 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1146/2305] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 18:03:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 18:03:37.632011 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d83854-0dc1-4493-956a-f041ddd3146c None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:37.632661 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d83854-0dc1-4493-956a-f041ddd3146c None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:37.632661 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d83854-0dc1-4493-956a-f041ddd3146c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:37.680107 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-72d83854-0dc1-4493-956a-f041ddd3146c None None] MFA Rules not processed for user `7f214333671e4878bf613c26ceb1381a`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:03:37.681475 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-72d83854-0dc1-4493-956a-f041ddd3146c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:03:37.759207 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1160/2306] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:03:37 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:03:44.656799 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a38dd5-2678-4c2d-8c99-426e3d5d6b3c service neutron] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:03:44.743169 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a38dd5-2678-4c2d-8c99-426e3d5d6b3c service neutron] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:03:44.754338 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af45762-b92f-432f-88f6-fd680771cd29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:03:44.755464 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af45762-b92f-432f-88f6-fd680771cd29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:44.755937 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af45762-b92f-432f-88f6-fd680771cd29 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:44.756227 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af45762-b92f-432f-88f6-fd680771cd29 admin admin] PATH_INFO: `/v3/users/9ea30656245048b096d93d1e1f124658` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:44.757466 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af45762-b92f-432f-88f6-fd680771cd29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ea30656245048b096d93d1e1f124658)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:03:44.759585 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af45762-b92f-432f-88f6-fd680771cd29 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:03:45.028130 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-5af45762-b92f-432f-88f6-fd680771cd29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ea30656245048b096d93d1e1f124658'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:03:45.028809 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-5af45762-b92f-432f-88f6-fd680771cd29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ea30656245048b096d93d1e1f124658'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:03:45.029417 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-5af45762-b92f-432f-88f6-fd680771cd29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ea30656245048b096d93d1e1f124658'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:03:45.114426 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-5af45762-b92f-432f-88f6-fd680771cd29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ea30656245048b096d93d1e1f124658'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:03:45.123332 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-5af45762-b92f-432f-88f6-fd680771cd29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ea30656245048b096d93d1e1f124658'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:03:45.145218 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1147/2307] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 14 18:03:44 2022] DELETE /identity/v3/users/9ea30656245048b096d93d1e1f124658 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:03:45.150156 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7841fecf-9e87-41b7-b714-9cad4c03a844 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:45.150779 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7841fecf-9e87-41b7-b714-9cad4c03a844 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:45.150779 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7841fecf-9e87-41b7-b714-9cad4c03a844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:45.170867 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-7841fecf-9e87-41b7-b714-9cad4c03a844 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:03:45.172164 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-7841fecf-9e87-41b7-b714-9cad4c03a844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:03:45.202203 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:03:45.242085 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1161/2308] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:03:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:03:45.252803 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af45762-b92f-432f-88f6-fd680771cd29 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:03:45.254643 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-5af45762-b92f-432f-88f6-fd680771cd29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:03:45.316841 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:03:45.333532 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af45762-b92f-432f-88f6-fd680771cd29 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:03:45.337559 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d428e28c-a473-4a9c-beaf-4eebdfdbf97e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5652329c71cd431fb579d69cef933b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:03:45.338328 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d428e28c-a473-4a9c-beaf-4eebdfdbf97e service neutron] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:45.338698 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d428e28c-a473-4a9c-beaf-4eebdfdbf97e service neutron] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:45.339249 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d428e28c-a473-4a9c-beaf-4eebdfdbf97e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:45.352694 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d428e28c-a473-4a9c-beaf-4eebdfdbf97e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:03:45.354234 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d428e28c-a473-4a9c-beaf-4eebdfdbf97e service neutron] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:03:45.370685 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1148/2309] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 18:03:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:03:45.984800 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7841fecf-9e87-41b7-b714-9cad4c03a844 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:03:45.987201 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-7841fecf-9e87-41b7-b714-9cad4c03a844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:03:46.005709 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7841fecf-9e87-41b7-b714-9cad4c03a844 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:03:46.012264 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5823c962-918b-42f8-a102-6faf8017ed93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:03:46.013454 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5823c962-918b-42f8-a102-6faf8017ed93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:46.013848 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5823c962-918b-42f8-a102-6faf8017ed93 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:46.014228 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5823c962-918b-42f8-a102-6faf8017ed93 admin admin] PATH_INFO: `/v3/projects/8416ca0c374e47fc9cae7ce04d0de7b3` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:46.016202 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5823c962-918b-42f8-a102-6faf8017ed93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8416ca0c374e47fc9cae7ce04d0de7b3)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:03:46.018991 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5823c962-918b-42f8-a102-6faf8017ed93 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:03:46.200238 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-5823c962-918b-42f8-a102-6faf8017ed93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8416ca0c374e47fc9cae7ce04d0de7b3', 'request_id': 'req-5823c962-918b-42f8-a102-6faf8017ed93'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:03:46.316469 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-5823c962-918b-42f8-a102-6faf8017ed93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8416ca0c374e47fc9cae7ce04d0de7b3', 'request_id': 'req-5823c962-918b-42f8-a102-6faf8017ed93'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:03:46.324435 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-5823c962-918b-42f8-a102-6faf8017ed93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8416ca0c374e47fc9cae7ce04d0de7b3', 'request_id': 'req-5823c962-918b-42f8-a102-6faf8017ed93'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:03:46.340938 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-5823c962-918b-42f8-a102-6faf8017ed93 admin admin] The token cache is being invalidate because project 8416ca0c374e47fc9cae7ce04d0de7b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87019) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:03:46.341426 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-5823c962-918b-42f8-a102-6faf8017ed93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:03:46.342210 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-5823c962-918b-42f8-a102-6faf8017ed93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:03:46.344560 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1162/2310] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 14 18:03:45 2022] DELETE /identity/v3/projects/8416ca0c374e47fc9cae7ce04d0de7b3 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:03:46.355941 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9508d7-33d1-415c-8809-b1236a4c47e3 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:46.355941 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9508d7-33d1-415c-8809-b1236a4c47e3 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:46.356736 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9508d7-33d1-415c-8809-b1236a4c47e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:46.387833 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-ff9508d7-33d1-415c-8809-b1236a4c47e3 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:03:46.392641 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-ff9508d7-33d1-415c-8809-b1236a4c47e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:03:46.480558 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1149/2311] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:03:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:03:46.489111 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34afba1e-bc1a-4fe7-9f9a-3c4602fd93c3 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:46.489452 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34afba1e-bc1a-4fe7-9f9a-3c4602fd93c3 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:46.494092 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34afba1e-bc1a-4fe7-9f9a-3c4602fd93c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:46.512733 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-34afba1e-bc1a-4fe7-9f9a-3c4602fd93c3 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:03:46.513958 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-34afba1e-bc1a-4fe7-9f9a-3c4602fd93c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:03:46.524107 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1163/2312] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:03:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:03:46.530070 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9508d7-33d1-415c-8809-b1236a4c47e3 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:03:46.542650 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9508d7-33d1-415c-8809-b1236a4c47e3 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:03:46.555186 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50296ead-44b9-43c8-a524-966e3926ef37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:03:46.555186 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50296ead-44b9-43c8-a524-966e3926ef37 admin admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:46.555186 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50296ead-44b9-43c8-a524-966e3926ef37 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:46.555186 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50296ead-44b9-43c8-a524-966e3926ef37 admin admin] PATH_INFO: `/v3/domains` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:46.555680 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50296ead-44b9-43c8-a524-966e3926ef37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 18:03:46.555680 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50296ead-44b9-43c8-a524-966e3926ef37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:03:46.555680 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50296ead-44b9-43c8-a524-966e3926ef37 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:03:46.570131 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1150/2313] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 14 18:03:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 18:03:46.574593 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34afba1e-bc1a-4fe7-9f9a-3c4602fd93c3 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:03:46.588227 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34afba1e-bc1a-4fe7-9f9a-3c4602fd93c3 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:03:46.594680 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21869e35-b1c4-40d8-a348-c1f614544809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:03:46.595685 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21869e35-b1c4-40d8-a348-c1f614544809 admin admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:46.596176 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21869e35-b1c4-40d8-a348-c1f614544809 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:46.596684 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21869e35-b1c4-40d8-a348-c1f614544809 admin admin] PATH_INFO: `/v3/projects` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:46.597790 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21869e35-b1c4-40d8-a348-c1f614544809 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:03:46.600799 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21869e35-b1c4-40d8-a348-c1f614544809 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:03:46.769582 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1164/2314] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 14 18:03:46 2022] POST /identity/v3/projects => generated 379 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:03:46.773794 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50296ead-44b9-43c8-a524-966e3926ef37 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:03:46.788149 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50296ead-44b9-43c8-a524-966e3926ef37 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:03:46.856477 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49a4f9e-0376-47fb-b499-011672dc21c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:03:46.857163 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49a4f9e-0376-47fb-b499-011672dc21c3 admin admin] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:46.857451 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49a4f9e-0376-47fb-b499-011672dc21c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:46.857876 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49a4f9e-0376-47fb-b499-011672dc21c3 admin admin] PATH_INFO: `/v3/users` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:46.858582 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49a4f9e-0376-47fb-b499-011672dc21c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:03:46.860629 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49a4f9e-0376-47fb-b499-011672dc21c3 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:03:46.988475 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1151/2315] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 14 18:03:46 2022] POST /identity/v3/users => generated 290 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 18:03:46.991161 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21869e35-b1c4-40d8-a348-c1f614544809 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:03:47.013355 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21869e35-b1c4-40d8-a348-c1f614544809 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:03:47.028066 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6132ef6-7f3a-420f-ac5d-2f4489c6a8b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:03:47.029466 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6132ef6-7f3a-420f-ac5d-2f4489c6a8b9 admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:47.030140 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6132ef6-7f3a-420f-ac5d-2f4489c6a8b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:47.030762 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6132ef6-7f3a-420f-ac5d-2f4489c6a8b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:47.033683 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6132ef6-7f3a-420f-ac5d-2f4489c6a8b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:03:47.037520 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6132ef6-7f3a-420f-ac5d-2f4489c6a8b9 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:03:47.065436 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1165/2316] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 18:03:46 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:03:47.073274 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49a4f9e-0376-47fb-b499-011672dc21c3 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:03:47.115004 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49a4f9e-0376-47fb-b499-011672dc21c3 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:03:47.121422 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eec7f7-6251-44ac-9707-a34c3a49aefb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:03:47.122949 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eec7f7-6251-44ac-9707-a34c3a49aefb admin admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:47.123669 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eec7f7-6251-44ac-9707-a34c3a49aefb admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:47.124422 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eec7f7-6251-44ac-9707-a34c3a49aefb admin admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:47.126723 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eec7f7-6251-44ac-9707-a34c3a49aefb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:03:47.131024 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eec7f7-6251-44ac-9707-a34c3a49aefb admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:03:47.162788 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1152/2317] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 18:03:47 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:03:47.165286 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6132ef6-7f3a-420f-ac5d-2f4489c6a8b9 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:03:47.187089 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6132ef6-7f3a-420f-ac5d-2f4489c6a8b9 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:03:47.196821 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c92e73a-35ef-4bd3-9acf-bd4f81b02c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:03:47.198727 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c92e73a-35ef-4bd3-9acf-bd4f81b02c3c admin admin] REQUEST_METHOD: `PUT` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:47.199437 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c92e73a-35ef-4bd3-9acf-bd4f81b02c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:47.200073 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c92e73a-35ef-4bd3-9acf-bd4f81b02c3c admin admin] PATH_INFO: `/v3/projects/f61370c4497b496487383283e474bc3a/users/da59091825d44440887d6ef9c542b1ce/roles/9ee80134743f4c2b88525b04df2facba` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:47.231179 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c92e73a-35ef-4bd3-9acf-bd4f81b02c3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f61370c4497b496487383283e474bc3a, user_id=da59091825d44440887d6ef9c542b1ce, role_id=9ee80134743f4c2b88525b04df2facba)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:03:47.237791 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c92e73a-35ef-4bd3-9acf-bd4f81b02c3c admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:03:47.349931 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1166/2318] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 18:03:47 2022] PUT /identity/v3/projects/f61370c4497b496487383283e474bc3a/users/da59091825d44440887d6ef9c542b1ce/roles/9ee80134743f4c2b88525b04df2facba => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:03:47.355844 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad56185-9c2a-4577-94ff-4d85dd9b542f None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:47.356535 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad56185-9c2a-4577-94ff-4d85dd9b542f None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:47.357143 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad56185-9c2a-4577-94ff-4d85dd9b542f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:47.376190 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-4ad56185-9c2a-4577-94ff-4d85dd9b542f None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:03:47.379240 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-4ad56185-9c2a-4577-94ff-4d85dd9b542f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:03:47.448975 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:03:47.464365 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1153/2319] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:03:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:03:47.477112 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c92e73a-35ef-4bd3-9acf-bd4f81b02c3c admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:03:47.479517 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-6c92e73a-35ef-4bd3-9acf-bd4f81b02c3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:03:47.609787 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:03:47.620093 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c92e73a-35ef-4bd3-9acf-bd4f81b02c3c admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:03:47.627800 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b5ff3e-273e-4078-a870-7b592bf28650 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5652329c71cd431fb579d69cef933b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:03:47.628777 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b5ff3e-273e-4078-a870-7b592bf28650 service neutron] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:47.629072 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b5ff3e-273e-4078-a870-7b592bf28650 service neutron] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:47.629355 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b5ff3e-273e-4078-a870-7b592bf28650 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:47.642859 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b5ff3e-273e-4078-a870-7b592bf28650 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:03:47.644772 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b5ff3e-273e-4078-a870-7b592bf28650 service neutron] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:03:47.662722 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1167/2320] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 18:03:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:03:49.146676 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad56185-9c2a-4577-94ff-4d85dd9b542f None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:03:49.148400 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-4ad56185-9c2a-4577-94ff-4d85dd9b542f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:03:49.303091 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad56185-9c2a-4577-94ff-4d85dd9b542f None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:03:49.309495 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ac9901-ae9f-47a5-a54f-2c7de3f4b784 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4696d396adb495ab300a9a5a5727595', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:03:49.310174 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ac9901-ae9f-47a5-a54f-2c7de3f4b784 service nova] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:49.315144 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ac9901-ae9f-47a5-a54f-2c7de3f4b784 service nova] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:49.315144 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ac9901-ae9f-47a5-a54f-2c7de3f4b784 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:49.315144 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-f2ac9901-ae9f-47a5-a54f-2c7de3f4b784 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:03:49.328023 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ac9901-ae9f-47a5-a54f-2c7de3f4b784 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:03:49.330291 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ac9901-ae9f-47a5-a54f-2c7de3f4b784 service nova] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:03:49.343950 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1154/2321] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 18:03:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:03:50.422655 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b5ff3e-273e-4078-a870-7b592bf28650 service neutron] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:03:50.440171 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b5ff3e-273e-4078-a870-7b592bf28650 service neutron] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:03:50.450404 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30347b23-cbd6-4555-8ff4-0d6eaaa1f946 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4696d396adb495ab300a9a5a5727595', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:03:50.469181 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30347b23-cbd6-4555-8ff4-0d6eaaa1f946 service nova] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:50.469181 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30347b23-cbd6-4555-8ff4-0d6eaaa1f946 service nova] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:50.469181 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30347b23-cbd6-4555-8ff4-0d6eaaa1f946 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:50.469181 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-30347b23-cbd6-4555-8ff4-0d6eaaa1f946 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:03:50.469806 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30347b23-cbd6-4555-8ff4-0d6eaaa1f946 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:03:50.472362 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30347b23-cbd6-4555-8ff4-0d6eaaa1f946 service nova] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:03:50.484784 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1168/2322] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 18:03:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:03:54.570711 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1930ac20-f312-4790-a1d0-5fd2fbcfbada None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:54.571614 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1930ac20-f312-4790-a1d0-5fd2fbcfbada None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:54.571975 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1930ac20-f312-4790-a1d0-5fd2fbcfbada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:54.596172 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-1930ac20-f312-4790-a1d0-5fd2fbcfbada None None] MFA Rules not processed for user `9c7ab182f1fd41718376a8e2f03ec87c`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:03:54.597490 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-1930ac20-f312-4790-a1d0-5fd2fbcfbada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:03:54.684478 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1155/2323] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:03:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:03:55.476824 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30347b23-cbd6-4555-8ff4-0d6eaaa1f946 service nova] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:03:55.480412 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-30347b23-cbd6-4555-8ff4-0d6eaaa1f946 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:03:55.498972 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30347b23-cbd6-4555-8ff4-0d6eaaa1f946 service nova] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:03:55.505594 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a920e5-648a-4442-9098-23225ad22118 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5652329c71cd431fb579d69cef933b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:03:55.506272 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a920e5-648a-4442-9098-23225ad22118 service neutron] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:55.506550 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a920e5-648a-4442-9098-23225ad22118 service neutron] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:55.507034 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a920e5-648a-4442-9098-23225ad22118 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:55.509094 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-d4a920e5-648a-4442-9098-23225ad22118 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:03:55.523891 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a920e5-648a-4442-9098-23225ad22118 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:03:55.539487 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a920e5-648a-4442-9098-23225ad22118 service neutron] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:03:55.542967 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1169/2324] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 18:03:55 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:03:57.911215 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388cf795-7485-4a38-9528-be6704b5dfad None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:57.911707 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388cf795-7485-4a38-9528-be6704b5dfad None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:57.913273 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388cf795-7485-4a38-9528-be6704b5dfad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:57.973304 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-388cf795-7485-4a38-9528-be6704b5dfad None None] MFA Rules not processed for user `da59091825d44440887d6ef9c542b1ce`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:03:57.975101 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-388cf795-7485-4a38-9528-be6704b5dfad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:03:58.060182 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1156/2325] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:03:57 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:03:58.064399 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a920e5-648a-4442-9098-23225ad22118 service neutron] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:03:58.075982 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a920e5-648a-4442-9098-23225ad22118 service neutron] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:03:58.081283 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bbdced-ef11-49a7-b636-491eee538bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:03:58.082173 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bbdced-ef11-49a7-b636-491eee538bca admin admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:58.082466 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bbdced-ef11-49a7-b636-491eee538bca admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:58.082836 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bbdced-ef11-49a7-b636-491eee538bca admin admin] PATH_INFO: `/v3/projects` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:58.083592 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bbdced-ef11-49a7-b636-491eee538bca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:03:58.085659 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bbdced-ef11-49a7-b636-491eee538bca admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:03:58.239857 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1170/2326] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 14 18:03:58 2022] POST /identity/v3/projects => generated 379 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:03:58.244335 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388cf795-7485-4a38-9528-be6704b5dfad None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:03:58.257789 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388cf795-7485-4a38-9528-be6704b5dfad None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:03:58.269906 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:03:58.334751 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505610a8-93f9-4d6c-9a7b-9439d9d2ce4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:03:58.335248 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505610a8-93f9-4d6c-9a7b-9439d9d2ce4c admin admin] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:58.335700 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505610a8-93f9-4d6c-9a7b-9439d9d2ce4c admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:58.336082 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505610a8-93f9-4d6c-9a7b-9439d9d2ce4c admin admin] PATH_INFO: `/v3/users` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:58.337040 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505610a8-93f9-4d6c-9a7b-9439d9d2ce4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:03:58.339121 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505610a8-93f9-4d6c-9a7b-9439d9d2ce4c admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:03:58.432677 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1157/2327] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 14 18:03:58 2022] POST /identity/v3/users => generated 296 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 18:03:58.441722 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bbdced-ef11-49a7-b636-491eee538bca admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:03:58.455228 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bbdced-ef11-49a7-b636-491eee538bca admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:03:58.460408 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6639438-fa60-4327-abc2-eec77cb2a740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:03:58.461227 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6639438-fa60-4327-abc2-eec77cb2a740 admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:58.461456 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6639438-fa60-4327-abc2-eec77cb2a740 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:58.461744 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6639438-fa60-4327-abc2-eec77cb2a740 admin admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:58.462489 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6639438-fa60-4327-abc2-eec77cb2a740 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:03:58.464402 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6639438-fa60-4327-abc2-eec77cb2a740 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:03:58.477583 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1171/2328] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 18:03:58 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 14 18:03:58.483419 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505610a8-93f9-4d6c-9a7b-9439d9d2ce4c admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:03:58.495901 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505610a8-93f9-4d6c-9a7b-9439d9d2ce4c admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:03:58.503552 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65ce4c2-e53f-49b2-b4e4-7d5d031dd60c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:03:58.505296 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65ce4c2-e53f-49b2-b4e4-7d5d031dd60c admin admin] REQUEST_METHOD: `PUT` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:58.505952 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65ce4c2-e53f-49b2-b4e4-7d5d031dd60c admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:58.506416 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65ce4c2-e53f-49b2-b4e4-7d5d031dd60c admin admin] PATH_INFO: `/v3/projects/87147f8df25c43b5a5a7ca1cca722071/users/9a5777f1ad7b4befb21a6a107028bbc4/roles/1348580877d04014bfdec4d866b98a74` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:58.525862 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65ce4c2-e53f-49b2-b4e4-7d5d031dd60c admin admin] RBAC: Authorizing `identity:create_grant(project_id=87147f8df25c43b5a5a7ca1cca722071, user_id=9a5777f1ad7b4befb21a6a107028bbc4, role_id=1348580877d04014bfdec4d866b98a74)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:03:58.529045 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65ce4c2-e53f-49b2-b4e4-7d5d031dd60c admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:03:58.632892 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1158/2329] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 18:03:58 2022] PUT /identity/v3/projects/87147f8df25c43b5a5a7ca1cca722071/users/9a5777f1ad7b4befb21a6a107028bbc4/roles/1348580877d04014bfdec4d866b98a74 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:03:58.637705 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6639438-fa60-4327-abc2-eec77cb2a740 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:03:58.655517 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6639438-fa60-4327-abc2-eec77cb2a740 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:03:58.751820 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818fcba1-84bc-4018-95f0-1b4b15333f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:03:58.752822 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818fcba1-84bc-4018-95f0-1b4b15333f61 admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:58.753103 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818fcba1-84bc-4018-95f0-1b4b15333f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:58.753573 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818fcba1-84bc-4018-95f0-1b4b15333f61 admin admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:58.754342 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818fcba1-84bc-4018-95f0-1b4b15333f61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:03:58.756231 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818fcba1-84bc-4018-95f0-1b4b15333f61 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:03:58.768402 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1172/2330] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 18:03:58 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:03:58.774815 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65ce4c2-e53f-49b2-b4e4-7d5d031dd60c admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:03:58.788060 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65ce4c2-e53f-49b2-b4e4-7d5d031dd60c admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:03:58.792994 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ac62d5-a642-4b4e-8fa8-7f57856f8908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:03:58.793913 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ac62d5-a642-4b4e-8fa8-7f57856f8908 admin admin] REQUEST_METHOD: `PUT` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:58.794198 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ac62d5-a642-4b4e-8fa8-7f57856f8908 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:58.794482 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ac62d5-a642-4b4e-8fa8-7f57856f8908 admin admin] PATH_INFO: `/v3/projects/87147f8df25c43b5a5a7ca1cca722071/users/9a5777f1ad7b4befb21a6a107028bbc4/roles/1348580877d04014bfdec4d866b98a74` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:58.796599 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ac62d5-a642-4b4e-8fa8-7f57856f8908 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87147f8df25c43b5a5a7ca1cca722071, user_id=9a5777f1ad7b4befb21a6a107028bbc4, role_id=1348580877d04014bfdec4d866b98a74)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:03:58.800570 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ac62d5-a642-4b4e-8fa8-7f57856f8908 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:03:58.812832 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1159/2331] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 18:03:58 2022] PUT /identity/v3/projects/87147f8df25c43b5a5a7ca1cca722071/users/9a5777f1ad7b4befb21a6a107028bbc4/roles/1348580877d04014bfdec4d866b98a74 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:03:59.807723 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818fcba1-84bc-4018-95f0-1b4b15333f61 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:03:59.997515 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818fcba1-84bc-4018-95f0-1b4b15333f61 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:04:00.057932 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:04:00.167953 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eeef4e-efe9-45c8-a8d4-fb61a07139a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4696d396adb495ab300a9a5a5727595', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:04:00.169722 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eeef4e-efe9-45c8-a8d4-fb61a07139a0 service nova] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:04:00.170720 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eeef4e-efe9-45c8-a8d4-fb61a07139a0 service nova] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:04:00.171595 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eeef4e-efe9-45c8-a8d4-fb61a07139a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:04:00.176997 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-d5eeef4e-efe9-45c8-a8d4-fb61a07139a0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:04:00.495857 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5eeef4e-efe9-45c8-a8d4-fb61a07139a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:04:00.499328 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5eeef4e-efe9-45c8-a8d4-fb61a07139a0 service nova] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:04:00.541523 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1173/2332] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 18:03:59 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 734 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:04:07.696891 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d02ad8-f9cc-4e9a-bd8a-c80b2b2af8c7 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:04:07.697520 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d02ad8-f9cc-4e9a-bd8a-c80b2b2af8c7 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:04:07.697520 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d02ad8-f9cc-4e9a-bd8a-c80b2b2af8c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:04:07.730631 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-26d02ad8-f9cc-4e9a-bd8a-c80b2b2af8c7 None None] MFA Rules not processed for user `9a5777f1ad7b4befb21a6a107028bbc4`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:04:07.732023 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-26d02ad8-f9cc-4e9a-bd8a-c80b2b2af8c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:04:07.823545 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1160/2333] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:04:07 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 18:04:07.837509 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eeef4e-efe9-45c8-a8d4-fb61a07139a0 service nova] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:04:07.849996 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eeef4e-efe9-45c8-a8d4-fb61a07139a0 service nova] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:04:07.856513 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa61e51-99a7-4ef5-9def-a7221956c9f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4696d396adb495ab300a9a5a5727595', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:04:07.857258 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa61e51-99a7-4ef5-9def-a7221956c9f7 service nova] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:04:07.857569 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa61e51-99a7-4ef5-9def-a7221956c9f7 service nova] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:04:07.857856 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa61e51-99a7-4ef5-9def-a7221956c9f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:04:07.931922 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa61e51-99a7-4ef5-9def-a7221956c9f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:04:07.933552 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa61e51-99a7-4ef5-9def-a7221956c9f7 service nova] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:04:07.945102 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1174/2334] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 18:04:07 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:04:17.819106 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=72,keystone:INSERT=5 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:04:17.940381 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=72 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:04:19.643665 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cdebba-556f-4819-940b-442ee8195a7b None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:04:19.644568 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cdebba-556f-4819-940b-442ee8195a7b None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:04:19.644568 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cdebba-556f-4819-940b-442ee8195a7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:04:19.671641 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-f6cdebba-556f-4819-940b-442ee8195a7b None None] MFA Rules not processed for user `f1e32638fe5c4d2d8d3e2e4ea8250aaa`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:04:19.672864 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-f6cdebba-556f-4819-940b-442ee8195a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:04:19.750684 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1161/2335] 10.222.0.36 () {58 vars in 1009 bytes} [Tue Jun 14 18:04:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:04:19.923993 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa61e51-99a7-4ef5-9def-a7221956c9f7 service nova] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:04:19.924575 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-9fa61e51-99a7-4ef5-9def-a7221956c9f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:04:20.023419 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa61e51-99a7-4ef5-9def-a7221956c9f7 service nova] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:04:20.028953 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbf85a0-ea9c-4d49-b0d0-2c8e44a39f36 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba38b47a31b14526be0aa2054841881b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:04:20.029696 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbf85a0-ea9c-4d49-b0d0-2c8e44a39f36 service swift] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:04:20.030055 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbf85a0-ea9c-4d49-b0d0-2c8e44a39f36 service swift] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:04:20.030461 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbf85a0-ea9c-4d49-b0d0-2c8e44a39f36 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:04:20.042608 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbf85a0-ea9c-4d49-b0d0-2c8e44a39f36 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:04:20.045423 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbf85a0-ea9c-4d49-b0d0-2c8e44a39f36 service swift] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:04:20.056552 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1175/2336] 10.222.0.36 () {60 vars in 1384 bytes} [Tue Jun 14 18:04:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 14 18:04:29.734312 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=25 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:04:30.052560 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=32 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:04:30.252822 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a7bbf7-88b7-454c-a8e5-a4fb4cb14904 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:04:30.253223 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a7bbf7-88b7-454c-a8e5-a4fb4cb14904 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:04:30.253571 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a7bbf7-88b7-454c-a8e5-a4fb4cb14904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:04:30.276509 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-a8a7bbf7-88b7-454c-a8e5-a4fb4cb14904 None None] MFA Rules not processed for user `da59091825d44440887d6ef9c542b1ce`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:04:30.278017 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-a8a7bbf7-88b7-454c-a8e5-a4fb4cb14904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:04:30.292389 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1162/2337] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:04:30 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:04:30.633631 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbf85a0-ea9c-4d49-b0d0-2c8e44a39f36 service swift] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:04:30.711081 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbf85a0-ea9c-4d49-b0d0-2c8e44a39f36 service swift] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:04:30.715418 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e351be2-ab75-4bd8-9462-0fa376b806f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5652329c71cd431fb579d69cef933b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:04:30.716325 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e351be2-ab75-4bd8-9462-0fa376b806f5 service neutron] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:04:30.716628 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e351be2-ab75-4bd8-9462-0fa376b806f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:04:30.716916 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e351be2-ab75-4bd8-9462-0fa376b806f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:04:30.719023 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-6e351be2-ab75-4bd8-9462-0fa376b806f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:04:30.733003 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e351be2-ab75-4bd8-9462-0fa376b806f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:04:30.734837 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e351be2-ab75-4bd8-9462-0fa376b806f5 service neutron] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:04:30.753036 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1176/2338] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 18:04:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:04:33.907343 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a7bbf7-88b7-454c-a8e5-a4fb4cb14904 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:04:33.933575 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a7bbf7-88b7-454c-a8e5-a4fb4cb14904 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:04:33.943562 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4273255e-5cd7-4432-bef8-2b0c767b19bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4696d396adb495ab300a9a5a5727595', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:04:33.943562 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4273255e-5cd7-4432-bef8-2b0c767b19bd service nova] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:04:33.943562 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4273255e-5cd7-4432-bef8-2b0c767b19bd service nova] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:04:33.943562 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4273255e-5cd7-4432-bef8-2b0c767b19bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:04:33.943973 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-4273255e-5cd7-4432-bef8-2b0c767b19bd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:04:34.009585 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4273255e-5cd7-4432-bef8-2b0c767b19bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:04:34.011200 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4273255e-5cd7-4432-bef8-2b0c767b19bd service nova] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:04:34.022544 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1163/2339] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 18:04:33 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:04:38.349284 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e351be2-ab75-4bd8-9462-0fa376b806f5 service neutron] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:04:38.351337 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-6e351be2-ab75-4bd8-9462-0fa376b806f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:04:38.376212 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e351be2-ab75-4bd8-9462-0fa376b806f5 service neutron] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:04:38.380680 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4177d72f-6c71-488d-a274-cce3a3fcc597 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4696d396adb495ab300a9a5a5727595', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:04:38.381374 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4177d72f-6c71-488d-a274-cce3a3fcc597 service nova] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:04:38.381666 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4177d72f-6c71-488d-a274-cce3a3fcc597 service nova] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:04:38.381954 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4177d72f-6c71-488d-a274-cce3a3fcc597 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:04:38.383864 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-4177d72f-6c71-488d-a274-cce3a3fcc597 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:04:38.401737 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4177d72f-6c71-488d-a274-cce3a3fcc597 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:04:38.401737 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4177d72f-6c71-488d-a274-cce3a3fcc597 service nova] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:04:38.414326 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1177/2340] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 18:04:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:04:38.620208 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2575186f-ca6d-410f-a99e-20c547d01ffb None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:04:38.623233 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2575186f-ca6d-410f-a99e-20c547d01ffb None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:04:38.623233 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2575186f-ca6d-410f-a99e-20c547d01ffb None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:04:38.623233 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1164/2341] 10.222.0.36 () {54 vars in 921 bytes} [Tue Jun 14 18:04:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 18:04:38.629423 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e839289e-66a3-495e-9ce0-8bf5fae355db None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:04:38.630270 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e839289e-66a3-495e-9ce0-8bf5fae355db None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:04:38.630766 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e839289e-66a3-495e-9ce0-8bf5fae355db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:04:38.653468 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-e839289e-66a3-495e-9ce0-8bf5fae355db None None] MFA Rules not processed for user `e4696d396adb495ab300a9a5a5727595`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:04:38.655656 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-e839289e-66a3-495e-9ce0-8bf5fae355db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:04:38.668045 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1178/2342] 10.222.0.36 () {58 vars in 1018 bytes} [Tue Jun 14 18:04:38 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:04:38.695832 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2575186f-ca6d-410f-a99e-20c547d01ffb None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:04:38.697614 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-2575186f-ca6d-410f-a99e-20c547d01ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:04:38.762137 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2575186f-ca6d-410f-a99e-20c547d01ffb None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:04:38.765896 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cf7822-9a9d-43de-8209-778ec8effc4d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359f5ed4eb684e769f552484ca9a34c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:04:38.766598 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cf7822-9a9d-43de-8209-778ec8effc4d service glance] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:04:38.766914 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cf7822-9a9d-43de-8209-778ec8effc4d service glance] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:04:38.767846 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cf7822-9a9d-43de-8209-778ec8effc4d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:04:38.779816 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cf7822-9a9d-43de-8209-778ec8effc4d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:04:38.781365 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cf7822-9a9d-43de-8209-778ec8effc4d service glance] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:04:38.793487 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1165/2343] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 18:04:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:04:39.011020 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b30c326-6348-4888-ac2f-7c64ae5281b0 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:04:39.011368 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b30c326-6348-4888-ac2f-7c64ae5281b0 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:04:39.011720 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b30c326-6348-4888-ac2f-7c64ae5281b0 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:04:39.013184 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1179/2344] 10.222.0.36 () {54 vars in 921 bytes} [Tue Jun 14 18:04:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 18:04:39.024989 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415bee53-96d1-4085-a569-cc1f2c28eacc None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:04:39.025546 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415bee53-96d1-4085-a569-cc1f2c28eacc None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:04:39.025832 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415bee53-96d1-4085-a569-cc1f2c28eacc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:04:39.044342 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-415bee53-96d1-4085-a569-cc1f2c28eacc None None] MFA Rules not processed for user `5652329c71cd431fb579d69cef933b37`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:04:39.045558 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-415bee53-96d1-4085-a569-cc1f2c28eacc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:04:39.052710 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1166/2345] 10.222.0.36 () {58 vars in 1018 bytes} [Tue Jun 14 18:04:39 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 18:04:39.066199 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b30c326-6348-4888-ac2f-7c64ae5281b0 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:04:39.077807 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b30c326-6348-4888-ac2f-7c64ae5281b0 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:04:39.081547 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133b12d8-6664-4691-97af-96804e291f4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5652329c71cd431fb579d69cef933b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:04:39.082222 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133b12d8-6664-4691-97af-96804e291f4f service neutron] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:04:39.082507 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133b12d8-6664-4691-97af-96804e291f4f service neutron] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:04:39.082790 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133b12d8-6664-4691-97af-96804e291f4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:04:39.090236 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133b12d8-6664-4691-97af-96804e291f4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:04:39.091690 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133b12d8-6664-4691-97af-96804e291f4f service neutron] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:04:39.099737 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1180/2346] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 18:04:39 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:04:39.189616 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0faab7-4aad-4993-a9bd-c8f6243739d4 None None] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:04:39.190868 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0faab7-4aad-4993-a9bd-c8f6243739d4 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:04:39.191229 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0faab7-4aad-4993-a9bd-c8f6243739d4 None None] PATH_INFO: `/` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:04:39.193010 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1167/2347] 10.222.0.36 () {54 vars in 921 bytes} [Tue Jun 14 18:04:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 18:04:39.199257 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8653691-8b0b-45d7-8bd5-ab06245f5324 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:04:39.199889 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8653691-8b0b-45d7-8bd5-ab06245f5324 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:04:39.200433 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8653691-8b0b-45d7-8bd5-ab06245f5324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:04:39.221296 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-e8653691-8b0b-45d7-8bd5-ab06245f5324 None None] MFA Rules not processed for user `e4696d396adb495ab300a9a5a5727595`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:04:39.222583 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-e8653691-8b0b-45d7-8bd5-ab06245f5324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:04:39.234658 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1181/2348] 10.222.0.36 () {58 vars in 1018 bytes} [Tue Jun 14 18:04:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:04:39.246916 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0faab7-4aad-4993-a9bd-c8f6243739d4 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:04:39.259044 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0faab7-4aad-4993-a9bd-c8f6243739d4 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:04:39.262954 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7f1c82-616b-4c1c-b2b7-06d8ebc8fd5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5652329c71cd431fb579d69cef933b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:04:39.263583 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f1c82-616b-4c1c-b2b7-06d8ebc8fd5d service neutron] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:04:39.263871 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f1c82-616b-4c1c-b2b7-06d8ebc8fd5d service neutron] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:04:39.264152 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f1c82-616b-4c1c-b2b7-06d8ebc8fd5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:04:39.275735 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7f1c82-616b-4c1c-b2b7-06d8ebc8fd5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:04:39.277220 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7f1c82-616b-4c1c-b2b7-06d8ebc8fd5d service neutron] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:04:39.288988 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1168/2349] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 18:04:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:04:44.148803 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e76998c-d2b7-487d-b629-2827c7e58f43 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:04:44.149303 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e76998c-d2b7-487d-b629-2827c7e58f43 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:04:44.149414 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e76998c-d2b7-487d-b629-2827c7e58f43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:04:44.168871 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-0e76998c-d2b7-487d-b629-2827c7e58f43 None None] MFA Rules not processed for user `f1e32638fe5c4d2d8d3e2e4ea8250aaa`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:04:44.170217 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-0e76998c-d2b7-487d-b629-2827c7e58f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:04:44.178808 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1182/2350] 10.222.0.36 () {58 vars in 1009 bytes} [Tue Jun 14 18:04:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:04:44.191613 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7f1c82-616b-4c1c-b2b7-06d8ebc8fd5d service neutron] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:04:44.209891 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7f1c82-616b-4c1c-b2b7-06d8ebc8fd5d service neutron] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:04:44.216256 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5437533-d2bb-488e-81e8-061e0586405b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba38b47a31b14526be0aa2054841881b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:04:44.220182 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5437533-d2bb-488e-81e8-061e0586405b service swift] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:04:44.220182 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5437533-d2bb-488e-81e8-061e0586405b service swift] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:04:44.220182 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5437533-d2bb-488e-81e8-061e0586405b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:04:44.226621 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5437533-d2bb-488e-81e8-061e0586405b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:04:44.228262 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5437533-d2bb-488e-81e8-061e0586405b service swift] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:04:44.248835 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1169/2351] 10.222.0.36 () {60 vars in 1384 bytes} [Tue Jun 14 18:04:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 14 18:04:54.162706 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=47 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:04:54.234009 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=72 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:05:00.007774 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e76998c-d2b7-487d-b629-2827c7e58f43 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:00.024874 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e76998c-d2b7-487d-b629-2827c7e58f43 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:00.029112 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d769abb-114a-455e-a0ec-9998e1ccc9ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5652329c71cd431fb579d69cef933b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:00.029859 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d769abb-114a-455e-a0ec-9998e1ccc9ab service neutron] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:00.030337 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d769abb-114a-455e-a0ec-9998e1ccc9ab service neutron] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:00.030617 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d769abb-114a-455e-a0ec-9998e1ccc9ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:00.042989 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d769abb-114a-455e-a0ec-9998e1ccc9ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:00.047150 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d769abb-114a-455e-a0ec-9998e1ccc9ab service neutron] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:00.058767 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1183/2352] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 18:05:00 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:05:00.615106 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81197f19-06d9-46d5-83dc-bb6a7fcc9b0e None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:00.615707 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81197f19-06d9-46d5-83dc-bb6a7fcc9b0e None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:00.615707 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81197f19-06d9-46d5-83dc-bb6a7fcc9b0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:00.640757 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-81197f19-06d9-46d5-83dc-bb6a7fcc9b0e None None] MFA Rules not processed for user `f1e32638fe5c4d2d8d3e2e4ea8250aaa`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:05:00.643133 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-81197f19-06d9-46d5-83dc-bb6a7fcc9b0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:05:00.656256 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1170/2353] 10.222.0.36 () {58 vars in 967 bytes} [Tue Jun 14 18:05:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 18:05:00.674754 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d769abb-114a-455e-a0ec-9998e1ccc9ab service neutron] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:00.691029 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d769abb-114a-455e-a0ec-9998e1ccc9ab service neutron] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:00.699717 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a3e07e-4778-4f52-994a-16f24a3d9874 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba38b47a31b14526be0aa2054841881b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:00.700907 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a3e07e-4778-4f52-994a-16f24a3d9874 service swift] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:00.701436 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a3e07e-4778-4f52-994a-16f24a3d9874 service swift] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:00.701964 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a3e07e-4778-4f52-994a-16f24a3d9874 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:00.723627 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a3e07e-4778-4f52-994a-16f24a3d9874 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:00.726722 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a3e07e-4778-4f52-994a-16f24a3d9874 service swift] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:00.753582 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1184/2354] 10.222.0.36 () {60 vars in 1384 bytes} [Tue Jun 14 18:05:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 14 18:05:03.010399 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81197f19-06d9-46d5-83dc-bb6a7fcc9b0e None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:03.020830 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81197f19-06d9-46d5-83dc-bb6a7fcc9b0e None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:03.024919 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1f4353-cd5e-4a43-b941-6eb75cd8ecd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5652329c71cd431fb579d69cef933b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:03.025482 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1f4353-cd5e-4a43-b941-6eb75cd8ecd5 service neutron] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:03.026024 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1f4353-cd5e-4a43-b941-6eb75cd8ecd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:03.026303 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1f4353-cd5e-4a43-b941-6eb75cd8ecd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:03.030687 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-cd1f4353-cd5e-4a43-b941-6eb75cd8ecd5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:05:03.115172 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1f4353-cd5e-4a43-b941-6eb75cd8ecd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:03.117981 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1f4353-cd5e-4a43-b941-6eb75cd8ecd5 service neutron] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:03.133149 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1171/2355] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 18:05:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:05:07.452390 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a3e07e-4778-4f52-994a-16f24a3d9874 service swift] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:07.455773 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-86a3e07e-4778-4f52-994a-16f24a3d9874 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:05:07.481448 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a3e07e-4778-4f52-994a-16f24a3d9874 service swift] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:07.485257 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f6ae61-15dd-4700-afaa-d702b3ca2e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:07.485257 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f6ae61-15dd-4700-afaa-d702b3ca2e56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:07.485774 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f6ae61-15dd-4700-afaa-d702b3ca2e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:07.486057 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f6ae61-15dd-4700-afaa-d702b3ca2e56 admin admin] PATH_INFO: `/v3/users/7f214333671e4878bf613c26ceb1381a` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:07.487412 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f6ae61-15dd-4700-afaa-d702b3ca2e56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f214333671e4878bf613c26ceb1381a)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:07.489693 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f6ae61-15dd-4700-afaa-d702b3ca2e56 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:07.736241 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-22f6ae61-15dd-4700-afaa-d702b3ca2e56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f214333671e4878bf613c26ceb1381a'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:05:07.737074 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-22f6ae61-15dd-4700-afaa-d702b3ca2e56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f214333671e4878bf613c26ceb1381a'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:05:07.737745 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-22f6ae61-15dd-4700-afaa-d702b3ca2e56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f214333671e4878bf613c26ceb1381a'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:05:07.814014 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-22f6ae61-15dd-4700-afaa-d702b3ca2e56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f214333671e4878bf613c26ceb1381a'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:05:07.824703 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-22f6ae61-15dd-4700-afaa-d702b3ca2e56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f214333671e4878bf613c26ceb1381a'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:05:07.843687 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1185/2356] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 14 18:05:07 2022] DELETE /identity/v3/users/7f214333671e4878bf613c26ceb1381a => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:05:08.132918 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1f4353-cd5e-4a43-b941-6eb75cd8ecd5 service neutron] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:08.151851 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1f4353-cd5e-4a43-b941-6eb75cd8ecd5 service neutron] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:08.212039 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f584c66-accc-46ff-8eac-ac337938a3bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:08.212940 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f584c66-accc-46ff-8eac-ac337938a3bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:08.213224 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f584c66-accc-46ff-8eac-ac337938a3bf admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:08.213515 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f584c66-accc-46ff-8eac-ac337938a3bf admin admin] PATH_INFO: `/v3/projects/6c8e2494e0744c778b32f979005ec7ab` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:08.214789 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f584c66-accc-46ff-8eac-ac337938a3bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c8e2494e0744c778b32f979005ec7ab)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:08.216801 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f584c66-accc-46ff-8eac-ac337938a3bf admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:08.357700 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-3f584c66-accc-46ff-8eac-ac337938a3bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c8e2494e0744c778b32f979005ec7ab', 'request_id': 'req-3f584c66-accc-46ff-8eac-ac337938a3bf'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:05:08.440010 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-3f584c66-accc-46ff-8eac-ac337938a3bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c8e2494e0744c778b32f979005ec7ab', 'request_id': 'req-3f584c66-accc-46ff-8eac-ac337938a3bf'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:05:08.446823 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-3f584c66-accc-46ff-8eac-ac337938a3bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c8e2494e0744c778b32f979005ec7ab', 'request_id': 'req-3f584c66-accc-46ff-8eac-ac337938a3bf'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:05:08.460352 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-3f584c66-accc-46ff-8eac-ac337938a3bf admin admin] The token cache is being invalidate because project 6c8e2494e0744c778b32f979005ec7ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:05:08.460651 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-3f584c66-accc-46ff-8eac-ac337938a3bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:05:08.461373 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-3f584c66-accc-46ff-8eac-ac337938a3bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:05:08.462944 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1172/2357] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 14 18:05:08 2022] DELETE /identity/v3/projects/6c8e2494e0744c778b32f979005ec7ab => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:05:08.468200 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38012d4-9ae1-4471-a42f-f664eac31118 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:08.468759 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38012d4-9ae1-4471-a42f-f664eac31118 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:08.468759 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38012d4-9ae1-4471-a42f-f664eac31118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:08.490473 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-c38012d4-9ae1-4471-a42f-f664eac31118 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:05:08.492101 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-c38012d4-9ae1-4471-a42f-f664eac31118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:05:08.560667 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1186/2358] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:05:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:05:08.570254 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b932a64-461a-4f19-bd48-4fb9a7a253e9 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:08.575569 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b932a64-461a-4f19-bd48-4fb9a7a253e9 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:08.575569 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b932a64-461a-4f19-bd48-4fb9a7a253e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:08.591080 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-3b932a64-461a-4f19-bd48-4fb9a7a253e9 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:05:08.592364 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-3b932a64-461a-4f19-bd48-4fb9a7a253e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:05:08.601724 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1173/2359] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:05:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:05:08.606096 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38012d4-9ae1-4471-a42f-f664eac31118 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:08.616622 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38012d4-9ae1-4471-a42f-f664eac31118 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:08.621630 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc367020-e49f-4404-8f30-5262ce1d854c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:08.622289 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc367020-e49f-4404-8f30-5262ce1d854c admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:08.622573 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc367020-e49f-4404-8f30-5262ce1d854c admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:08.622853 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc367020-e49f-4404-8f30-5262ce1d854c admin admin] PATH_INFO: `/v3/domains` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:08.623736 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc367020-e49f-4404-8f30-5262ce1d854c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 18:05:08.624050 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc367020-e49f-4404-8f30-5262ce1d854c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:08.625656 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc367020-e49f-4404-8f30-5262ce1d854c admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:08.637866 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1187/2360] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 14 18:05:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 18:05:08.643664 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b932a64-461a-4f19-bd48-4fb9a7a253e9 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:08.654209 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b932a64-461a-4f19-bd48-4fb9a7a253e9 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:08.661621 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbe5ff6-4995-4d28-892c-c2535e99fa5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:08.662772 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbe5ff6-4995-4d28-892c-c2535e99fa5b admin admin] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:08.663270 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbe5ff6-4995-4d28-892c-c2535e99fa5b admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:08.663807 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbe5ff6-4995-4d28-892c-c2535e99fa5b admin admin] PATH_INFO: `/v3/projects` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:08.665117 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbe5ff6-4995-4d28-892c-c2535e99fa5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:08.668975 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbe5ff6-4995-4d28-892c-c2535e99fa5b admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:08.681120 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:05:08.787288 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1174/2361] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 14 18:05:08 2022] POST /identity/v3/projects => generated 365 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:05:08.791683 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc367020-e49f-4404-8f30-5262ce1d854c admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:08.802513 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc367020-e49f-4404-8f30-5262ce1d854c admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:08.846614 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:05:08.885918 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8680c88-89bc-43ab-b639-b51e64e26a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:08.886687 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8680c88-89bc-43ab-b639-b51e64e26a3b admin admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:08.886994 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8680c88-89bc-43ab-b639-b51e64e26a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:08.887506 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8680c88-89bc-43ab-b639-b51e64e26a3b admin admin] PATH_INFO: `/v3/users` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:08.888257 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8680c88-89bc-43ab-b639-b51e64e26a3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:08.890404 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8680c88-89bc-43ab-b639-b51e64e26a3b admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:09.024553 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1188/2362] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 14 18:05:08 2022] POST /identity/v3/users => generated 283 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:05:09.029026 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbe5ff6-4995-4d28-892c-c2535e99fa5b admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:09.040762 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbe5ff6-4995-4d28-892c-c2535e99fa5b admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:09.045663 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231ae194-2678-4a1d-9887-5e114b7281df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:09.046349 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231ae194-2678-4a1d-9887-5e114b7281df admin admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:09.046638 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231ae194-2678-4a1d-9887-5e114b7281df admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:09.046922 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231ae194-2678-4a1d-9887-5e114b7281df admin admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:09.048259 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231ae194-2678-4a1d-9887-5e114b7281df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:09.049880 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231ae194-2678-4a1d-9887-5e114b7281df admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:09.061064 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1175/2363] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 18:05:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:05:09.065982 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8680c88-89bc-43ab-b639-b51e64e26a3b admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:09.076379 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8680c88-89bc-43ab-b639-b51e64e26a3b admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:09.083044 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99f24fa-ce6e-4605-a41b-32cb586b6275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:09.083777 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f24fa-ce6e-4605-a41b-32cb586b6275 admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:09.084076 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f24fa-ce6e-4605-a41b-32cb586b6275 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:09.084361 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f24fa-ce6e-4605-a41b-32cb586b6275 admin admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:09.085140 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99f24fa-ce6e-4605-a41b-32cb586b6275 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:09.086834 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99f24fa-ce6e-4605-a41b-32cb586b6275 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:09.099262 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1189/2364] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 18:05:09 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:05:09.103614 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231ae194-2678-4a1d-9887-5e114b7281df admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:09.114890 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231ae194-2678-4a1d-9887-5e114b7281df admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:09.120352 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6cada1-3552-41df-a176-ee2a1014405d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:09.121265 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6cada1-3552-41df-a176-ee2a1014405d admin admin] REQUEST_METHOD: `PUT` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:09.121579 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6cada1-3552-41df-a176-ee2a1014405d admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:09.121865 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6cada1-3552-41df-a176-ee2a1014405d admin admin] PATH_INFO: `/v3/projects/ae2bac68607043e6981aa9d2f2cc3110/users/413c7faf6ea1427f9248f5ef1601bb1d/roles/9ee80134743f4c2b88525b04df2facba` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:09.138876 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6cada1-3552-41df-a176-ee2a1014405d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae2bac68607043e6981aa9d2f2cc3110, user_id=413c7faf6ea1427f9248f5ef1601bb1d, role_id=9ee80134743f4c2b88525b04df2facba)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:09.141667 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6cada1-3552-41df-a176-ee2a1014405d admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:09.280944 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1176/2365] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 18:05:09 2022] PUT /identity/v3/projects/ae2bac68607043e6981aa9d2f2cc3110/users/413c7faf6ea1427f9248f5ef1601bb1d/roles/9ee80134743f4c2b88525b04df2facba => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:05:09.291773 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a7c61-913c-4dd5-ae8b-dba445107cfb None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:09.291975 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a7c61-913c-4dd5-ae8b-dba445107cfb None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:09.292255 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a7c61-913c-4dd5-ae8b-dba445107cfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:09.323282 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-ce9a7c61-913c-4dd5-ae8b-dba445107cfb None None] MFA Rules not processed for user `413c7faf6ea1427f9248f5ef1601bb1d`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:05:09.324546 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-ce9a7c61-913c-4dd5-ae8b-dba445107cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:05:09.394375 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1190/2366] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:05:09 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 18:05:09.399022 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6cada1-3552-41df-a176-ee2a1014405d admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:09.467497 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6cada1-3552-41df-a176-ee2a1014405d admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:09.475630 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd385b3-d496-4cf5-b397-44ca0741301c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:09.476439 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd385b3-d496-4cf5-b397-44ca0741301c admin admin] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:09.476739 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd385b3-d496-4cf5-b397-44ca0741301c admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:09.477020 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd385b3-d496-4cf5-b397-44ca0741301c admin admin] PATH_INFO: `/v3/projects` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:09.477746 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd385b3-d496-4cf5-b397-44ca0741301c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:09.479751 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd385b3-d496-4cf5-b397-44ca0741301c admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:09.656590 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1177/2367] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 14 18:05:09 2022] POST /identity/v3/projects => generated 365 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:05:09.666004 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9a7c61-913c-4dd5-ae8b-dba445107cfb None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:09.677743 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9a7c61-913c-4dd5-ae8b-dba445107cfb None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:09.741620 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd48f9d0-8edf-452d-9045-fa953e5bca3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:09.742314 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd48f9d0-8edf-452d-9045-fa953e5bca3d admin admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:09.742601 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd48f9d0-8edf-452d-9045-fa953e5bca3d admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:09.742887 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd48f9d0-8edf-452d-9045-fa953e5bca3d admin admin] PATH_INFO: `/v3/users` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:09.743627 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd48f9d0-8edf-452d-9045-fa953e5bca3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:09.745621 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd48f9d0-8edf-452d-9045-fa953e5bca3d admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:09.846853 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1191/2368] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 14 18:05:09 2022] POST /identity/v3/users => generated 289 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:05:09.850931 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd385b3-d496-4cf5-b397-44ca0741301c admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:09.861966 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd385b3-d496-4cf5-b397-44ca0741301c admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:09.866960 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2219b900-ae62-4928-bdd9-44859592ccfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:09.867627 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2219b900-ae62-4928-bdd9-44859592ccfe admin admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:09.867918 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2219b900-ae62-4928-bdd9-44859592ccfe admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:09.868239 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2219b900-ae62-4928-bdd9-44859592ccfe admin admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:09.868975 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2219b900-ae62-4928-bdd9-44859592ccfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:09.870607 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2219b900-ae62-4928-bdd9-44859592ccfe admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:09.882324 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1178/2369] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 18:05:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:05:09.886619 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd48f9d0-8edf-452d-9045-fa953e5bca3d admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:09.899016 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd48f9d0-8edf-452d-9045-fa953e5bca3d admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:09.916699 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e7214f-4ddd-46de-8ac8-914fd7cd1d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:09.917623 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e7214f-4ddd-46de-8ac8-914fd7cd1d1e admin admin] REQUEST_METHOD: `PUT` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:09.917938 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e7214f-4ddd-46de-8ac8-914fd7cd1d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:09.918351 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e7214f-4ddd-46de-8ac8-914fd7cd1d1e admin admin] PATH_INFO: `/v3/projects/9c7da32d47c84a888f9fe0ea5808a406/users/280eb53a89d64ec0ae24a5f8d4a587b9/roles/1348580877d04014bfdec4d866b98a74` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:09.935680 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e7214f-4ddd-46de-8ac8-914fd7cd1d1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c7da32d47c84a888f9fe0ea5808a406, user_id=280eb53a89d64ec0ae24a5f8d4a587b9, role_id=1348580877d04014bfdec4d866b98a74)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:09.942603 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e7214f-4ddd-46de-8ac8-914fd7cd1d1e admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:10.078036 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1192/2370] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 18:05:09 2022] PUT /identity/v3/projects/9c7da32d47c84a888f9fe0ea5808a406/users/280eb53a89d64ec0ae24a5f8d4a587b9/roles/1348580877d04014bfdec4d866b98a74 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:05:10.084627 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2219b900-ae62-4928-bdd9-44859592ccfe admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:10.104758 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2219b900-ae62-4928-bdd9-44859592ccfe admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:10.185971 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c61562-8fac-4726-95e8-2af1263f47a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:10.187011 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c61562-8fac-4726-95e8-2af1263f47a6 admin admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:10.187352 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c61562-8fac-4726-95e8-2af1263f47a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:10.187693 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c61562-8fac-4726-95e8-2af1263f47a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:10.189256 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c61562-8fac-4726-95e8-2af1263f47a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:10.191809 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c61562-8fac-4726-95e8-2af1263f47a6 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:10.203638 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1179/2371] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 18:05:10 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:05:10.209132 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e7214f-4ddd-46de-8ac8-914fd7cd1d1e admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:10.220680 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e7214f-4ddd-46de-8ac8-914fd7cd1d1e admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:10.226416 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884ec1e3-04d0-4506-80a3-7576676b7a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:10.227508 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884ec1e3-04d0-4506-80a3-7576676b7a82 admin admin] REQUEST_METHOD: `PUT` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:10.227806 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884ec1e3-04d0-4506-80a3-7576676b7a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:10.228093 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884ec1e3-04d0-4506-80a3-7576676b7a82 admin admin] PATH_INFO: `/v3/projects/9c7da32d47c84a888f9fe0ea5808a406/users/280eb53a89d64ec0ae24a5f8d4a587b9/roles/1348580877d04014bfdec4d866b98a74` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:10.230444 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884ec1e3-04d0-4506-80a3-7576676b7a82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c7da32d47c84a888f9fe0ea5808a406, user_id=280eb53a89d64ec0ae24a5f8d4a587b9, role_id=1348580877d04014bfdec4d866b98a74)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:10.233358 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884ec1e3-04d0-4506-80a3-7576676b7a82 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:10.236578 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:05:10.246495 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1193/2372] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 18:05:10 2022] PUT /identity/v3/projects/9c7da32d47c84a888f9fe0ea5808a406/users/280eb53a89d64ec0ae24a5f8d4a587b9/roles/1348580877d04014bfdec4d866b98a74 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:05:10.258436 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d423cef5-4819-4f39-87c7-066636cae8fe None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:10.258732 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d423cef5-4819-4f39-87c7-066636cae8fe None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:10.259019 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d423cef5-4819-4f39-87c7-066636cae8fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:10.290920 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-d423cef5-4819-4f39-87c7-066636cae8fe None None] MFA Rules not processed for user `280eb53a89d64ec0ae24a5f8d4a587b9`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:05:10.292252 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-d423cef5-4819-4f39-87c7-066636cae8fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:05:10.297071 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:05:10.373116 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1180/2373] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:05:10 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:05:10.387330 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884ec1e3-04d0-4506-80a3-7576676b7a82 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:10.389382 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-884ec1e3-04d0-4506-80a3-7576676b7a82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:05:10.455601 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884ec1e3-04d0-4506-80a3-7576676b7a82 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:10.459739 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d071c6c0-2ae5-4bea-b582-3973ade0c11b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17945e7d72954b8787e0ba09a9903247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:10.460506 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d071c6c0-2ae5-4bea-b582-3973ade0c11b service cinder] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:10.460796 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d071c6c0-2ae5-4bea-b582-3973ade0c11b service cinder] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:10.461082 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d071c6c0-2ae5-4bea-b582-3973ade0c11b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:10.472160 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d071c6c0-2ae5-4bea-b582-3973ade0c11b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:10.473613 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d071c6c0-2ae5-4bea-b582-3973ade0c11b service cinder] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:10.484881 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1194/2374] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 18:05:10 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:05:10.764199 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d423cef5-4819-4f39-87c7-066636cae8fe None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:10.766052 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-d423cef5-4819-4f39-87c7-066636cae8fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:05:10.780583 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d423cef5-4819-4f39-87c7-066636cae8fe None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:10.784870 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c54d58b-dbb3-4e49-9ad5-7a4df4f37596 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17945e7d72954b8787e0ba09a9903247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:10.787336 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c54d58b-dbb3-4e49-9ad5-7a4df4f37596 service cinder] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:10.787336 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c54d58b-dbb3-4e49-9ad5-7a4df4f37596 service cinder] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:10.787336 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c54d58b-dbb3-4e49-9ad5-7a4df4f37596 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:10.853141 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c54d58b-dbb3-4e49-9ad5-7a4df4f37596 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:10.854801 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c54d58b-dbb3-4e49-9ad5-7a4df4f37596 service cinder] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:10.867597 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1181/2375] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 18:05:10 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:05:20.479757 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:INSERT=1,keystone:SELECT=28 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:05:20.862382 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=55 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:05:23.327537 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d071c6c0-2ae5-4bea-b582-3973ade0c11b service cinder] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:23.411919 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d071c6c0-2ae5-4bea-b582-3973ade0c11b service cinder] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:23.416941 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f639ffd-c8d8-4d23-b0e3-24676cd0c329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:23.417839 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f639ffd-c8d8-4d23-b0e3-24676cd0c329 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:23.418124 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f639ffd-c8d8-4d23-b0e3-24676cd0c329 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:23.418399 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f639ffd-c8d8-4d23-b0e3-24676cd0c329 admin admin] PATH_INFO: `/v3/users/413c7faf6ea1427f9248f5ef1601bb1d` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:23.419805 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f639ffd-c8d8-4d23-b0e3-24676cd0c329 admin admin] RBAC: Authorizing `identity:delete_user(user_id=413c7faf6ea1427f9248f5ef1601bb1d)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:23.423349 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f639ffd-c8d8-4d23-b0e3-24676cd0c329 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:23.699078 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-0f639ffd-c8d8-4d23-b0e3-24676cd0c329 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '413c7faf6ea1427f9248f5ef1601bb1d'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:05:23.703546 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-0f639ffd-c8d8-4d23-b0e3-24676cd0c329 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '413c7faf6ea1427f9248f5ef1601bb1d'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:05:23.705043 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-0f639ffd-c8d8-4d23-b0e3-24676cd0c329 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '413c7faf6ea1427f9248f5ef1601bb1d'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:05:23.790939 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-0f639ffd-c8d8-4d23-b0e3-24676cd0c329 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '413c7faf6ea1427f9248f5ef1601bb1d'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:05:23.800515 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-0f639ffd-c8d8-4d23-b0e3-24676cd0c329 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '413c7faf6ea1427f9248f5ef1601bb1d'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:05:23.820465 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1195/2376] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 14 18:05:23 2022] DELETE /identity/v3/users/413c7faf6ea1427f9248f5ef1601bb1d => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:05:23.825542 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0a95d8-7ec5-4b7f-8a7d-fa1e23884614 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:23.826120 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0a95d8-7ec5-4b7f-8a7d-fa1e23884614 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:23.826229 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0a95d8-7ec5-4b7f-8a7d-fa1e23884614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:23.850875 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-eb0a95d8-7ec5-4b7f-8a7d-fa1e23884614 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:05:23.853427 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-eb0a95d8-7ec5-4b7f-8a7d-fa1e23884614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:05:23.937971 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1182/2377] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:05:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 18:05:23.950197 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f639ffd-c8d8-4d23-b0e3-24676cd0c329 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:23.951434 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-0f639ffd-c8d8-4d23-b0e3-24676cd0c329 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:05:24.043484 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f639ffd-c8d8-4d23-b0e3-24676cd0c329 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:24.048493 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c924e9-8328-428a-8951-cc0a35c4aaea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5652329c71cd431fb579d69cef933b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:24.049775 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c924e9-8328-428a-8951-cc0a35c4aaea service neutron] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:24.050133 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c924e9-8328-428a-8951-cc0a35c4aaea service neutron] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:24.051069 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c924e9-8328-428a-8951-cc0a35c4aaea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:24.062172 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c924e9-8328-428a-8951-cc0a35c4aaea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:24.064477 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c924e9-8328-428a-8951-cc0a35c4aaea service neutron] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:24.075549 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1196/2378] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 18:05:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:05:24.742636 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0a95d8-7ec5-4b7f-8a7d-fa1e23884614 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:24.744451 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-eb0a95d8-7ec5-4b7f-8a7d-fa1e23884614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:05:24.759586 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0a95d8-7ec5-4b7f-8a7d-fa1e23884614 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:24.767504 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2383cd19-765c-4e26-8957-addf482c0ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:24.768743 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2383cd19-765c-4e26-8957-addf482c0ea1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:24.769265 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2383cd19-765c-4e26-8957-addf482c0ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:24.769803 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2383cd19-765c-4e26-8957-addf482c0ea1 admin admin] PATH_INFO: `/v3/projects/ae2bac68607043e6981aa9d2f2cc3110` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:24.773935 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2383cd19-765c-4e26-8957-addf482c0ea1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae2bac68607043e6981aa9d2f2cc3110)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:24.777722 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2383cd19-765c-4e26-8957-addf482c0ea1 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:24.934868 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-2383cd19-765c-4e26-8957-addf482c0ea1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae2bac68607043e6981aa9d2f2cc3110', 'request_id': 'req-2383cd19-765c-4e26-8957-addf482c0ea1'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:05:25.068667 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-2383cd19-765c-4e26-8957-addf482c0ea1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae2bac68607043e6981aa9d2f2cc3110', 'request_id': 'req-2383cd19-765c-4e26-8957-addf482c0ea1'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:05:25.076246 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-2383cd19-765c-4e26-8957-addf482c0ea1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae2bac68607043e6981aa9d2f2cc3110', 'request_id': 'req-2383cd19-765c-4e26-8957-addf482c0ea1'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:05:25.089244 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-2383cd19-765c-4e26-8957-addf482c0ea1 admin admin] The token cache is being invalidate because project ae2bac68607043e6981aa9d2f2cc3110 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:05:25.089528 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-2383cd19-765c-4e26-8957-addf482c0ea1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:05:25.090224 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-2383cd19-765c-4e26-8957-addf482c0ea1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:05:25.091871 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1183/2379] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 14 18:05:24 2022] DELETE /identity/v3/projects/ae2bac68607043e6981aa9d2f2cc3110 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 18:05:25.097691 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c924e9-8328-428a-8951-cc0a35c4aaea service neutron] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:25.110899 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c924e9-8328-428a-8951-cc0a35c4aaea service neutron] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:25.141274 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:05:25.199038 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9767f806-df34-448e-a0cd-355fbc76d8a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:25.199884 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9767f806-df34-448e-a0cd-355fbc76d8a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:25.200165 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9767f806-df34-448e-a0cd-355fbc76d8a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:25.200461 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9767f806-df34-448e-a0cd-355fbc76d8a8 admin admin] PATH_INFO: `/v3/users/280eb53a89d64ec0ae24a5f8d4a587b9` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:25.201752 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9767f806-df34-448e-a0cd-355fbc76d8a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=280eb53a89d64ec0ae24a5f8d4a587b9)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:25.203723 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9767f806-df34-448e-a0cd-355fbc76d8a8 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:25.457999 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-9767f806-df34-448e-a0cd-355fbc76d8a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '280eb53a89d64ec0ae24a5f8d4a587b9'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:05:25.458969 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-9767f806-df34-448e-a0cd-355fbc76d8a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '280eb53a89d64ec0ae24a5f8d4a587b9'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:05:25.459902 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-9767f806-df34-448e-a0cd-355fbc76d8a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '280eb53a89d64ec0ae24a5f8d4a587b9'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:05:25.609712 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-9767f806-df34-448e-a0cd-355fbc76d8a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '280eb53a89d64ec0ae24a5f8d4a587b9'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:05:25.626969 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-9767f806-df34-448e-a0cd-355fbc76d8a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '280eb53a89d64ec0ae24a5f8d4a587b9'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:05:25.655388 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1197/2380] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 14 18:05:25 2022] DELETE /identity/v3/users/280eb53a89d64ec0ae24a5f8d4a587b9 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:05:26.354310 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2383cd19-765c-4e26-8957-addf482c0ea1 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:26.357975 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-2383cd19-765c-4e26-8957-addf482c0ea1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:05:26.400731 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2383cd19-765c-4e26-8957-addf482c0ea1 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:26.534420 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2d1849-f77e-42f4-9fb4-f98f873014fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:26.535362 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2d1849-f77e-42f4-9fb4-f98f873014fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:26.535648 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2d1849-f77e-42f4-9fb4-f98f873014fb admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:26.535925 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2d1849-f77e-42f4-9fb4-f98f873014fb admin admin] PATH_INFO: `/v3/projects/9c7da32d47c84a888f9fe0ea5808a406` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:26.537149 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2d1849-f77e-42f4-9fb4-f98f873014fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c7da32d47c84a888f9fe0ea5808a406)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:26.539193 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2d1849-f77e-42f4-9fb4-f98f873014fb admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:26.687948 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:05:26.707501 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-2b2d1849-f77e-42f4-9fb4-f98f873014fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c7da32d47c84a888f9fe0ea5808a406', 'request_id': 'req-2b2d1849-f77e-42f4-9fb4-f98f873014fb'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:05:26.791619 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-2b2d1849-f77e-42f4-9fb4-f98f873014fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c7da32d47c84a888f9fe0ea5808a406', 'request_id': 'req-2b2d1849-f77e-42f4-9fb4-f98f873014fb'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:05:26.803255 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-2b2d1849-f77e-42f4-9fb4-f98f873014fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c7da32d47c84a888f9fe0ea5808a406', 'request_id': 'req-2b2d1849-f77e-42f4-9fb4-f98f873014fb'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:05:26.820262 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-2b2d1849-f77e-42f4-9fb4-f98f873014fb admin admin] The token cache is being invalidate because project 9c7da32d47c84a888f9fe0ea5808a406 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:05:26.820563 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-2b2d1849-f77e-42f4-9fb4-f98f873014fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:05:26.821284 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-2b2d1849-f77e-42f4-9fb4-f98f873014fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:05:26.823132 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1184/2381] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 14 18:05:26 2022] DELETE /identity/v3/projects/9c7da32d47c84a888f9fe0ea5808a406 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:05:26.828605 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fe2b69-147c-4cdb-a4a0-92e36079ea5a None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:26.829762 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fe2b69-147c-4cdb-a4a0-92e36079ea5a None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:26.835618 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fe2b69-147c-4cdb-a4a0-92e36079ea5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:26.851744 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-c1fe2b69-147c-4cdb-a4a0-92e36079ea5a None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:05:26.854981 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-c1fe2b69-147c-4cdb-a4a0-92e36079ea5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:05:26.940403 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1198/2382] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:05:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:05:26.949077 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeff908-f5d2-4d83-b4ff-2267ede6abae None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:26.949402 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeff908-f5d2-4d83-b4ff-2267ede6abae None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:26.949783 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeff908-f5d2-4d83-b4ff-2267ede6abae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:26.974224 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-0eeff908-f5d2-4d83-b4ff-2267ede6abae None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:05:26.975448 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-0eeff908-f5d2-4d83-b4ff-2267ede6abae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:05:26.984183 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1185/2383] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:05:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:05:26.990160 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fe2b69-147c-4cdb-a4a0-92e36079ea5a None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:27.001731 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fe2b69-147c-4cdb-a4a0-92e36079ea5a None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:27.007106 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0eb039-dfd8-4216-92cb-c3985628315a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:27.007879 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0eb039-dfd8-4216-92cb-c3985628315a admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:27.008172 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0eb039-dfd8-4216-92cb-c3985628315a admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:27.008459 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0eb039-dfd8-4216-92cb-c3985628315a admin admin] PATH_INFO: `/v3/domains` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:27.009208 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0eb039-dfd8-4216-92cb-c3985628315a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 18:05:27.009529 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0eb039-dfd8-4216-92cb-c3985628315a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:27.011229 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0eb039-dfd8-4216-92cb-c3985628315a admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:27.025672 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1199/2384] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 14 18:05:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 18:05:27.030592 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeff908-f5d2-4d83-b4ff-2267ede6abae None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:27.042326 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeff908-f5d2-4d83-b4ff-2267ede6abae None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:27.048933 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a71431-fb79-4526-8fd5-936148d11886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:27.049711 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a71431-fb79-4526-8fd5-936148d11886 admin admin] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:27.050121 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a71431-fb79-4526-8fd5-936148d11886 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:27.050523 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a71431-fb79-4526-8fd5-936148d11886 admin admin] PATH_INFO: `/v3/projects` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:27.051238 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a71431-fb79-4526-8fd5-936148d11886 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:27.053900 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a71431-fb79-4526-8fd5-936148d11886 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:27.174784 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1186/2385] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 14 18:05:27 2022] POST /identity/v3/projects => generated 371 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:05:27.181486 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0eb039-dfd8-4216-92cb-c3985628315a admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:27.194196 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0eb039-dfd8-4216-92cb-c3985628315a admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:27.233041 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:05:27.273820 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0722b7c1-382c-476d-8a82-947af33c6dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:27.274516 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0722b7c1-382c-476d-8a82-947af33c6dcc admin admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:27.274803 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0722b7c1-382c-476d-8a82-947af33c6dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:27.275082 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0722b7c1-382c-476d-8a82-947af33c6dcc admin admin] PATH_INFO: `/v3/users` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:27.275840 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0722b7c1-382c-476d-8a82-947af33c6dcc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:27.278128 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0722b7c1-382c-476d-8a82-947af33c6dcc admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:27.458179 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1200/2386] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 14 18:05:27 2022] POST /identity/v3/users => generated 286 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 18:05:27.459846 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a71431-fb79-4526-8fd5-936148d11886 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:27.472926 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a71431-fb79-4526-8fd5-936148d11886 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:27.478601 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4535b802-1b80-499c-8c08-80cbaddbaac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:27.479546 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4535b802-1b80-499c-8c08-80cbaddbaac0 admin admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:27.479984 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4535b802-1b80-499c-8c08-80cbaddbaac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:27.480394 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4535b802-1b80-499c-8c08-80cbaddbaac0 admin admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:27.481269 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4535b802-1b80-499c-8c08-80cbaddbaac0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:27.483088 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4535b802-1b80-499c-8c08-80cbaddbaac0 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:27.496401 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1187/2387] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 18:05:27 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:05:27.501152 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0722b7c1-382c-476d-8a82-947af33c6dcc admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:27.512803 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0722b7c1-382c-476d-8a82-947af33c6dcc admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:27.519527 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f647c40-aa16-412a-8326-3a2ea9e9723c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:27.520749 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f647c40-aa16-412a-8326-3a2ea9e9723c admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:27.521145 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f647c40-aa16-412a-8326-3a2ea9e9723c admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:27.521528 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f647c40-aa16-412a-8326-3a2ea9e9723c admin admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:27.522382 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f647c40-aa16-412a-8326-3a2ea9e9723c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:27.524474 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f647c40-aa16-412a-8326-3a2ea9e9723c admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:27.537994 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1201/2388] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 18:05:27 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 14 18:05:27.542794 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4535b802-1b80-499c-8c08-80cbaddbaac0 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:27.555679 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4535b802-1b80-499c-8c08-80cbaddbaac0 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:27.561189 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5b2f88-9492-4017-8c68-4533f0f34b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:27.564657 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b2f88-9492-4017-8c68-4533f0f34b78 admin admin] REQUEST_METHOD: `PUT` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:27.564657 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b2f88-9492-4017-8c68-4533f0f34b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:27.564657 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b2f88-9492-4017-8c68-4533f0f34b78 admin admin] PATH_INFO: `/v3/projects/97bb461a166d449d8866a2136dfdb1fa/users/c8db643765b84544a166155635213288/roles/9ee80134743f4c2b88525b04df2facba` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:27.582646 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5b2f88-9492-4017-8c68-4533f0f34b78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97bb461a166d449d8866a2136dfdb1fa, user_id=c8db643765b84544a166155635213288, role_id=9ee80134743f4c2b88525b04df2facba)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:27.588550 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5b2f88-9492-4017-8c68-4533f0f34b78 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:27.713189 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1188/2389] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 18:05:27 2022] PUT /identity/v3/projects/97bb461a166d449d8866a2136dfdb1fa/users/c8db643765b84544a166155635213288/roles/9ee80134743f4c2b88525b04df2facba => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:05:27.718652 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9780cf3-c751-4507-a15e-0b13578e7aeb None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:27.719263 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9780cf3-c751-4507-a15e-0b13578e7aeb None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:27.720321 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9780cf3-c751-4507-a15e-0b13578e7aeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:27.740143 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-b9780cf3-c751-4507-a15e-0b13578e7aeb None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:05:27.741415 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-b9780cf3-c751-4507-a15e-0b13578e7aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:05:27.815080 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1202/2390] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:05:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 18:05:27.827403 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5b2f88-9492-4017-8c68-4533f0f34b78 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:27.830493 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-2b5b2f88-9492-4017-8c68-4533f0f34b78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:05:27.911428 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5b2f88-9492-4017-8c68-4533f0f34b78 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:27.914363 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c27c6c4-254f-4b14-bba6-221c5b286cf2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5652329c71cd431fb579d69cef933b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:27.915069 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c27c6c4-254f-4b14-bba6-221c5b286cf2 service neutron] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:27.916174 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c27c6c4-254f-4b14-bba6-221c5b286cf2 service neutron] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:27.916475 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c27c6c4-254f-4b14-bba6-221c5b286cf2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:27.927552 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c27c6c4-254f-4b14-bba6-221c5b286cf2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:27.929041 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c27c6c4-254f-4b14-bba6-221c5b286cf2 service neutron] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:27.939900 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1189/2391] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 18:05:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 18:05:29.938102 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc65a6-6921-4c0a-9dca-8554b57119d9 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:29.939249 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc65a6-6921-4c0a-9dca-8554b57119d9 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:29.939617 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc65a6-6921-4c0a-9dca-8554b57119d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:29.977242 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-04bc65a6-6921-4c0a-9dca-8554b57119d9 None None] MFA Rules not processed for user `c8db643765b84544a166155635213288`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:05:29.978612 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-04bc65a6-6921-4c0a-9dca-8554b57119d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:05:30.069630 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1203/2392] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:05:29 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:05:30.074699 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c27c6c4-254f-4b14-bba6-221c5b286cf2 service neutron] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:30.099797 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c27c6c4-254f-4b14-bba6-221c5b286cf2 service neutron] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:30.128761 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdcc77b-d209-4ea2-b900-6ed4a3ae6c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:30.130436 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdcc77b-d209-4ea2-b900-6ed4a3ae6c48 admin admin] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:30.131215 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdcc77b-d209-4ea2-b900-6ed4a3ae6c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:30.132035 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdcc77b-d209-4ea2-b900-6ed4a3ae6c48 admin admin] PATH_INFO: `/v3/projects` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:30.133709 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdcc77b-d209-4ea2-b900-6ed4a3ae6c48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:30.143776 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdcc77b-d209-4ea2-b900-6ed4a3ae6c48 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:30.322334 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1190/2393] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 14 18:05:30 2022] POST /identity/v3/projects => generated 371 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:05:30.325212 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bc65a6-6921-4c0a-9dca-8554b57119d9 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:30.347930 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bc65a6-6921-4c0a-9dca-8554b57119d9 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:30.408282 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:05:30.450673 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd60ac2-67ab-4493-9632-a09113f3673e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:30.452279 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd60ac2-67ab-4493-9632-a09113f3673e admin admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:30.452864 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd60ac2-67ab-4493-9632-a09113f3673e admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:30.453386 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd60ac2-67ab-4493-9632-a09113f3673e admin admin] PATH_INFO: `/v3/users` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:30.454853 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd60ac2-67ab-4493-9632-a09113f3673e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:30.457386 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd60ac2-67ab-4493-9632-a09113f3673e admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:30.599698 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1204/2394] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 14 18:05:30 2022] POST /identity/v3/users => generated 292 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 18:05:30.606572 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdcc77b-d209-4ea2-b900-6ed4a3ae6c48 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:30.639705 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdcc77b-d209-4ea2-b900-6ed4a3ae6c48 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:30.660714 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f1acb4-ca85-4c99-ab3e-029d1b0be5cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:30.662461 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f1acb4-ca85-4c99-ab3e-029d1b0be5cc admin admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:30.663381 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f1acb4-ca85-4c99-ab3e-029d1b0be5cc admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:30.664143 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f1acb4-ca85-4c99-ab3e-029d1b0be5cc admin admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:30.675425 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f1acb4-ca85-4c99-ab3e-029d1b0be5cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:30.675425 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f1acb4-ca85-4c99-ab3e-029d1b0be5cc admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:30.697692 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1191/2395] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 18:05:30 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:05:30.705196 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd60ac2-67ab-4493-9632-a09113f3673e admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:30.717774 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd60ac2-67ab-4493-9632-a09113f3673e admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:30.725157 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0511be-7ea8-467a-ae9d-0545de99fa84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:30.726585 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0511be-7ea8-467a-ae9d-0545de99fa84 admin admin] REQUEST_METHOD: `PUT` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:30.726933 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0511be-7ea8-467a-ae9d-0545de99fa84 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:30.727709 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0511be-7ea8-467a-ae9d-0545de99fa84 admin admin] PATH_INFO: `/v3/projects/a5be122a42fa4e1c818db280bda8131f/users/8d31b57bde734db8808049144558fb3e/roles/1348580877d04014bfdec4d866b98a74` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:30.757345 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0511be-7ea8-467a-ae9d-0545de99fa84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5be122a42fa4e1c818db280bda8131f, user_id=8d31b57bde734db8808049144558fb3e, role_id=1348580877d04014bfdec4d866b98a74)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:30.761425 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0511be-7ea8-467a-ae9d-0545de99fa84 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:30.896876 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1205/2396] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 18:05:30 2022] PUT /identity/v3/projects/a5be122a42fa4e1c818db280bda8131f/users/8d31b57bde734db8808049144558fb3e/roles/1348580877d04014bfdec4d866b98a74 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:05:30.902792 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f1acb4-ca85-4c99-ab3e-029d1b0be5cc admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:30.918204 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f1acb4-ca85-4c99-ab3e-029d1b0be5cc admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:30.941309 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:05:31.027168 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dfe470-f4f4-4851-8bb5-7acd2042c912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:31.028320 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dfe470-f4f4-4851-8bb5-7acd2042c912 admin admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:31.028926 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dfe470-f4f4-4851-8bb5-7acd2042c912 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:31.029880 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dfe470-f4f4-4851-8bb5-7acd2042c912 admin admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:31.031339 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dfe470-f4f4-4851-8bb5-7acd2042c912 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:31.034867 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dfe470-f4f4-4851-8bb5-7acd2042c912 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:31.055768 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1192/2397] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 18:05:30 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:05:31.062525 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0511be-7ea8-467a-ae9d-0545de99fa84 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:31.077256 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0511be-7ea8-467a-ae9d-0545de99fa84 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:31.083394 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3e0076-925b-4369-8183-4563878b9d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:31.084502 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3e0076-925b-4369-8183-4563878b9d5b admin admin] REQUEST_METHOD: `PUT` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:31.084803 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3e0076-925b-4369-8183-4563878b9d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:31.085088 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3e0076-925b-4369-8183-4563878b9d5b admin admin] PATH_INFO: `/v3/projects/a5be122a42fa4e1c818db280bda8131f/users/8d31b57bde734db8808049144558fb3e/roles/1348580877d04014bfdec4d866b98a74` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:31.087629 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3e0076-925b-4369-8183-4563878b9d5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5be122a42fa4e1c818db280bda8131f, user_id=8d31b57bde734db8808049144558fb3e, role_id=1348580877d04014bfdec4d866b98a74)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:31.090543 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3e0076-925b-4369-8183-4563878b9d5b admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:31.108606 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1206/2398] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 18:05:31 2022] PUT /identity/v3/projects/a5be122a42fa4e1c818db280bda8131f/users/8d31b57bde734db8808049144558fb3e/roles/1348580877d04014bfdec4d866b98a74 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 18:05:32.763358 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dfe470-f4f4-4851-8bb5-7acd2042c912 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:32.767449 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-22dfe470-f4f4-4851-8bb5-7acd2042c912 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:05:32.845508 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dfe470-f4f4-4851-8bb5-7acd2042c912 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:32.902322 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469959d2-a115-41de-b1db-4d3fff48178e None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:32.902833 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469959d2-a115-41de-b1db-4d3fff48178e None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:32.902922 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469959d2-a115-41de-b1db-4d3fff48178e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:32.922207 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56cde2d-7224-4bd5-8cb3-3844620d6f19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5652329c71cd431fb579d69cef933b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:32.922207 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56cde2d-7224-4bd5-8cb3-3844620d6f19 service neutron] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:32.922207 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56cde2d-7224-4bd5-8cb3-3844620d6f19 service neutron] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:32.922207 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56cde2d-7224-4bd5-8cb3-3844620d6f19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:32.923914 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-a56cde2d-7224-4bd5-8cb3-3844620d6f19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:05:32.947706 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-469959d2-a115-41de-b1db-4d3fff48178e None None] MFA Rules not processed for user `8d31b57bde734db8808049144558fb3e`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:05:32.949714 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-469959d2-a115-41de-b1db-4d3fff48178e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:05:33.040117 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56cde2d-7224-4bd5-8cb3-3844620d6f19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:33.043925 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56cde2d-7224-4bd5-8cb3-3844620d6f19 service neutron] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:33.060358 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1193/2399] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 18:05:32 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:05:33.077582 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1207/2400] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:05:32 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:05:33.093477 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56cde2d-7224-4bd5-8cb3-3844620d6f19 service neutron] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:33.105690 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-a56cde2d-7224-4bd5-8cb3-3844620d6f19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:05:33.159558 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:05:33.201583 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469959d2-a115-41de-b1db-4d3fff48178e None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:33.211115 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56cde2d-7224-4bd5-8cb3-3844620d6f19 service neutron] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:33.214182 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469959d2-a115-41de-b1db-4d3fff48178e None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:33.216594 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b650e2-facc-42b6-a8e3-ffd521ee59c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17945e7d72954b8787e0ba09a9903247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:33.217519 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b650e2-facc-42b6-a8e3-ffd521ee59c9 service cinder] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:33.217814 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b650e2-facc-42b6-a8e3-ffd521ee59c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:33.218917 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24105295-8938-4673-bd44-958e6119d68e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5652329c71cd431fb579d69cef933b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:33.219823 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24105295-8938-4673-bd44-958e6119d68e service neutron] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:33.220095 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b650e2-facc-42b6-a8e3-ffd521ee59c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:33.220606 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24105295-8938-4673-bd44-958e6119d68e service neutron] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:33.221025 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24105295-8938-4673-bd44-958e6119d68e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:33.223212 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-24105295-8938-4673-bd44-958e6119d68e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:05:33.327345 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b650e2-facc-42b6-a8e3-ffd521ee59c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:33.330200 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b650e2-facc-42b6-a8e3-ffd521ee59c9 service cinder] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:33.334082 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24105295-8938-4673-bd44-958e6119d68e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:33.335658 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24105295-8938-4673-bd44-958e6119d68e service neutron] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:33.348186 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1194/2401] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 18:05:33 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:05:33.348931 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1208/2402] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 18:05:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:05:35.563827 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b650e2-facc-42b6-a8e3-ffd521ee59c9 service cinder] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:35.581485 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b650e2-facc-42b6-a8e3-ffd521ee59c9 service cinder] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:35.588467 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c6bb77-e8d3-4dbd-839e-3ccc1a2f6fbf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17945e7d72954b8787e0ba09a9903247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:35.589783 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c6bb77-e8d3-4dbd-839e-3ccc1a2f6fbf service cinder] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:35.590480 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c6bb77-e8d3-4dbd-839e-3ccc1a2f6fbf service cinder] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:35.591149 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c6bb77-e8d3-4dbd-839e-3ccc1a2f6fbf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:35.607788 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c6bb77-e8d3-4dbd-839e-3ccc1a2f6fbf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:35.612153 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c6bb77-e8d3-4dbd-839e-3ccc1a2f6fbf service cinder] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:35.629610 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1195/2403] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 18:05:35 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:05:38.077162 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24105295-8938-4673-bd44-958e6119d68e service neutron] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:38.087730 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24105295-8938-4673-bd44-958e6119d68e service neutron] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:38.091573 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6685812f-5dba-4cee-9dbe-7f2965d60af5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5652329c71cd431fb579d69cef933b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:38.092245 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6685812f-5dba-4cee-9dbe-7f2965d60af5 service neutron] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:38.092532 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6685812f-5dba-4cee-9dbe-7f2965d60af5 service neutron] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:38.092812 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6685812f-5dba-4cee-9dbe-7f2965d60af5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:38.095099 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-6685812f-5dba-4cee-9dbe-7f2965d60af5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:05:38.108850 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:05:38.111638 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6685812f-5dba-4cee-9dbe-7f2965d60af5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:38.113164 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6685812f-5dba-4cee-9dbe-7f2965d60af5 service neutron] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:38.125014 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1209/2404] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 18:05:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:05:40.986752 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c6bb77-e8d3-4dbd-839e-3ccc1a2f6fbf service cinder] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:40.989661 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-a3c6bb77-e8d3-4dbd-839e-3ccc1a2f6fbf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:05:41.030407 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c6bb77-e8d3-4dbd-839e-3ccc1a2f6fbf service cinder] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:41.057586 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1948f5e-a94f-491e-aaf3-00186c2f221c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:41.059676 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1948f5e-a94f-491e-aaf3-00186c2f221c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:41.060608 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1948f5e-a94f-491e-aaf3-00186c2f221c admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:41.061421 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1948f5e-a94f-491e-aaf3-00186c2f221c admin admin] PATH_INFO: `/v3/users/9c7ab182f1fd41718376a8e2f03ec87c` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:41.064906 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1948f5e-a94f-491e-aaf3-00186c2f221c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c7ab182f1fd41718376a8e2f03ec87c)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:41.066998 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1948f5e-a94f-491e-aaf3-00186c2f221c admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:41.493478 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-f1948f5e-a94f-491e-aaf3-00186c2f221c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c7ab182f1fd41718376a8e2f03ec87c'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:05:41.493478 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-f1948f5e-a94f-491e-aaf3-00186c2f221c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c7ab182f1fd41718376a8e2f03ec87c'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:05:41.493478 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-f1948f5e-a94f-491e-aaf3-00186c2f221c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c7ab182f1fd41718376a8e2f03ec87c'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:05:41.586713 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-f1948f5e-a94f-491e-aaf3-00186c2f221c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c7ab182f1fd41718376a8e2f03ec87c'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:05:41.607416 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-f1948f5e-a94f-491e-aaf3-00186c2f221c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c7ab182f1fd41718376a8e2f03ec87c'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:05:41.650074 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1196/2405] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 14 18:05:40 2022] DELETE /identity/v3/users/9c7ab182f1fd41718376a8e2f03ec87c => generated 0 bytes in 666 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:05:42.220771 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6685812f-5dba-4cee-9dbe-7f2965d60af5 service neutron] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:42.235057 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6685812f-5dba-4cee-9dbe-7f2965d60af5 service neutron] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:42.365308 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83062d6c-1edd-4ea9-a48a-af56004cbd03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:42.371521 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83062d6c-1edd-4ea9-a48a-af56004cbd03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:42.371521 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83062d6c-1edd-4ea9-a48a-af56004cbd03 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:42.371521 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83062d6c-1edd-4ea9-a48a-af56004cbd03 admin admin] PATH_INFO: `/v3/projects/865c9f495fc24f8fb216d11917309a95` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:42.373008 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83062d6c-1edd-4ea9-a48a-af56004cbd03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=865c9f495fc24f8fb216d11917309a95)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:42.378246 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83062d6c-1edd-4ea9-a48a-af56004cbd03 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:42.589175 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-83062d6c-1edd-4ea9-a48a-af56004cbd03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '865c9f495fc24f8fb216d11917309a95', 'request_id': 'req-83062d6c-1edd-4ea9-a48a-af56004cbd03'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:05:42.710969 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-83062d6c-1edd-4ea9-a48a-af56004cbd03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '865c9f495fc24f8fb216d11917309a95', 'request_id': 'req-83062d6c-1edd-4ea9-a48a-af56004cbd03'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:05:42.728625 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-83062d6c-1edd-4ea9-a48a-af56004cbd03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '865c9f495fc24f8fb216d11917309a95', 'request_id': 'req-83062d6c-1edd-4ea9-a48a-af56004cbd03'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:05:42.754160 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-83062d6c-1edd-4ea9-a48a-af56004cbd03 admin admin] The token cache is being invalidate because project 865c9f495fc24f8fb216d11917309a95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87019) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:05:42.754570 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-83062d6c-1edd-4ea9-a48a-af56004cbd03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:05:42.755258 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-83062d6c-1edd-4ea9-a48a-af56004cbd03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:05:42.757313 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1210/2406] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 14 18:05:42 2022] DELETE /identity/v3/projects/865c9f495fc24f8fb216d11917309a95 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:05:42.764428 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ddfb08-900b-4908-96cc-92c7b8fea391 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:42.765386 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ddfb08-900b-4908-96cc-92c7b8fea391 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:42.766076 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ddfb08-900b-4908-96cc-92c7b8fea391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:42.803442 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-f6ddfb08-900b-4908-96cc-92c7b8fea391 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:05:42.805611 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-f6ddfb08-900b-4908-96cc-92c7b8fea391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:05:42.858923 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:05:42.920543 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1197/2407] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:05:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:05:42.929179 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c333a99-f4d6-4c7c-aea2-f4e5e2b713e2 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:42.929506 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c333a99-f4d6-4c7c-aea2-f4e5e2b713e2 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:42.929823 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c333a99-f4d6-4c7c-aea2-f4e5e2b713e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:42.974422 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-7c333a99-f4d6-4c7c-aea2-f4e5e2b713e2 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:05:42.976285 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-7c333a99-f4d6-4c7c-aea2-f4e5e2b713e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:05:42.988116 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1211/2408] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:05:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:05:42.992524 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ddfb08-900b-4908-96cc-92c7b8fea391 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:43.010303 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ddfb08-900b-4908-96cc-92c7b8fea391 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:43.026688 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9e8e3f-de9a-40ed-aadb-584b935ddb22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:43.027495 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9e8e3f-de9a-40ed-aadb-584b935ddb22 admin admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:43.027804 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9e8e3f-de9a-40ed-aadb-584b935ddb22 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:43.028072 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9e8e3f-de9a-40ed-aadb-584b935ddb22 admin admin] PATH_INFO: `/v3/domains` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:43.028840 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9e8e3f-de9a-40ed-aadb-584b935ddb22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 18:05:43.029191 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9e8e3f-de9a-40ed-aadb-584b935ddb22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:43.030982 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9e8e3f-de9a-40ed-aadb-584b935ddb22 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:43.074785 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1198/2409] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 14 18:05:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 18:05:43.076839 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c333a99-f4d6-4c7c-aea2-f4e5e2b713e2 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:43.094643 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c333a99-f4d6-4c7c-aea2-f4e5e2b713e2 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:43.115705 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cba3afa-9212-4b91-9f32-0e9f3bd53a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:43.116401 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cba3afa-9212-4b91-9f32-0e9f3bd53a4d admin admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:43.116689 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cba3afa-9212-4b91-9f32-0e9f3bd53a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:43.116972 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cba3afa-9212-4b91-9f32-0e9f3bd53a4d admin admin] PATH_INFO: `/v3/projects` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:43.117709 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cba3afa-9212-4b91-9f32-0e9f3bd53a4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:43.119984 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9e8e3f-de9a-40ed-aadb-584b935ddb22 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:43.121855 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-eb9e8e3f-de9a-40ed-aadb-584b935ddb22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:05:43.124300 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cba3afa-9212-4b91-9f32-0e9f3bd53a4d admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:43.241974 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9e8e3f-de9a-40ed-aadb-584b935ddb22 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:43.248759 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec4e2bd-23f6-4024-8d1b-e57b30e549e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5652329c71cd431fb579d69cef933b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:43.249571 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec4e2bd-23f6-4024-8d1b-e57b30e549e7 service neutron] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:43.249936 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec4e2bd-23f6-4024-8d1b-e57b30e549e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:43.250293 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec4e2bd-23f6-4024-8d1b-e57b30e549e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:43.253306 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-6ec4e2bd-23f6-4024-8d1b-e57b30e549e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:05:43.269305 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec4e2bd-23f6-4024-8d1b-e57b30e549e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:43.271092 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec4e2bd-23f6-4024-8d1b-e57b30e549e7 service neutron] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:43.286167 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1199/2410] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 18:05:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 18:05:43.403709 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1212/2411] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 14 18:05:43 2022] POST /identity/v3/projects => generated 385 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:05:43.407692 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec4e2bd-23f6-4024-8d1b-e57b30e549e7 service neutron] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:43.420055 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec4e2bd-23f6-4024-8d1b-e57b30e549e7 service neutron] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:43.535431 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99708b54-e2da-4c20-be02-88cd103488b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:43.537126 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99708b54-e2da-4c20-be02-88cd103488b4 admin admin] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:43.537654 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99708b54-e2da-4c20-be02-88cd103488b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:43.538007 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99708b54-e2da-4c20-be02-88cd103488b4 admin admin] PATH_INFO: `/v3/users` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:43.539023 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99708b54-e2da-4c20-be02-88cd103488b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:43.544503 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99708b54-e2da-4c20-be02-88cd103488b4 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:43.820886 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1200/2412] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 14 18:05:43 2022] POST /identity/v3/users => generated 293 bytes in 414 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 18:05:43.824897 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cba3afa-9212-4b91-9f32-0e9f3bd53a4d admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:43.845433 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cba3afa-9212-4b91-9f32-0e9f3bd53a4d admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:43.859733 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e01a94c-79ae-43f9-a888-ae2142085d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:43.865485 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e01a94c-79ae-43f9-a888-ae2142085d25 admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:43.865868 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e01a94c-79ae-43f9-a888-ae2142085d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:43.866203 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e01a94c-79ae-43f9-a888-ae2142085d25 admin admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:43.866974 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e01a94c-79ae-43f9-a888-ae2142085d25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:43.869531 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e01a94c-79ae-43f9-a888-ae2142085d25 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:43.917915 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1213/2413] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 18:05:43 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:05:43.923935 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99708b54-e2da-4c20-be02-88cd103488b4 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:43.941545 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99708b54-e2da-4c20-be02-88cd103488b4 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:43.946701 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7c68b2-a3af-4db9-9fb5-4f1bbb291554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:43.947731 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7c68b2-a3af-4db9-9fb5-4f1bbb291554 admin admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:43.948372 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7c68b2-a3af-4db9-9fb5-4f1bbb291554 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:43.948869 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7c68b2-a3af-4db9-9fb5-4f1bbb291554 admin admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:43.950010 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7c68b2-a3af-4db9-9fb5-4f1bbb291554 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:43.951987 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7c68b2-a3af-4db9-9fb5-4f1bbb291554 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:43.967412 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1201/2414] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 18:05:43 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:05:43.972446 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e01a94c-79ae-43f9-a888-ae2142085d25 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:43.985031 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e01a94c-79ae-43f9-a888-ae2142085d25 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:43.991948 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9da9dc2-c656-4cd8-8c64-43f54ac8ae00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:43.992871 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9da9dc2-c656-4cd8-8c64-43f54ac8ae00 admin admin] REQUEST_METHOD: `PUT` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:43.993155 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9da9dc2-c656-4cd8-8c64-43f54ac8ae00 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:43.993436 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9da9dc2-c656-4cd8-8c64-43f54ac8ae00 admin admin] PATH_INFO: `/v3/projects/25f56991b4c14ffca55aca08105b04a4/users/f83b97d3b451488fa7bb2cdb900e62d3/roles/9ee80134743f4c2b88525b04df2facba` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:44.061564 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9da9dc2-c656-4cd8-8c64-43f54ac8ae00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25f56991b4c14ffca55aca08105b04a4, user_id=f83b97d3b451488fa7bb2cdb900e62d3, role_id=9ee80134743f4c2b88525b04df2facba)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:44.065283 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9da9dc2-c656-4cd8-8c64-43f54ac8ae00 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:44.166379 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1214/2415] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 18:05:43 2022] PUT /identity/v3/projects/25f56991b4c14ffca55aca08105b04a4/users/f83b97d3b451488fa7bb2cdb900e62d3/roles/9ee80134743f4c2b88525b04df2facba => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:05:44.178906 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848ea7d0-50a5-4124-b40f-19abb97d0be3 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:44.179203 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848ea7d0-50a5-4124-b40f-19abb97d0be3 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:44.179513 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848ea7d0-50a5-4124-b40f-19abb97d0be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:44.231187 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-848ea7d0-50a5-4124-b40f-19abb97d0be3 None None] MFA Rules not processed for user `f83b97d3b451488fa7bb2cdb900e62d3`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:05:44.233379 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-848ea7d0-50a5-4124-b40f-19abb97d0be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:05:44.359384 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:05:44.371583 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1202/2416] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:05:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:05:44.380022 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9da9dc2-c656-4cd8-8c64-43f54ac8ae00 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:44.381825 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-a9da9dc2-c656-4cd8-8c64-43f54ac8ae00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:05:44.443402 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:05:44.581713 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9da9dc2-c656-4cd8-8c64-43f54ac8ae00 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:44.591789 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b320fd73-8546-4986-a930-e1273b9559bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4696d396adb495ab300a9a5a5727595', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:44.592933 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b320fd73-8546-4986-a930-e1273b9559bf service nova] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:44.593324 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b320fd73-8546-4986-a930-e1273b9559bf service nova] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:44.593877 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b320fd73-8546-4986-a930-e1273b9559bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:44.607593 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b320fd73-8546-4986-a930-e1273b9559bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:44.609383 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b320fd73-8546-4986-a930-e1273b9559bf service nova] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:44.620473 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1215/2417] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 18:05:44 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 18:05:45.320319 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848ea7d0-50a5-4124-b40f-19abb97d0be3 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:45.323918 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-848ea7d0-50a5-4124-b40f-19abb97d0be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:05:45.453558 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848ea7d0-50a5-4124-b40f-19abb97d0be3 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:45.466524 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5179f16-3d7c-46e8-a1ac-5a6b424ada7f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a8049f9c66b4b5185c26084fd8239ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:45.467445 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5179f16-3d7c-46e8-a1ac-5a6b424ada7f service placement] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:45.467807 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5179f16-3d7c-46e8-a1ac-5a6b424ada7f service placement] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:45.468212 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5179f16-3d7c-46e8-a1ac-5a6b424ada7f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:45.483849 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-e5179f16-3d7c-46e8-a1ac-5a6b424ada7f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:05:45.486073 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b320fd73-8546-4986-a930-e1273b9559bf service nova] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:45.487654 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-b320fd73-8546-4986-a930-e1273b9559bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:05:45.508737 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5179f16-3d7c-46e8-a1ac-5a6b424ada7f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:45.512301 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5179f16-3d7c-46e8-a1ac-5a6b424ada7f service placement] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:45.532456 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1203/2418] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 18:05:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 18:05:45.673214 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b320fd73-8546-4986-a930-e1273b9559bf service nova] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:45.681471 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d7a29c-4e6e-4c0d-bcc0-c6d158745c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:45.682489 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d7a29c-4e6e-4c0d-bcc0-c6d158745c7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:45.702239 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d7a29c-4e6e-4c0d-bcc0-c6d158745c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:45.702239 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d7a29c-4e6e-4c0d-bcc0-c6d158745c7c admin admin] PATH_INFO: `/v3/users/41680577c34d4b9090270d3097a7e02c` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:45.702239 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d7a29c-4e6e-4c0d-bcc0-c6d158745c7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=41680577c34d4b9090270d3097a7e02c)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:45.702239 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d7a29c-4e6e-4c0d-bcc0-c6d158745c7c admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:46.113373 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-e3d7a29c-4e6e-4c0d-bcc0-c6d158745c7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41680577c34d4b9090270d3097a7e02c'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:05:46.114401 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-e3d7a29c-4e6e-4c0d-bcc0-c6d158745c7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41680577c34d4b9090270d3097a7e02c'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:05:46.115693 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-e3d7a29c-4e6e-4c0d-bcc0-c6d158745c7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41680577c34d4b9090270d3097a7e02c'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:05:46.294591 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-e3d7a29c-4e6e-4c0d-bcc0-c6d158745c7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41680577c34d4b9090270d3097a7e02c'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:05:46.309584 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-e3d7a29c-4e6e-4c0d-bcc0-c6d158745c7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41680577c34d4b9090270d3097a7e02c'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:05:46.331343 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1216/2419] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 14 18:05:45 2022] DELETE /identity/v3/users/41680577c34d4b9090270d3097a7e02c => generated 0 bytes in 846 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:05:46.761224 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5179f16-3d7c-46e8-a1ac-5a6b424ada7f service placement] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:46.782339 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5179f16-3d7c-46e8-a1ac-5a6b424ada7f service placement] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:46.897567 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0203cf81-2d25-445d-ba97-af0df489581f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:46.899194 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0203cf81-2d25-445d-ba97-af0df489581f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:46.900005 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0203cf81-2d25-445d-ba97-af0df489581f admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:46.900736 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0203cf81-2d25-445d-ba97-af0df489581f admin admin] PATH_INFO: `/v3/projects/b2bf6c7727884fd98fd7035f04de2da5` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:46.902692 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0203cf81-2d25-445d-ba97-af0df489581f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2bf6c7727884fd98fd7035f04de2da5)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:46.905178 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0203cf81-2d25-445d-ba97-af0df489581f admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:47.060757 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-0203cf81-2d25-445d-ba97-af0df489581f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2bf6c7727884fd98fd7035f04de2da5', 'request_id': 'req-0203cf81-2d25-445d-ba97-af0df489581f'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:05:47.133861 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-0203cf81-2d25-445d-ba97-af0df489581f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2bf6c7727884fd98fd7035f04de2da5', 'request_id': 'req-0203cf81-2d25-445d-ba97-af0df489581f'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:05:47.140327 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-0203cf81-2d25-445d-ba97-af0df489581f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2bf6c7727884fd98fd7035f04de2da5', 'request_id': 'req-0203cf81-2d25-445d-ba97-af0df489581f'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:05:47.151196 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:05:47.157826 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-0203cf81-2d25-445d-ba97-af0df489581f admin admin] The token cache is being invalidate because project b2bf6c7727884fd98fd7035f04de2da5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:05:47.157826 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-0203cf81-2d25-445d-ba97-af0df489581f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:05:47.157826 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-0203cf81-2d25-445d-ba97-af0df489581f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:05:47.159892 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1204/2420] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 14 18:05:46 2022] DELETE /identity/v3/projects/b2bf6c7727884fd98fd7035f04de2da5 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:05:47.165203 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7f3983-63fe-46c1-873d-577af512a47f None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:47.165203 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7f3983-63fe-46c1-873d-577af512a47f None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:47.165960 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7f3983-63fe-46c1-873d-577af512a47f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:47.186754 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-bd7f3983-63fe-46c1-873d-577af512a47f None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:05:47.188680 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-bd7f3983-63fe-46c1-873d-577af512a47f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:05:47.216399 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:05:47.269487 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1217/2421] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:05:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:05:47.278429 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a12b2-0381-4821-b2f3-eb691dd4b3a7 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:47.278988 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a12b2-0381-4821-b2f3-eb691dd4b3a7 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:47.279519 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a12b2-0381-4821-b2f3-eb691dd4b3a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:47.317838 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-b18a12b2-0381-4821-b2f3-eb691dd4b3a7 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:05:47.322178 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-b18a12b2-0381-4821-b2f3-eb691dd4b3a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:05:47.339718 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1205/2422] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:05:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:05:47.340678 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7f3983-63fe-46c1-873d-577af512a47f None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:47.370166 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7f3983-63fe-46c1-873d-577af512a47f None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:47.412847 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034cf43f-f378-42cd-bff0-b725e7b06e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:47.414582 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034cf43f-f378-42cd-bff0-b725e7b06e4d admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:47.414949 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034cf43f-f378-42cd-bff0-b725e7b06e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:47.416421 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034cf43f-f378-42cd-bff0-b725e7b06e4d admin admin] PATH_INFO: `/v3/domains` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:47.418096 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034cf43f-f378-42cd-bff0-b725e7b06e4d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 18:05:47.418735 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034cf43f-f378-42cd-bff0-b725e7b06e4d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:47.424143 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034cf43f-f378-42cd-bff0-b725e7b06e4d admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:47.444538 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1218/2423] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 14 18:05:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 18:05:47.449795 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18a12b2-0381-4821-b2f3-eb691dd4b3a7 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:47.472363 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18a12b2-0381-4821-b2f3-eb691dd4b3a7 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:47.491001 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f767fc2-373e-4102-98ae-0ce9659ce14f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:47.491976 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f767fc2-373e-4102-98ae-0ce9659ce14f admin admin] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:47.492349 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f767fc2-373e-4102-98ae-0ce9659ce14f admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:47.492642 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f767fc2-373e-4102-98ae-0ce9659ce14f admin admin] PATH_INFO: `/v3/projects` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:47.499183 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f767fc2-373e-4102-98ae-0ce9659ce14f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:47.499183 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f767fc2-373e-4102-98ae-0ce9659ce14f admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:47.697382 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1206/2424] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 14 18:05:47 2022] POST /identity/v3/projects => generated 381 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:05:47.701681 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034cf43f-f378-42cd-bff0-b725e7b06e4d admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:47.712658 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034cf43f-f378-42cd-bff0-b725e7b06e4d admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:47.783278 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918791cd-59bc-4c36-8357-f9781848cd7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:47.784062 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918791cd-59bc-4c36-8357-f9781848cd7f admin admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:47.784585 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918791cd-59bc-4c36-8357-f9781848cd7f admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:47.784791 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918791cd-59bc-4c36-8357-f9781848cd7f admin admin] PATH_INFO: `/v3/users` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:47.785537 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918791cd-59bc-4c36-8357-f9781848cd7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:47.787502 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918791cd-59bc-4c36-8357-f9781848cd7f admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:47.899181 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1219/2425] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 14 18:05:47 2022] POST /identity/v3/users => generated 291 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:05:47.902996 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f767fc2-373e-4102-98ae-0ce9659ce14f admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:47.915771 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f767fc2-373e-4102-98ae-0ce9659ce14f admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:47.921196 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d29f27c-2e76-4a42-ac02-fed7eac6f548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:47.921900 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d29f27c-2e76-4a42-ac02-fed7eac6f548 admin admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:47.922189 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d29f27c-2e76-4a42-ac02-fed7eac6f548 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:47.923168 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d29f27c-2e76-4a42-ac02-fed7eac6f548 admin admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:47.924847 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d29f27c-2e76-4a42-ac02-fed7eac6f548 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:47.926524 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d29f27c-2e76-4a42-ac02-fed7eac6f548 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:47.941473 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1207/2426] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 18:05:47 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:05:47.946254 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918791cd-59bc-4c36-8357-f9781848cd7f admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:47.960743 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918791cd-59bc-4c36-8357-f9781848cd7f admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:47.965980 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b277c1a-640a-4a52-a7c0-b9aedbc0b800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:47.966774 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b277c1a-640a-4a52-a7c0-b9aedbc0b800 admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:47.968197 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b277c1a-640a-4a52-a7c0-b9aedbc0b800 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:47.968197 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b277c1a-640a-4a52-a7c0-b9aedbc0b800 admin admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:47.968197 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b277c1a-640a-4a52-a7c0-b9aedbc0b800 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:47.970648 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b277c1a-640a-4a52-a7c0-b9aedbc0b800 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:47.982397 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1220/2427] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 18:05:47 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:05:47.987604 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d29f27c-2e76-4a42-ac02-fed7eac6f548 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:47.999957 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d29f27c-2e76-4a42-ac02-fed7eac6f548 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:48.009981 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c539ea5b-b0a9-41b2-9de4-1918b186a841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:48.010936 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c539ea5b-b0a9-41b2-9de4-1918b186a841 admin admin] REQUEST_METHOD: `PUT` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:48.011225 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c539ea5b-b0a9-41b2-9de4-1918b186a841 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:48.011564 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c539ea5b-b0a9-41b2-9de4-1918b186a841 admin admin] PATH_INFO: `/v3/projects/08d175b9a23f4eedb5a45ac5fb9f4483/users/59678ca5f10b440db03e76923977dcc3/roles/9ee80134743f4c2b88525b04df2facba` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:48.042844 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c539ea5b-b0a9-41b2-9de4-1918b186a841 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08d175b9a23f4eedb5a45ac5fb9f4483, user_id=59678ca5f10b440db03e76923977dcc3, role_id=9ee80134743f4c2b88525b04df2facba)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:48.045694 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c539ea5b-b0a9-41b2-9de4-1918b186a841 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:48.167629 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1208/2428] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 18:05:47 2022] PUT /identity/v3/projects/08d175b9a23f4eedb5a45ac5fb9f4483/users/59678ca5f10b440db03e76923977dcc3/roles/9ee80134743f4c2b88525b04df2facba => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:05:48.178552 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf270c0d-b76b-41db-affb-15e6593e57e8 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:48.179054 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf270c0d-b76b-41db-affb-15e6593e57e8 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:48.179152 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf270c0d-b76b-41db-affb-15e6593e57e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:48.206211 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-bf270c0d-b76b-41db-affb-15e6593e57e8 None None] MFA Rules not processed for user `59678ca5f10b440db03e76923977dcc3`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:05:48.207400 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-bf270c0d-b76b-41db-affb-15e6593e57e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:05:48.273228 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1221/2429] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:05:48 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:05:48.278019 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c539ea5b-b0a9-41b2-9de4-1918b186a841 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:48.353063 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c539ea5b-b0a9-41b2-9de4-1918b186a841 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:48.359604 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85dae6a-7d37-457a-bedc-fad6991f7aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:48.360354 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85dae6a-7d37-457a-bedc-fad6991f7aa4 admin admin] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:48.360608 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85dae6a-7d37-457a-bedc-fad6991f7aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:48.360961 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85dae6a-7d37-457a-bedc-fad6991f7aa4 admin admin] PATH_INFO: `/v3/projects` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:48.361700 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85dae6a-7d37-457a-bedc-fad6991f7aa4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:48.364479 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85dae6a-7d37-457a-bedc-fad6991f7aa4 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:48.474249 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1209/2430] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 14 18:05:48 2022] POST /identity/v3/projects => generated 379 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:05:48.478300 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf270c0d-b76b-41db-affb-15e6593e57e8 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:48.493677 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf270c0d-b76b-41db-affb-15e6593e57e8 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:48.585641 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d7c13c-0d34-40bb-ac12-403c1a962e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:48.587267 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d7c13c-0d34-40bb-ac12-403c1a962e9d admin admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:48.588098 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d7c13c-0d34-40bb-ac12-403c1a962e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:48.588730 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d7c13c-0d34-40bb-ac12-403c1a962e9d admin admin] PATH_INFO: `/v3/users` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:48.590116 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d7c13c-0d34-40bb-ac12-403c1a962e9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:48.594148 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d7c13c-0d34-40bb-ac12-403c1a962e9d admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:48.697673 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1222/2431] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 14 18:05:48 2022] POST /identity/v3/users => generated 296 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:05:48.701956 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85dae6a-7d37-457a-bedc-fad6991f7aa4 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:48.715291 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85dae6a-7d37-457a-bedc-fad6991f7aa4 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:48.722225 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1c456f-7ab3-4bd6-bb6c-cba8e5d179f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:48.722924 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1c456f-7ab3-4bd6-bb6c-cba8e5d179f4 admin admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:48.723203 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1c456f-7ab3-4bd6-bb6c-cba8e5d179f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:48.723746 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1c456f-7ab3-4bd6-bb6c-cba8e5d179f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:48.724384 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1c456f-7ab3-4bd6-bb6c-cba8e5d179f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:48.725957 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1c456f-7ab3-4bd6-bb6c-cba8e5d179f4 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:48.739932 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1210/2432] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 18:05:48 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 14 18:05:48.743829 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d7c13c-0d34-40bb-ac12-403c1a962e9d admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:48.756922 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d7c13c-0d34-40bb-ac12-403c1a962e9d admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:48.762197 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99770cd4-07f3-49c7-b73c-ae1075f509dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:48.763204 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99770cd4-07f3-49c7-b73c-ae1075f509dc admin admin] REQUEST_METHOD: `PUT` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:48.763592 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99770cd4-07f3-49c7-b73c-ae1075f509dc admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:48.763951 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99770cd4-07f3-49c7-b73c-ae1075f509dc admin admin] PATH_INFO: `/v3/projects/03b63890f7c6420fa568adedf7260f00/users/34bf0b858caa4ca1a9a66fe2a9cb17b2/roles/1348580877d04014bfdec4d866b98a74` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:48.783342 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99770cd4-07f3-49c7-b73c-ae1075f509dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=03b63890f7c6420fa568adedf7260f00, user_id=34bf0b858caa4ca1a9a66fe2a9cb17b2, role_id=1348580877d04014bfdec4d866b98a74)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:48.786434 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99770cd4-07f3-49c7-b73c-ae1075f509dc admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:48.922080 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1223/2433] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 18:05:48 2022] PUT /identity/v3/projects/03b63890f7c6420fa568adedf7260f00/users/34bf0b858caa4ca1a9a66fe2a9cb17b2/roles/1348580877d04014bfdec4d866b98a74 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 18:05:48.927608 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1c456f-7ab3-4bd6-bb6c-cba8e5d179f4 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:48.939606 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1c456f-7ab3-4bd6-bb6c-cba8e5d179f4 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:48.997841 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:05:49.051605 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137caebc-d6f9-4d95-8482-c57dee0de42b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:49.052389 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137caebc-d6f9-4d95-8482-c57dee0de42b admin admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:49.052846 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137caebc-d6f9-4d95-8482-c57dee0de42b admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:49.053009 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137caebc-d6f9-4d95-8482-c57dee0de42b admin admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:49.053665 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137caebc-d6f9-4d95-8482-c57dee0de42b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:49.055292 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137caebc-d6f9-4d95-8482-c57dee0de42b admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:49.076145 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99770cd4-07f3-49c7-b73c-ae1075f509dc admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:49.077210 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1211/2434] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 18:05:48 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:05:49.103544 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99770cd4-07f3-49c7-b73c-ae1075f509dc admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:49.108894 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20004cd-f976-42ba-af6a-344aea2a9458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:49.110741 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20004cd-f976-42ba-af6a-344aea2a9458 admin admin] REQUEST_METHOD: `PUT` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:49.111572 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20004cd-f976-42ba-af6a-344aea2a9458 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:49.112013 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20004cd-f976-42ba-af6a-344aea2a9458 admin admin] PATH_INFO: `/v3/projects/03b63890f7c6420fa568adedf7260f00/users/34bf0b858caa4ca1a9a66fe2a9cb17b2/roles/1348580877d04014bfdec4d866b98a74` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:49.114424 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20004cd-f976-42ba-af6a-344aea2a9458 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03b63890f7c6420fa568adedf7260f00, user_id=34bf0b858caa4ca1a9a66fe2a9cb17b2, role_id=1348580877d04014bfdec4d866b98a74)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:49.117363 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20004cd-f976-42ba-af6a-344aea2a9458 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:49.132147 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1224/2435] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 18:05:49 2022] PUT /identity/v3/projects/03b63890f7c6420fa568adedf7260f00/users/34bf0b858caa4ca1a9a66fe2a9cb17b2/roles/1348580877d04014bfdec4d866b98a74 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:05:49.143334 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9490d0-46c8-4de7-82fc-f052b62e71c3 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:49.143635 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9490d0-46c8-4de7-82fc-f052b62e71c3 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:49.143927 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9490d0-46c8-4de7-82fc-f052b62e71c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:49.152210 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:05:49.176498 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-1c9490d0-46c8-4de7-82fc-f052b62e71c3 None None] MFA Rules not processed for user `34bf0b858caa4ca1a9a66fe2a9cb17b2`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:05:49.177743 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-1c9490d0-46c8-4de7-82fc-f052b62e71c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:05:49.256789 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1212/2436] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:05:49 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:05:49.270615 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20004cd-f976-42ba-af6a-344aea2a9458 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:49.272536 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-a20004cd-f976-42ba-af6a-344aea2a9458 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:05:49.341464 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20004cd-f976-42ba-af6a-344aea2a9458 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:49.346044 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ee94a2-3198-4941-a3ca-5b010f1da284 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17945e7d72954b8787e0ba09a9903247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:49.346794 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ee94a2-3198-4941-a3ca-5b010f1da284 service cinder] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:49.347078 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ee94a2-3198-4941-a3ca-5b010f1da284 service cinder] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:49.347389 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ee94a2-3198-4941-a3ca-5b010f1da284 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:49.365701 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ee94a2-3198-4941-a3ca-5b010f1da284 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:49.369974 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ee94a2-3198-4941-a3ca-5b010f1da284 service cinder] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:49.392541 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1225/2437] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 18:05:49 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:05:49.621283 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9490d0-46c8-4de7-82fc-f052b62e71c3 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:49.632817 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9490d0-46c8-4de7-82fc-f052b62e71c3 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:49.636600 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c3ad12-9fe7-49d4-8439-44fe55e6bce5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17945e7d72954b8787e0ba09a9903247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:49.637295 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c3ad12-9fe7-49d4-8439-44fe55e6bce5 service cinder] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:49.637583 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c3ad12-9fe7-49d4-8439-44fe55e6bce5 service cinder] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:49.638015 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c3ad12-9fe7-49d4-8439-44fe55e6bce5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:49.716571 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c3ad12-9fe7-49d4-8439-44fe55e6bce5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:49.719494 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c3ad12-9fe7-49d4-8439-44fe55e6bce5 service cinder] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:49.737211 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1213/2438] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 18:05:49 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:05:51.020505 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ee94a2-3198-4941-a3ca-5b010f1da284 service cinder] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:51.024811 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-38ee94a2-3198-4941-a3ca-5b010f1da284 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:05:51.190739 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ee94a2-3198-4941-a3ca-5b010f1da284 service cinder] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:51.199840 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e8b211-d685-480b-aa22-0a630741104e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5652329c71cd431fb579d69cef933b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:51.200905 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e8b211-d685-480b-aa22-0a630741104e service neutron] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:51.201596 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e8b211-d685-480b-aa22-0a630741104e service neutron] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:51.202056 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e8b211-d685-480b-aa22-0a630741104e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:51.205308 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-14e8b211-d685-480b-aa22-0a630741104e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:05:51.285330 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:05:51.324454 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e8b211-d685-480b-aa22-0a630741104e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:51.326634 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e8b211-d685-480b-aa22-0a630741104e service neutron] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:51.340579 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1226/2439] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 18:05:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:05:54.266687 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c3ad12-9fe7-49d4-8439-44fe55e6bce5 service cinder] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:54.268908 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-f0c3ad12-9fe7-49d4-8439-44fe55e6bce5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:05:54.297621 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c3ad12-9fe7-49d4-8439-44fe55e6bce5 service cinder] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:54.303163 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70334797-7a37-45b8-b079-e5182f32146c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:54.304354 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70334797-7a37-45b8-b079-e5182f32146c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:54.305035 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70334797-7a37-45b8-b079-e5182f32146c admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:54.305481 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70334797-7a37-45b8-b079-e5182f32146c admin admin] PATH_INFO: `/v3/users/f83b97d3b451488fa7bb2cdb900e62d3` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:54.306937 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70334797-7a37-45b8-b079-e5182f32146c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f83b97d3b451488fa7bb2cdb900e62d3)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:54.309460 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70334797-7a37-45b8-b079-e5182f32146c admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:54.615065 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e8b211-d685-480b-aa22-0a630741104e service neutron] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:54.616591 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-14e8b211-d685-480b-aa22-0a630741104e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:05:54.620497 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-70334797-7a37-45b8-b079-e5182f32146c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f83b97d3b451488fa7bb2cdb900e62d3'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:05:54.621272 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-70334797-7a37-45b8-b079-e5182f32146c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f83b97d3b451488fa7bb2cdb900e62d3'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:05:54.621989 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-70334797-7a37-45b8-b079-e5182f32146c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f83b97d3b451488fa7bb2cdb900e62d3'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:05:54.632379 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e8b211-d685-480b-aa22-0a630741104e service neutron] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:54.637751 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97a60b2-3191-4cc0-a3ce-eb62b8bc0597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:54.638642 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a60b2-3191-4cc0-a3ce-eb62b8bc0597 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:54.638977 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a60b2-3191-4cc0-a3ce-eb62b8bc0597 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:54.639272 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a60b2-3191-4cc0-a3ce-eb62b8bc0597 admin admin] PATH_INFO: `/v3/users/e6b1c08311384aa39ad01a8378c9a056` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:54.640644 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97a60b2-3191-4cc0-a3ce-eb62b8bc0597 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6b1c08311384aa39ad01a8378c9a056)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:54.643369 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97a60b2-3191-4cc0-a3ce-eb62b8bc0597 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:54.771349 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-70334797-7a37-45b8-b079-e5182f32146c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f83b97d3b451488fa7bb2cdb900e62d3'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:05:54.785959 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-70334797-7a37-45b8-b079-e5182f32146c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f83b97d3b451488fa7bb2cdb900e62d3'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:05:54.818532 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:05:54.826366 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1214/2440] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 14 18:05:54 2022] DELETE /identity/v3/users/f83b97d3b451488fa7bb2cdb900e62d3 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:05:54.832627 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa37b054-5bdc-493f-ac2c-80a53d2c5662 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:54.833715 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa37b054-5bdc-493f-ac2c-80a53d2c5662 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:54.834225 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa37b054-5bdc-493f-ac2c-80a53d2c5662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:54.861041 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-aa37b054-5bdc-493f-ac2c-80a53d2c5662 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:05:54.862379 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-aa37b054-5bdc-493f-ac2c-80a53d2c5662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:05:54.930828 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-c97a60b2-3191-4cc0-a3ce-eb62b8bc0597 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6b1c08311384aa39ad01a8378c9a056'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:05:54.931876 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-c97a60b2-3191-4cc0-a3ce-eb62b8bc0597 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6b1c08311384aa39ad01a8378c9a056'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:05:54.932682 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-c97a60b2-3191-4cc0-a3ce-eb62b8bc0597 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6b1c08311384aa39ad01a8378c9a056'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:05:54.949312 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1215/2441] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:05:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 18:05:54.960237 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa37b054-5bdc-493f-ac2c-80a53d2c5662 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:54.961499 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-aa37b054-5bdc-493f-ac2c-80a53d2c5662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:05:55.038067 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa37b054-5bdc-493f-ac2c-80a53d2c5662 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:55.042647 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69b8ea4-b9a4-4b51-b9b3-96b4df200f49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5652329c71cd431fb579d69cef933b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:55.043356 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69b8ea4-b9a4-4b51-b9b3-96b4df200f49 service neutron] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:55.043650 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69b8ea4-b9a4-4b51-b9b3-96b4df200f49 service neutron] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:55.044040 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69b8ea4-b9a4-4b51-b9b3-96b4df200f49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:55.054134 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-c97a60b2-3191-4cc0-a3ce-eb62b8bc0597 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6b1c08311384aa39ad01a8378c9a056'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:05:55.059935 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69b8ea4-b9a4-4b51-b9b3-96b4df200f49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:55.060567 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69b8ea4-b9a4-4b51-b9b3-96b4df200f49 service neutron] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:55.083188 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-c97a60b2-3191-4cc0-a3ce-eb62b8bc0597 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6b1c08311384aa39ad01a8378c9a056'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:05:55.113453 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1227/2442] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 14 18:05:54 2022] DELETE /identity/v3/users/e6b1c08311384aa39ad01a8378c9a056 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:05:55.127063 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1216/2443] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 18:05:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 18:05:55.729236 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97a60b2-3191-4cc0-a3ce-eb62b8bc0597 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:55.730838 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-c97a60b2-3191-4cc0-a3ce-eb62b8bc0597 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:05:55.828309 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97a60b2-3191-4cc0-a3ce-eb62b8bc0597 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:55.833665 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21019a95-8800-4579-a2ba-da0f053044a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:55.834583 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21019a95-8800-4579-a2ba-da0f053044a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:55.834956 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21019a95-8800-4579-a2ba-da0f053044a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:55.835319 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21019a95-8800-4579-a2ba-da0f053044a4 admin admin] PATH_INFO: `/v3/projects/25f56991b4c14ffca55aca08105b04a4` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:55.836551 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21019a95-8800-4579-a2ba-da0f053044a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25f56991b4c14ffca55aca08105b04a4)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:55.838477 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21019a95-8800-4579-a2ba-da0f053044a4 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:55.931484 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69b8ea4-b9a4-4b51-b9b3-96b4df200f49 service neutron] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:55.940252 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-a69b8ea4-b9a4-4b51-b9b3-96b4df200f49 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:05:55.962843 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69b8ea4-b9a4-4b51-b9b3-96b4df200f49 service neutron] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:55.971247 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b45e298-bdcf-4f11-82f1-d6cc3b2ac88c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:55.973181 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b45e298-bdcf-4f11-82f1-d6cc3b2ac88c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:55.973477 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b45e298-bdcf-4f11-82f1-d6cc3b2ac88c admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:55.973763 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b45e298-bdcf-4f11-82f1-d6cc3b2ac88c admin admin] PATH_INFO: `/v3/projects/add35554d0514dc59890c61894593313` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:55.978783 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b45e298-bdcf-4f11-82f1-d6cc3b2ac88c admin admin] RBAC: Authorizing `identity:delete_project(project_id=add35554d0514dc59890c61894593313)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:55.980959 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b45e298-bdcf-4f11-82f1-d6cc3b2ac88c admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:56.020139 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:05:56.033731 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-21019a95-8800-4579-a2ba-da0f053044a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25f56991b4c14ffca55aca08105b04a4', 'request_id': 'req-21019a95-8800-4579-a2ba-da0f053044a4'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:05:56.132938 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-21019a95-8800-4579-a2ba-da0f053044a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25f56991b4c14ffca55aca08105b04a4', 'request_id': 'req-21019a95-8800-4579-a2ba-da0f053044a4'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:05:56.140311 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-21019a95-8800-4579-a2ba-da0f053044a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25f56991b4c14ffca55aca08105b04a4', 'request_id': 'req-21019a95-8800-4579-a2ba-da0f053044a4'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:05:56.141506 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-5b45e298-bdcf-4f11-82f1-d6cc3b2ac88c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'add35554d0514dc59890c61894593313', 'request_id': 'req-5b45e298-bdcf-4f11-82f1-d6cc3b2ac88c'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:05:56.154241 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-21019a95-8800-4579-a2ba-da0f053044a4 admin admin] The token cache is being invalidate because project 25f56991b4c14ffca55aca08105b04a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87019) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:05:56.154617 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-21019a95-8800-4579-a2ba-da0f053044a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:05:56.159358 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-21019a95-8800-4579-a2ba-da0f053044a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:05:56.159358 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1228/2444] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 14 18:05:55 2022] DELETE /identity/v3/projects/25f56991b4c14ffca55aca08105b04a4 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:05:56.163012 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38d8b7f-f6cc-4547-909c-352f7accc00a None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:56.163394 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38d8b7f-f6cc-4547-909c-352f7accc00a None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:56.163717 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38d8b7f-f6cc-4547-909c-352f7accc00a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:56.190333 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-d38d8b7f-f6cc-4547-909c-352f7accc00a None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:05:56.191702 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-d38d8b7f-f6cc-4547-909c-352f7accc00a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:05:56.239422 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-5b45e298-bdcf-4f11-82f1-d6cc3b2ac88c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'add35554d0514dc59890c61894593313', 'request_id': 'req-5b45e298-bdcf-4f11-82f1-d6cc3b2ac88c'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:05:56.248929 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-5b45e298-bdcf-4f11-82f1-d6cc3b2ac88c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'add35554d0514dc59890c61894593313', 'request_id': 'req-5b45e298-bdcf-4f11-82f1-d6cc3b2ac88c'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:05:56.289268 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1229/2445] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:05:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 18:05:56.290502 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-5b45e298-bdcf-4f11-82f1-d6cc3b2ac88c admin admin] The token cache is being invalidate because project add35554d0514dc59890c61894593313 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:05:56.290502 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-5b45e298-bdcf-4f11-82f1-d6cc3b2ac88c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:05:56.290502 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-5b45e298-bdcf-4f11-82f1-d6cc3b2ac88c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:05:56.295920 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef390b0b-6b17-479d-82a9-ae40f7914d67 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:56.295920 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef390b0b-6b17-479d-82a9-ae40f7914d67 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:56.295920 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef390b0b-6b17-479d-82a9-ae40f7914d67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:56.307903 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1217/2446] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 14 18:05:55 2022] DELETE /identity/v3/projects/add35554d0514dc59890c61894593313 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:05:56.312446 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b45e298-bdcf-4f11-82f1-d6cc3b2ac88c admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:56.322425 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-ef390b0b-6b17-479d-82a9-ae40f7914d67 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:05:56.324269 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-ef390b0b-6b17-479d-82a9-ae40f7914d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:05:56.325452 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-5b45e298-bdcf-4f11-82f1-d6cc3b2ac88c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:05:56.334025 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1230/2447] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:05:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:05:56.341121 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef390b0b-6b17-479d-82a9-ae40f7914d67 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:56.355837 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef390b0b-6b17-479d-82a9-ae40f7914d67 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:56.369813 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212a0eb4-e985-45ea-9ced-69bdf6401ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:56.371177 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212a0eb4-e985-45ea-9ced-69bdf6401ea7 admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:56.372417 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212a0eb4-e985-45ea-9ced-69bdf6401ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:56.373058 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212a0eb4-e985-45ea-9ced-69bdf6401ea7 admin admin] PATH_INFO: `/v3/domains` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:56.373743 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b45e298-bdcf-4f11-82f1-d6cc3b2ac88c admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:56.375838 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212a0eb4-e985-45ea-9ced-69bdf6401ea7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 18:05:56.376622 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212a0eb4-e985-45ea-9ced-69bdf6401ea7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:56.381507 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212a0eb4-e985-45ea-9ced-69bdf6401ea7 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:56.392336 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41d14ce-4030-4fea-9167-beaecf9f8b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:56.394190 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d14ce-4030-4fea-9167-beaecf9f8b46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:56.394855 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d14ce-4030-4fea-9167-beaecf9f8b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:56.395771 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d14ce-4030-4fea-9167-beaecf9f8b46 admin admin] PATH_INFO: `/v3/users/6560a5b74b59431cbe301726e1e6822b` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:56.400948 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41d14ce-4030-4fea-9167-beaecf9f8b46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6560a5b74b59431cbe301726e1e6822b)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:56.405260 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41d14ce-4030-4fea-9167-beaecf9f8b46 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:56.419820 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1231/2448] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 14 18:05:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 18:05:56.424974 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212a0eb4-e985-45ea-9ced-69bdf6401ea7 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:56.438620 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212a0eb4-e985-45ea-9ced-69bdf6401ea7 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:56.451608 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b0a179-cb01-40e7-b503-8f16a1bccc33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:56.452465 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b0a179-cb01-40e7-b503-8f16a1bccc33 admin admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:56.452949 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b0a179-cb01-40e7-b503-8f16a1bccc33 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:56.453249 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b0a179-cb01-40e7-b503-8f16a1bccc33 admin admin] PATH_INFO: `/v3/projects` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:56.460627 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b0a179-cb01-40e7-b503-8f16a1bccc33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:56.465883 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b0a179-cb01-40e7-b503-8f16a1bccc33 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:56.490921 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:05:56.605318 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1232/2449] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 14 18:05:56 2022] POST /identity/v3/projects => generated 357 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 18:05:56.610356 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b0a179-cb01-40e7-b503-8f16a1bccc33 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:56.702086 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b0a179-cb01-40e7-b503-8f16a1bccc33 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:56.705276 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430c1232-f2b3-4aa2-a520-c9f55f1e08c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:56.705969 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430c1232-f2b3-4aa2-a520-c9f55f1e08c7 admin admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:56.706255 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430c1232-f2b3-4aa2-a520-c9f55f1e08c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:56.706535 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430c1232-f2b3-4aa2-a520-c9f55f1e08c7 admin admin] PATH_INFO: `/v3/users` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:56.707259 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430c1232-f2b3-4aa2-a520-c9f55f1e08c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:56.709352 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430c1232-f2b3-4aa2-a520-c9f55f1e08c7 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:56.744597 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-c41d14ce-4030-4fea-9167-beaecf9f8b46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6560a5b74b59431cbe301726e1e6822b'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:05:56.745447 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-c41d14ce-4030-4fea-9167-beaecf9f8b46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6560a5b74b59431cbe301726e1e6822b'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:05:56.745960 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-c41d14ce-4030-4fea-9167-beaecf9f8b46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6560a5b74b59431cbe301726e1e6822b'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:05:56.836381 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-c41d14ce-4030-4fea-9167-beaecf9f8b46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6560a5b74b59431cbe301726e1e6822b'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:05:56.846015 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1233/2450] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 14 18:05:56 2022] POST /identity/v3/users => generated 279 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 18:05:56.846015 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430c1232-f2b3-4aa2-a520-c9f55f1e08c7 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:56.848065 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-430c1232-f2b3-4aa2-a520-c9f55f1e08c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:05:56.863351 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430c1232-f2b3-4aa2-a520-c9f55f1e08c7 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:56.880011 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174f16c7-14a9-4fb4-971a-926881869c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:56.880011 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174f16c7-14a9-4fb4-971a-926881869c5f admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:56.880011 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174f16c7-14a9-4fb4-971a-926881869c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:56.880011 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174f16c7-14a9-4fb4-971a-926881869c5f admin admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:56.880678 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174f16c7-14a9-4fb4-971a-926881869c5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:56.880678 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174f16c7-14a9-4fb4-971a-926881869c5f admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:56.881566 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-c41d14ce-4030-4fea-9167-beaecf9f8b46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6560a5b74b59431cbe301726e1e6822b'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:05:56.903788 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1234/2451] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 18:05:56 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 14 18:05:56.906279 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174f16c7-14a9-4fb4-971a-926881869c5f admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:56.916332 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1218/2452] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 14 18:05:56 2022] DELETE /identity/v3/users/6560a5b74b59431cbe301726e1e6822b => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:05:56.926703 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174f16c7-14a9-4fb4-971a-926881869c5f admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:57.046241 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0abeeb3-ed91-4b50-8b8d-3286f9cb097c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:57.047024 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0abeeb3-ed91-4b50-8b8d-3286f9cb097c admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:57.048085 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0abeeb3-ed91-4b50-8b8d-3286f9cb097c admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:57.049423 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0abeeb3-ed91-4b50-8b8d-3286f9cb097c admin admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:57.050190 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0abeeb3-ed91-4b50-8b8d-3286f9cb097c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:57.051901 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0abeeb3-ed91-4b50-8b8d-3286f9cb097c admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:57.064223 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1235/2453] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 18:05:56 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:05:57.069283 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41d14ce-4030-4fea-9167-beaecf9f8b46 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:57.114350 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41d14ce-4030-4fea-9167-beaecf9f8b46 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:57.131193 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e773dcd4-9535-4087-b4a8-37ce170ce0d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:57.138134 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e773dcd4-9535-4087-b4a8-37ce170ce0d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:57.138134 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e773dcd4-9535-4087-b4a8-37ce170ce0d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:57.138134 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e773dcd4-9535-4087-b4a8-37ce170ce0d4 admin admin] PATH_INFO: `/v3/projects/a34a6566f23042bdbcb4077a2c32cb35/users/e9825391e82f449cb659a3dfca0fd1ea/roles/9ee80134743f4c2b88525b04df2facba` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:57.165647 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e773dcd4-9535-4087-b4a8-37ce170ce0d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a34a6566f23042bdbcb4077a2c32cb35, user_id=e9825391e82f449cb659a3dfca0fd1ea, role_id=9ee80134743f4c2b88525b04df2facba)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:57.168587 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e773dcd4-9535-4087-b4a8-37ce170ce0d4 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:57.236132 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0abeeb3-ed91-4b50-8b8d-3286f9cb097c admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:57.242722 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-f0abeeb3-ed91-4b50-8b8d-3286f9cb097c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:05:57.258397 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0abeeb3-ed91-4b50-8b8d-3286f9cb097c admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:57.283041 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1219/2454] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 18:05:57 2022] PUT /identity/v3/projects/a34a6566f23042bdbcb4077a2c32cb35/users/e9825391e82f449cb659a3dfca0fd1ea/roles/9ee80134743f4c2b88525b04df2facba => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:05:57.283725 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e773dcd4-9535-4087-b4a8-37ce170ce0d4 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:57.287509 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-e773dcd4-9535-4087-b4a8-37ce170ce0d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:05:57.290388 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9cd0bd-b198-4a4b-b8e1-7a15cb609330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:57.290891 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9cd0bd-b198-4a4b-b8e1-7a15cb609330 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:57.291207 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9cd0bd-b198-4a4b-b8e1-7a15cb609330 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:57.291590 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9cd0bd-b198-4a4b-b8e1-7a15cb609330 admin admin] PATH_INFO: `/v3/projects/1517fde6e66f4c0585da0a378adfaa54` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:57.298574 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9cd0bd-b198-4a4b-b8e1-7a15cb609330 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1517fde6e66f4c0585da0a378adfaa54)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:57.301081 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9cd0bd-b198-4a4b-b8e1-7a15cb609330 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:57.377943 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e773dcd4-9535-4087-b4a8-37ce170ce0d4 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:57.382998 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c9211b-b7be-45dc-a91a-b5cb9f2ec10e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:57.383922 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c9211b-b7be-45dc-a91a-b5cb9f2ec10e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:57.384207 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c9211b-b7be-45dc-a91a-b5cb9f2ec10e admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:57.384483 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c9211b-b7be-45dc-a91a-b5cb9f2ec10e admin admin] PATH_INFO: `/v3/users/0b64d79cbd27413cb9d6064e7b9c88e7` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:57.385757 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c9211b-b7be-45dc-a91a-b5cb9f2ec10e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b64d79cbd27413cb9d6064e7b9c88e7)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:57.387790 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c9211b-b7be-45dc-a91a-b5cb9f2ec10e admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:57.443487 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-fc9cd0bd-b198-4a4b-b8e1-7a15cb609330 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1517fde6e66f4c0585da0a378adfaa54', 'request_id': 'req-fc9cd0bd-b198-4a4b-b8e1-7a15cb609330'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:05:57.580399 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:05:57.581652 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-fc9cd0bd-b198-4a4b-b8e1-7a15cb609330 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1517fde6e66f4c0585da0a378adfaa54', 'request_id': 'req-fc9cd0bd-b198-4a4b-b8e1-7a15cb609330'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:05:57.589666 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-fc9cd0bd-b198-4a4b-b8e1-7a15cb609330 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1517fde6e66f4c0585da0a378adfaa54', 'request_id': 'req-fc9cd0bd-b198-4a4b-b8e1-7a15cb609330'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:05:57.602112 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-fc9cd0bd-b198-4a4b-b8e1-7a15cb609330 admin admin] The token cache is being invalidate because project 1517fde6e66f4c0585da0a378adfaa54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87019) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:05:57.602415 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-fc9cd0bd-b198-4a4b-b8e1-7a15cb609330 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:05:57.603121 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-fc9cd0bd-b198-4a4b-b8e1-7a15cb609330 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:05:57.604854 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1236/2455] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 14 18:05:57 2022] DELETE /identity/v3/projects/1517fde6e66f4c0585da0a378adfaa54 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:05:57.608267 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7079e1-95d4-4d74-83ab-930ec24ac552 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:57.609667 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7079e1-95d4-4d74-83ab-930ec24ac552 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:57.618497 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7079e1-95d4-4d74-83ab-930ec24ac552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:57.643206 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-29c9211b-b7be-45dc-a91a-b5cb9f2ec10e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b64d79cbd27413cb9d6064e7b9c88e7'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:05:57.643961 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-29c9211b-b7be-45dc-a91a-b5cb9f2ec10e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b64d79cbd27413cb9d6064e7b9c88e7'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:05:57.644593 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-29c9211b-b7be-45dc-a91a-b5cb9f2ec10e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b64d79cbd27413cb9d6064e7b9c88e7'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:05:57.661607 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-1e7079e1-95d4-4d74-83ab-930ec24ac552 None None] MFA Rules not processed for user `e9825391e82f449cb659a3dfca0fd1ea`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:05:57.663832 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-1e7079e1-95d4-4d74-83ab-930ec24ac552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:05:57.765216 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-29c9211b-b7be-45dc-a91a-b5cb9f2ec10e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b64d79cbd27413cb9d6064e7b9c88e7'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:05:57.782287 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1237/2456] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:05:57 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:05:57.789288 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-29c9211b-b7be-45dc-a91a-b5cb9f2ec10e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b64d79cbd27413cb9d6064e7b9c88e7'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:05:57.789985 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7079e1-95d4-4d74-83ab-930ec24ac552 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:57.791606 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-1e7079e1-95d4-4d74-83ab-930ec24ac552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:05:57.834514 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1220/2457] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 14 18:05:57 2022] DELETE /identity/v3/users/0b64d79cbd27413cb9d6064e7b9c88e7 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:05:57.944919 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7079e1-95d4-4d74-83ab-930ec24ac552 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:58.012051 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf6ead3-801b-478b-a104-470b1a01d924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:58.012964 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf6ead3-801b-478b-a104-470b1a01d924 admin admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:58.013315 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf6ead3-801b-478b-a104-470b1a01d924 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:58.013568 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf6ead3-801b-478b-a104-470b1a01d924 admin admin] PATH_INFO: `/v3/projects` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:58.014433 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf6ead3-801b-478b-a104-470b1a01d924 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:58.016307 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf6ead3-801b-478b-a104-470b1a01d924 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:58.190696 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1238/2458] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 14 18:05:57 2022] POST /identity/v3/projects => generated 353 bytes in 401 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:05:58.196773 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c9211b-b7be-45dc-a91a-b5cb9f2ec10e admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:58.210867 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c9211b-b7be-45dc-a91a-b5cb9f2ec10e admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:58.228148 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf6ead3-801b-478b-a104-470b1a01d924 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:58.229960 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-2cf6ead3-801b-478b-a104-470b1a01d924 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:05:58.312723 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba33c237-57fe-43d9-aaed-2dfc41c4b90b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:58.315044 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba33c237-57fe-43d9-aaed-2dfc41c4b90b admin admin] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:58.315553 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba33c237-57fe-43d9-aaed-2dfc41c4b90b admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:58.316027 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba33c237-57fe-43d9-aaed-2dfc41c4b90b admin admin] PATH_INFO: `/v3/users` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:58.317260 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba33c237-57fe-43d9-aaed-2dfc41c4b90b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:58.320738 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba33c237-57fe-43d9-aaed-2dfc41c4b90b admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:58.337936 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf6ead3-801b-478b-a104-470b1a01d924 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:58.346716 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6429de36-0204-4bbf-93bf-65ad2a0e8b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:58.348151 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6429de36-0204-4bbf-93bf-65ad2a0e8b15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:58.348605 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6429de36-0204-4bbf-93bf-65ad2a0e8b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:58.349134 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6429de36-0204-4bbf-93bf-65ad2a0e8b15 admin admin] PATH_INFO: `/v3/projects/f61b2ba814064d7da5702f0f15d1ba0a` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:58.350847 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6429de36-0204-4bbf-93bf-65ad2a0e8b15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f61b2ba814064d7da5702f0f15d1ba0a)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:58.353476 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6429de36-0204-4bbf-93bf-65ad2a0e8b15 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:58.376043 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:DELETE=16,keystone:SELECT=81,keystone:INSERT=3 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:05:58.521121 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1221/2459] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 14 18:05:58 2022] POST /identity/v3/users => generated 283 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:05:58.525929 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba33c237-57fe-43d9-aaed-2dfc41c4b90b admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:58.537546 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba33c237-57fe-43d9-aaed-2dfc41c4b90b admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:58.544738 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19af9390-3638-44e2-bf29-95abd9b5eeea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:58.548677 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19af9390-3638-44e2-bf29-95abd9b5eeea admin admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:58.548677 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19af9390-3638-44e2-bf29-95abd9b5eeea admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:58.548677 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19af9390-3638-44e2-bf29-95abd9b5eeea admin admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:58.548677 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19af9390-3638-44e2-bf29-95abd9b5eeea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:58.550288 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19af9390-3638-44e2-bf29-95abd9b5eeea admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:58.574115 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1222/2460] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 18:05:58 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:05:58.577953 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19af9390-3638-44e2-bf29-95abd9b5eeea admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:58.594325 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-6429de36-0204-4bbf-93bf-65ad2a0e8b15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f61b2ba814064d7da5702f0f15d1ba0a', 'request_id': 'req-6429de36-0204-4bbf-93bf-65ad2a0e8b15'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:05:58.595378 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19af9390-3638-44e2-bf29-95abd9b5eeea admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:58.679327 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bdd007-dce2-46c9-bd34-ef7815305cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:58.680351 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bdd007-dce2-46c9-bd34-ef7815305cea admin admin] REQUEST_METHOD: `PUT` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:58.680639 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bdd007-dce2-46c9-bd34-ef7815305cea admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:58.680920 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bdd007-dce2-46c9-bd34-ef7815305cea admin admin] PATH_INFO: `/v3/projects/8ad5c06706764d3eaca45ba4921d5cb4/users/da21fedd5be74ec797abb9b1d2fa711e/roles/1348580877d04014bfdec4d866b98a74` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:58.701173 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bdd007-dce2-46c9-bd34-ef7815305cea admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ad5c06706764d3eaca45ba4921d5cb4, user_id=da21fedd5be74ec797abb9b1d2fa711e, role_id=1348580877d04014bfdec4d866b98a74)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:58.705219 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bdd007-dce2-46c9-bd34-ef7815305cea admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:58.733418 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-6429de36-0204-4bbf-93bf-65ad2a0e8b15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f61b2ba814064d7da5702f0f15d1ba0a', 'request_id': 'req-6429de36-0204-4bbf-93bf-65ad2a0e8b15'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:05:58.741458 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-6429de36-0204-4bbf-93bf-65ad2a0e8b15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f61b2ba814064d7da5702f0f15d1ba0a', 'request_id': 'req-6429de36-0204-4bbf-93bf-65ad2a0e8b15'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:05:58.754037 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-6429de36-0204-4bbf-93bf-65ad2a0e8b15 admin admin] The token cache is being invalidate because project f61b2ba814064d7da5702f0f15d1ba0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87019) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:05:58.754336 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-6429de36-0204-4bbf-93bf-65ad2a0e8b15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:05:58.755030 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-6429de36-0204-4bbf-93bf-65ad2a0e8b15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:05:58.756717 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1239/2461] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 14 18:05:58 2022] DELETE /identity/v3/projects/f61b2ba814064d7da5702f0f15d1ba0a => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:05:58.761533 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70fb05c-7fee-42a2-91d0-672625f74221 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:58.761835 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70fb05c-7fee-42a2-91d0-672625f74221 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:58.762123 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70fb05c-7fee-42a2-91d0-672625f74221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:58.781082 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-a70fb05c-7fee-42a2-91d0-672625f74221 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:05:58.782389 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-a70fb05c-7fee-42a2-91d0-672625f74221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:05:58.790658 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1240/2462] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:05:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 18:05:58.799761 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f5f644-99d5-445b-8577-53a53cbc7cb5 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:58.800055 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f5f644-99d5-445b-8577-53a53cbc7cb5 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:58.800340 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f5f644-99d5-445b-8577-53a53cbc7cb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:58.821567 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-05f5f644-99d5-445b-8577-53a53cbc7cb5 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:05:58.823611 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1223/2463] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 18:05:58 2022] PUT /identity/v3/projects/8ad5c06706764d3eaca45ba4921d5cb4/users/da21fedd5be74ec797abb9b1d2fa711e/roles/1348580877d04014bfdec4d866b98a74 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:05:58.823811 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-05f5f644-99d5-445b-8577-53a53cbc7cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:05:58.828091 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bdd007-dce2-46c9-bd34-ef7815305cea admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:58.830800 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-16bdd007-dce2-46c9-bd34-ef7815305cea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:05:58.944123 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bdd007-dce2-46c9-bd34-ef7815305cea admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:58.949730 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1241/2464] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:05:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 18:05:58.950580 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2050373c-328c-41d3-9c52-bb65a63310ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:58.952026 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2050373c-328c-41d3-9c52-bb65a63310ee admin admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:58.957178 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2050373c-328c-41d3-9c52-bb65a63310ee admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:58.957178 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2050373c-328c-41d3-9c52-bb65a63310ee admin admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:58.957178 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2050373c-328c-41d3-9c52-bb65a63310ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:58.959333 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2050373c-328c-41d3-9c52-bb65a63310ee admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:58.960962 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f5f644-99d5-445b-8577-53a53cbc7cb5 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:58.974201 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f5f644-99d5-445b-8577-53a53cbc7cb5 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:58.988852 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41696fbe-9dca-4c86-a8f4-4f103651db7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:58.990233 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41696fbe-9dca-4c86-a8f4-4f103651db7f admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:58.990534 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41696fbe-9dca-4c86-a8f4-4f103651db7f admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:58.990877 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41696fbe-9dca-4c86-a8f4-4f103651db7f admin admin] PATH_INFO: `/v3/domains` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:58.991712 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41696fbe-9dca-4c86-a8f4-4f103651db7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 18:05:58.992083 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41696fbe-9dca-4c86-a8f4-4f103651db7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:58.993990 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41696fbe-9dca-4c86-a8f4-4f103651db7f admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:59.010971 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1224/2465] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 18:05:58 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 14 18:05:59.013696 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2050373c-328c-41d3-9c52-bb65a63310ee admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:59.021567 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1242/2466] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 14 18:05:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 18:05:59.031037 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2050373c-328c-41d3-9c52-bb65a63310ee admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:59.036364 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41696fbe-9dca-4c86-a8f4-4f103651db7f admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:59.054561 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4b7f72-a5bc-4ddb-9244-e5638c260425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:59.056224 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4b7f72-a5bc-4ddb-9244-e5638c260425 admin admin] REQUEST_METHOD: `PUT` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:59.056573 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4b7f72-a5bc-4ddb-9244-e5638c260425 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:59.056870 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4b7f72-a5bc-4ddb-9244-e5638c260425 admin admin] PATH_INFO: `/v3/projects/8ad5c06706764d3eaca45ba4921d5cb4/users/da21fedd5be74ec797abb9b1d2fa711e/roles/1348580877d04014bfdec4d866b98a74` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:59.057623 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41696fbe-9dca-4c86-a8f4-4f103651db7f admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:59.064162 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4b7f72-a5bc-4ddb-9244-e5638c260425 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ad5c06706764d3eaca45ba4921d5cb4, user_id=da21fedd5be74ec797abb9b1d2fa711e, role_id=1348580877d04014bfdec4d866b98a74)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:59.068238 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4b7f72-a5bc-4ddb-9244-e5638c260425 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:59.075400 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a688744-b4ee-4aaf-8dfb-793de45a4aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:59.076903 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a688744-b4ee-4aaf-8dfb-793de45a4aa9 admin admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:59.077545 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a688744-b4ee-4aaf-8dfb-793de45a4aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:59.078297 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a688744-b4ee-4aaf-8dfb-793de45a4aa9 admin admin] PATH_INFO: `/v3/projects` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:59.080399 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a688744-b4ee-4aaf-8dfb-793de45a4aa9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:59.085201 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1225/2467] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 18:05:59 2022] PUT /identity/v3/projects/8ad5c06706764d3eaca45ba4921d5cb4/users/da21fedd5be74ec797abb9b1d2fa711e/roles/1348580877d04014bfdec4d866b98a74 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:05:59.085988 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a688744-b4ee-4aaf-8dfb-793de45a4aa9 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:59.096297 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df18def0-92cf-4d50-ad39-76fc2cc70d57 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:59.096632 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df18def0-92cf-4d50-ad39-76fc2cc70d57 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:59.096868 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df18def0-92cf-4d50-ad39-76fc2cc70d57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:59.137834 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:05:59.143261 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-df18def0-92cf-4d50-ad39-76fc2cc70d57 None None] MFA Rules not processed for user `da21fedd5be74ec797abb9b1d2fa711e`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:05:59.147902 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-df18def0-92cf-4d50-ad39-76fc2cc70d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:05:59.244550 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1226/2468] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:05:59 2022] POST /identity/v3/auth/tokens => generated 3287 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 18:05:59.249979 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1243/2469] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 14 18:05:59 2022] POST /identity/v3/projects => generated 367 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 18:05:59.252876 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a688744-b4ee-4aaf-8dfb-793de45a4aa9 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:59.263341 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df18def0-92cf-4d50-ad39-76fc2cc70d57 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:59.267364 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-df18def0-92cf-4d50-ad39-76fc2cc70d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:05:59.361639 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df18def0-92cf-4d50-ad39-76fc2cc70d57 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:59.369764 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a688744-b4ee-4aaf-8dfb-793de45a4aa9 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:59.375041 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ad087b-9587-451b-9635-b5d6543e927d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:59.376201 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ad087b-9587-451b-9635-b5d6543e927d admin admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:59.376706 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ad087b-9587-451b-9635-b5d6543e927d admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:59.377232 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ad087b-9587-451b-9635-b5d6543e927d admin admin] PATH_INFO: `/v3/users` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:59.378170 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ad087b-9587-451b-9635-b5d6543e927d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:59.380198 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ad087b-9587-451b-9635-b5d6543e927d admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:59.418745 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a28a919-60f8-47ec-84e7-d37203ed0307 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17945e7d72954b8787e0ba09a9903247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:59.419726 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a28a919-60f8-47ec-84e7-d37203ed0307 service cinder] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:59.420099 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a28a919-60f8-47ec-84e7-d37203ed0307 service cinder] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:59.420479 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a28a919-60f8-47ec-84e7-d37203ed0307 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:59.454477 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:DELETE=1,keystone:SELECT=95,keystone:INSERT=4 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:05:59.510035 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a28a919-60f8-47ec-84e7-d37203ed0307 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:59.511565 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a28a919-60f8-47ec-84e7-d37203ed0307 service cinder] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:59.531054 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1244/2470] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 14 18:05:59 2022] POST /identity/v3/users => generated 284 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:05:59.532596 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1227/2471] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 18:05:59 2022] GET /identity/v3/auth/tokens => generated 3287 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 18:05:59.534416 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ad087b-9587-451b-9635-b5d6543e927d admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:59.555070 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ad087b-9587-451b-9635-b5d6543e927d admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:59.562942 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74313c35-eb9e-402e-a377-3e16d659bcbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:59.564976 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74313c35-eb9e-402e-a377-3e16d659bcbd admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:59.565165 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74313c35-eb9e-402e-a377-3e16d659bcbd admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:59.565473 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74313c35-eb9e-402e-a377-3e16d659bcbd admin admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:59.566433 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74313c35-eb9e-402e-a377-3e16d659bcbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:59.568443 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74313c35-eb9e-402e-a377-3e16d659bcbd admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:59.581430 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1245/2472] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 18:05:59 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:05:59.585521 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a28a919-60f8-47ec-84e7-d37203ed0307 service cinder] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:59.597854 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a28a919-60f8-47ec-84e7-d37203ed0307 service cinder] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:59.603200 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77223249-ce23-47c4-a4f5-d2790a8d96b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:59.603830 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77223249-ce23-47c4-a4f5-d2790a8d96b9 admin admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:59.604117 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77223249-ce23-47c4-a4f5-d2790a8d96b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:59.604400 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77223249-ce23-47c4-a4f5-d2790a8d96b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:59.605145 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77223249-ce23-47c4-a4f5-d2790a8d96b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:59.606852 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77223249-ce23-47c4-a4f5-d2790a8d96b9 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:59.618836 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1228/2473] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 18:05:59 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:05:59.627955 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74313c35-eb9e-402e-a377-3e16d659bcbd admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:59.635531 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74313c35-eb9e-402e-a377-3e16d659bcbd admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:59.641560 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623944d7-d9d1-4fcb-966e-fd9c9926a456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:59.642495 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623944d7-d9d1-4fcb-966e-fd9c9926a456 admin admin] REQUEST_METHOD: `PUT` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:59.642782 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623944d7-d9d1-4fcb-966e-fd9c9926a456 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:59.643069 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623944d7-d9d1-4fcb-966e-fd9c9926a456 admin admin] PATH_INFO: `/v3/projects/4beb2a5b15b440a699f11f2f83e02f4b/users/192aa2e17bee4fe4b2bc9cb9cce64833/roles/9ee80134743f4c2b88525b04df2facba` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:59.661803 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623944d7-d9d1-4fcb-966e-fd9c9926a456 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4beb2a5b15b440a699f11f2f83e02f4b, user_id=192aa2e17bee4fe4b2bc9cb9cce64833, role_id=9ee80134743f4c2b88525b04df2facba)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:59.664530 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623944d7-d9d1-4fcb-966e-fd9c9926a456 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:59.699499 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:05:59.796460 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ca1622-ef72-44b6-b15c-9ed8e7835430 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:59.796782 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ca1622-ef72-44b6-b15c-9ed8e7835430 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:59.797069 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ca1622-ef72-44b6-b15c-9ed8e7835430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:59.800936 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1246/2474] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 18:05:59 2022] PUT /identity/v3/projects/4beb2a5b15b440a699f11f2f83e02f4b/users/192aa2e17bee4fe4b2bc9cb9cce64833/roles/9ee80134743f4c2b88525b04df2facba => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:05:59.804019 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623944d7-d9d1-4fcb-966e-fd9c9926a456 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:59.849033 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-70ca1622-ef72-44b6-b15c-9ed8e7835430 None None] MFA Rules not processed for user `192aa2e17bee4fe4b2bc9cb9cce64833`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:05:59.850267 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-70ca1622-ef72-44b6-b15c-9ed8e7835430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:05:59.874000 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623944d7-d9d1-4fcb-966e-fd9c9926a456 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:59.879994 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a833c7ce-68fb-48fe-b1b8-628ed22abb3f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17945e7d72954b8787e0ba09a9903247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:59.880672 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a833c7ce-68fb-48fe-b1b8-628ed22abb3f service cinder] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:59.880880 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a833c7ce-68fb-48fe-b1b8-628ed22abb3f service cinder] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:59.881165 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a833c7ce-68fb-48fe-b1b8-628ed22abb3f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:59.883472 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-a833c7ce-68fb-48fe-b1b8-628ed22abb3f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:05:59.931440 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:05:59.943616 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1229/2475] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:05:59 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 18:05:59.948551 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ca1622-ef72-44b6-b15c-9ed8e7835430 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:59.977897 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a833c7ce-68fb-48fe-b1b8-628ed22abb3f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:59.979407 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a833c7ce-68fb-48fe-b1b8-628ed22abb3f service cinder] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:59.991034 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1247/2476] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 18:05:59 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 18:06:00.024348 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ca1622-ef72-44b6-b15c-9ed8e7835430 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:00.030921 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be317b4a-1c6e-4ba1-b469-590993879232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:00.032745 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be317b4a-1c6e-4ba1-b469-590993879232 admin admin] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:00.033104 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be317b4a-1c6e-4ba1-b469-590993879232 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:00.033405 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be317b4a-1c6e-4ba1-b469-590993879232 admin admin] PATH_INFO: `/v3/projects` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:00.043538 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be317b4a-1c6e-4ba1-b469-590993879232 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:00.043538 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be317b4a-1c6e-4ba1-b469-590993879232 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:00.166195 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1230/2477] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 14 18:05:59 2022] POST /identity/v3/projects => generated 369 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 18:06:00.170046 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a833c7ce-68fb-48fe-b1b8-628ed22abb3f service cinder] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:00.182133 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a833c7ce-68fb-48fe-b1b8-628ed22abb3f service cinder] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:00.259564 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d6bb3a-f5d1-4f71-b873-6e633a233817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:00.260262 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d6bb3a-f5d1-4f71-b873-6e633a233817 admin admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:00.260622 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d6bb3a-f5d1-4f71-b873-6e633a233817 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:00.260915 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d6bb3a-f5d1-4f71-b873-6e633a233817 admin admin] PATH_INFO: `/v3/users` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:00.261161 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be317b4a-1c6e-4ba1-b469-590993879232 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:00.262098 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d6bb3a-f5d1-4f71-b873-6e633a233817 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:00.264908 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d6bb3a-f5d1-4f71-b873-6e633a233817 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:00.265541 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-be317b4a-1c6e-4ba1-b469-590993879232 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:00.277304 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:INSERT=5,keystone:DELETE=3,keystone:SELECT=92 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:06:00.303348 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be317b4a-1c6e-4ba1-b469-590993879232 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:00.315133 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2185109-c8b3-4bb3-abe8-d29e848a7865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:00.316121 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2185109-c8b3-4bb3-abe8-d29e848a7865 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:00.316436 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2185109-c8b3-4bb3-abe8-d29e848a7865 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:00.316777 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2185109-c8b3-4bb3-abe8-d29e848a7865 admin admin] PATH_INFO: `/v3/users/c8db643765b84544a166155635213288` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:00.318075 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2185109-c8b3-4bb3-abe8-d29e848a7865 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8db643765b84544a166155635213288)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:00.320107 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2185109-c8b3-4bb3-abe8-d29e848a7865 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:00.378442 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1248/2478] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 14 18:06:00 2022] POST /identity/v3/users => generated 291 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:06:00.383099 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d6bb3a-f5d1-4f71-b873-6e633a233817 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:00.400262 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d6bb3a-f5d1-4f71-b873-6e633a233817 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:00.406208 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ae0038-9d30-4145-b7ef-a2f113fc6ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:00.407717 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ae0038-9d30-4145-b7ef-a2f113fc6ee8 admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:00.408195 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ae0038-9d30-4145-b7ef-a2f113fc6ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:00.408485 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ae0038-9d30-4145-b7ef-a2f113fc6ee8 admin admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:00.409323 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ae0038-9d30-4145-b7ef-a2f113fc6ee8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:00.410948 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ae0038-9d30-4145-b7ef-a2f113fc6ee8 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:00.423625 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1249/2479] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 18:06:00 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 14 18:06:00.428407 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ae0038-9d30-4145-b7ef-a2f113fc6ee8 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:00.439950 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ae0038-9d30-4145-b7ef-a2f113fc6ee8 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:00.445186 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f8c85e-15b5-432f-8f6b-72436cdcea3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:00.446147 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f8c85e-15b5-432f-8f6b-72436cdcea3b admin admin] REQUEST_METHOD: `PUT` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:00.446498 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f8c85e-15b5-432f-8f6b-72436cdcea3b admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:00.446823 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f8c85e-15b5-432f-8f6b-72436cdcea3b admin admin] PATH_INFO: `/v3/projects/0a3b2b0e44f24fe087c1fab5fc5cd258/users/c0c500b78d88466a9f0b09ba2874f8f7/roles/1348580877d04014bfdec4d866b98a74` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:00.465253 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f8c85e-15b5-432f-8f6b-72436cdcea3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a3b2b0e44f24fe087c1fab5fc5cd258, user_id=c0c500b78d88466a9f0b09ba2874f8f7, role_id=1348580877d04014bfdec4d866b98a74)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:00.468259 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f8c85e-15b5-432f-8f6b-72436cdcea3b admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:00.583953 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-f2185109-c8b3-4bb3-abe8-d29e848a7865 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8db643765b84544a166155635213288'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:00.584620 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-f2185109-c8b3-4bb3-abe8-d29e848a7865 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8db643765b84544a166155635213288'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:00.585245 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-f2185109-c8b3-4bb3-abe8-d29e848a7865 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8db643765b84544a166155635213288'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:00.599871 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:06:00.705807 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-f2185109-c8b3-4bb3-abe8-d29e848a7865 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8db643765b84544a166155635213288'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:00.713656 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1250/2480] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 18:06:00 2022] PUT /identity/v3/projects/0a3b2b0e44f24fe087c1fab5fc5cd258/users/c0c500b78d88466a9f0b09ba2874f8f7/roles/1348580877d04014bfdec4d866b98a74 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 18:06:00.716083 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-f2185109-c8b3-4bb3-abe8-d29e848a7865 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8db643765b84544a166155635213288'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:00.717599 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f8c85e-15b5-432f-8f6b-72436cdcea3b admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:00.719591 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-96f8c85e-15b5-432f-8f6b-72436cdcea3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:00.752923 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1231/2481] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 14 18:06:00 2022] DELETE /identity/v3/users/c8db643765b84544a166155635213288 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:06:00.824154 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f8c85e-15b5-432f-8f6b-72436cdcea3b admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:00.897688 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446fdd43-1bf7-4df9-aa33-4b37d77808e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:00.898610 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446fdd43-1bf7-4df9-aa33-4b37d77808e7 admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:00.898730 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446fdd43-1bf7-4df9-aa33-4b37d77808e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:00.899011 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446fdd43-1bf7-4df9-aa33-4b37d77808e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:00.903395 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446fdd43-1bf7-4df9-aa33-4b37d77808e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:00.903395 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446fdd43-1bf7-4df9-aa33-4b37d77808e7 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:00.914461 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1251/2482] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 18:06:00 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:06:00.918667 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2185109-c8b3-4bb3-abe8-d29e848a7865 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:00.930099 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2185109-c8b3-4bb3-abe8-d29e848a7865 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:00.935202 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabe0cfc-f385-4110-8b89-631ff046234d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:00.936213 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabe0cfc-f385-4110-8b89-631ff046234d admin admin] REQUEST_METHOD: `PUT` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:00.936716 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabe0cfc-f385-4110-8b89-631ff046234d admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:00.937006 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabe0cfc-f385-4110-8b89-631ff046234d admin admin] PATH_INFO: `/v3/projects/0a3b2b0e44f24fe087c1fab5fc5cd258/users/c0c500b78d88466a9f0b09ba2874f8f7/roles/1348580877d04014bfdec4d866b98a74` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:00.939933 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabe0cfc-f385-4110-8b89-631ff046234d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a3b2b0e44f24fe087c1fab5fc5cd258, user_id=c0c500b78d88466a9f0b09ba2874f8f7, role_id=1348580877d04014bfdec4d866b98a74)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:00.942795 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabe0cfc-f385-4110-8b89-631ff046234d admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:00.956633 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1232/2483] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 18:06:00 2022] PUT /identity/v3/projects/0a3b2b0e44f24fe087c1fab5fc5cd258/users/c0c500b78d88466a9f0b09ba2874f8f7/roles/1348580877d04014bfdec4d866b98a74 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 18:06:00.968089 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d45855-3fb1-4f14-8c4a-d056ee6626c9 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:00.968602 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d45855-3fb1-4f14-8c4a-d056ee6626c9 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:00.969130 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d45855-3fb1-4f14-8c4a-d056ee6626c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:01.006122 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-45d45855-3fb1-4f14-8c4a-d056ee6626c9 None None] MFA Rules not processed for user `c0c500b78d88466a9f0b09ba2874f8f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:06:01.007664 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-45d45855-3fb1-4f14-8c4a-d056ee6626c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:01.085154 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1252/2484] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:06:00 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:06:01.095678 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabe0cfc-f385-4110-8b89-631ff046234d admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:01.097849 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-fabe0cfc-f385-4110-8b89-631ff046234d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:01.115581 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d45855-3fb1-4f14-8c4a-d056ee6626c9 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:01.116877 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-45d45855-3fb1-4f14-8c4a-d056ee6626c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:01.189633 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabe0cfc-f385-4110-8b89-631ff046234d admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:01.195192 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81193a78-2c80-48b5-a2e1-47d1aa3d883b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17945e7d72954b8787e0ba09a9903247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:01.195956 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81193a78-2c80-48b5-a2e1-47d1aa3d883b service cinder] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:01.196249 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81193a78-2c80-48b5-a2e1-47d1aa3d883b service cinder] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:01.196540 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81193a78-2c80-48b5-a2e1-47d1aa3d883b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:01.203132 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d45855-3fb1-4f14-8c4a-d056ee6626c9 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:01.207444 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81193a78-2c80-48b5-a2e1-47d1aa3d883b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:01.208745 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41f8107-98a0-4561-b08b-2416c7dd8262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:01.208911 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81193a78-2c80-48b5-a2e1-47d1aa3d883b service cinder] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:01.209650 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41f8107-98a0-4561-b08b-2416c7dd8262 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:01.209936 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41f8107-98a0-4561-b08b-2416c7dd8262 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:01.210213 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41f8107-98a0-4561-b08b-2416c7dd8262 admin admin] PATH_INFO: `/v3/projects/97bb461a166d449d8866a2136dfdb1fa` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:01.211523 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41f8107-98a0-4561-b08b-2416c7dd8262 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97bb461a166d449d8866a2136dfdb1fa)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:01.213469 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41f8107-98a0-4561-b08b-2416c7dd8262 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:01.223263 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1233/2485] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 18:06:01 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 18:06:01.341283 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81193a78-2c80-48b5-a2e1-47d1aa3d883b service cinder] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:01.343113 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-81193a78-2c80-48b5-a2e1-47d1aa3d883b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:01.358507 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81193a78-2c80-48b5-a2e1-47d1aa3d883b service cinder] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:01.364505 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee165c2e-54ae-435d-83fa-2405c6111fbc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17945e7d72954b8787e0ba09a9903247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:01.365510 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee165c2e-54ae-435d-83fa-2405c6111fbc service cinder] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:01.366007 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee165c2e-54ae-435d-83fa-2405c6111fbc service cinder] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:01.366491 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee165c2e-54ae-435d-83fa-2405c6111fbc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:01.369953 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-ee165c2e-54ae-435d-83fa-2405c6111fbc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:01.401810 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-c41f8107-98a0-4561-b08b-2416c7dd8262 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97bb461a166d449d8866a2136dfdb1fa', 'request_id': 'req-c41f8107-98a0-4561-b08b-2416c7dd8262'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:01.463026 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee165c2e-54ae-435d-83fa-2405c6111fbc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:01.465503 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee165c2e-54ae-435d-83fa-2405c6111fbc service cinder] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:01.481970 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1234/2486] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 18:06:01 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 18:06:01.496357 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-c41f8107-98a0-4561-b08b-2416c7dd8262 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97bb461a166d449d8866a2136dfdb1fa', 'request_id': 'req-c41f8107-98a0-4561-b08b-2416c7dd8262'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:01.509471 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-c41f8107-98a0-4561-b08b-2416c7dd8262 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97bb461a166d449d8866a2136dfdb1fa', 'request_id': 'req-c41f8107-98a0-4561-b08b-2416c7dd8262'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:01.529877 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-c41f8107-98a0-4561-b08b-2416c7dd8262 admin admin] The token cache is being invalidate because project 97bb461a166d449d8866a2136dfdb1fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87019) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:06:01.530410 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-c41f8107-98a0-4561-b08b-2416c7dd8262 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:01.532160 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-c41f8107-98a0-4561-b08b-2416c7dd8262 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:01.535321 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1253/2487] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 14 18:06:01 2022] DELETE /identity/v3/projects/97bb461a166d449d8866a2136dfdb1fa => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:06:01.540557 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee165c2e-54ae-435d-83fa-2405c6111fbc service cinder] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:01.552836 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee165c2e-54ae-435d-83fa-2405c6111fbc service cinder] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:01.651043 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6fecee-147e-4c7c-87cb-3924d545ed4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:01.651043 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6fecee-147e-4c7c-87cb-3924d545ed4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:01.651043 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6fecee-147e-4c7c-87cb-3924d545ed4a admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:01.655357 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6fecee-147e-4c7c-87cb-3924d545ed4a admin admin] PATH_INFO: `/v3/users/8d31b57bde734db8808049144558fb3e` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:01.655357 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6fecee-147e-4c7c-87cb-3924d545ed4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d31b57bde734db8808049144558fb3e)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:01.655357 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6fecee-147e-4c7c-87cb-3924d545ed4a admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:01.839619 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:06:01.918050 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-3e6fecee-147e-4c7c-87cb-3924d545ed4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d31b57bde734db8808049144558fb3e'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:01.918729 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-3e6fecee-147e-4c7c-87cb-3924d545ed4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d31b57bde734db8808049144558fb3e'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:01.919454 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-3e6fecee-147e-4c7c-87cb-3924d545ed4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d31b57bde734db8808049144558fb3e'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:02.019072 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-3e6fecee-147e-4c7c-87cb-3924d545ed4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d31b57bde734db8808049144558fb3e'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:02.027524 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-3e6fecee-147e-4c7c-87cb-3924d545ed4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d31b57bde734db8808049144558fb3e'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:02.046460 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1235/2488] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 14 18:06:01 2022] DELETE /identity/v3/users/8d31b57bde734db8808049144558fb3e => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:06:02.310901 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:06:02.402150 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41f8107-98a0-4561-b08b-2416c7dd8262 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:02.403867 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-c41f8107-98a0-4561-b08b-2416c7dd8262 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:02.420262 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41f8107-98a0-4561-b08b-2416c7dd8262 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:02.488690 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af5cec1-90fa-4487-be73-9c924c2cab4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:02.489854 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af5cec1-90fa-4487-be73-9c924c2cab4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:02.490221 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af5cec1-90fa-4487-be73-9c924c2cab4b admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:02.490570 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af5cec1-90fa-4487-be73-9c924c2cab4b admin admin] PATH_INFO: `/v3/projects/a5be122a42fa4e1c818db280bda8131f` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:02.492021 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af5cec1-90fa-4487-be73-9c924c2cab4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5be122a42fa4e1c818db280bda8131f)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:02.493975 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af5cec1-90fa-4487-be73-9c924c2cab4b admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:02.554846 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6fecee-147e-4c7c-87cb-3924d545ed4a admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:02.556993 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-3e6fecee-147e-4c7c-87cb-3924d545ed4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:02.574023 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6fecee-147e-4c7c-87cb-3924d545ed4a admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:02.580409 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583e4ddc-4b2a-4ef8-b2c7-3c094aa29436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:02.581701 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583e4ddc-4b2a-4ef8-b2c7-3c094aa29436 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:02.582085 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583e4ddc-4b2a-4ef8-b2c7-3c094aa29436 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:02.582454 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583e4ddc-4b2a-4ef8-b2c7-3c094aa29436 admin admin] PATH_INFO: `/v3/users/59678ca5f10b440db03e76923977dcc3` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:02.584231 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583e4ddc-4b2a-4ef8-b2c7-3c094aa29436 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59678ca5f10b440db03e76923977dcc3)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:02.586704 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583e4ddc-4b2a-4ef8-b2c7-3c094aa29436 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:02.687592 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-3af5cec1-90fa-4487-be73-9c924c2cab4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5be122a42fa4e1c818db280bda8131f', 'request_id': 'req-3af5cec1-90fa-4487-be73-9c924c2cab4b'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:02.790655 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-3af5cec1-90fa-4487-be73-9c924c2cab4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5be122a42fa4e1c818db280bda8131f', 'request_id': 'req-3af5cec1-90fa-4487-be73-9c924c2cab4b'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:02.799372 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-3af5cec1-90fa-4487-be73-9c924c2cab4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5be122a42fa4e1c818db280bda8131f', 'request_id': 'req-3af5cec1-90fa-4487-be73-9c924c2cab4b'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:02.811899 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-3af5cec1-90fa-4487-be73-9c924c2cab4b admin admin] The token cache is being invalidate because project a5be122a42fa4e1c818db280bda8131f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87019) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:06:02.812247 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-3af5cec1-90fa-4487-be73-9c924c2cab4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:02.813034 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-3af5cec1-90fa-4487-be73-9c924c2cab4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:02.814836 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1254/2489] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 14 18:06:02 2022] DELETE /identity/v3/projects/a5be122a42fa4e1c818db280bda8131f => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:06:02.820584 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f7ad13-0f9d-4042-a95e-a968f7aab520 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:02.820872 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f7ad13-0f9d-4042-a95e-a968f7aab520 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:02.821151 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f7ad13-0f9d-4042-a95e-a968f7aab520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:02.841989 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-93f7ad13-0f9d-4042-a95e-a968f7aab520 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:06:02.843246 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-93f7ad13-0f9d-4042-a95e-a968f7aab520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:02.909700 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-583e4ddc-4b2a-4ef8-b2c7-3c094aa29436 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59678ca5f10b440db03e76923977dcc3'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:02.910304 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-583e4ddc-4b2a-4ef8-b2c7-3c094aa29436 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59678ca5f10b440db03e76923977dcc3'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:02.911401 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-583e4ddc-4b2a-4ef8-b2c7-3c094aa29436 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59678ca5f10b440db03e76923977dcc3'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:02.924987 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1255/2490] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:06:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 18:06:02.934459 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da30e6e-c101-4199-9ac4-6069afd75cab None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:02.936319 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da30e6e-c101-4199-9ac4-6069afd75cab None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:02.936319 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da30e6e-c101-4199-9ac4-6069afd75cab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:02.955323 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-3da30e6e-c101-4199-9ac4-6069afd75cab None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:06:02.956563 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-3da30e6e-c101-4199-9ac4-6069afd75cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:02.965218 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1256/2491] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:06:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 18:06:02.969662 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da30e6e-c101-4199-9ac4-6069afd75cab None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:02.978964 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da30e6e-c101-4199-9ac4-6069afd75cab None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:02.984065 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a080466-0f20-458d-9f27-0380e9b440ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:02.984775 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a080466-0f20-458d-9f27-0380e9b440ee admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:02.985765 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a080466-0f20-458d-9f27-0380e9b440ee admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:02.986075 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a080466-0f20-458d-9f27-0380e9b440ee admin admin] PATH_INFO: `/v3/domains` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:02.986811 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a080466-0f20-458d-9f27-0380e9b440ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 18:06:02.987127 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a080466-0f20-458d-9f27-0380e9b440ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:02.988775 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a080466-0f20-458d-9f27-0380e9b440ee admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:03.001728 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1257/2492] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 14 18:06:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 18:06:03.006091 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a080466-0f20-458d-9f27-0380e9b440ee admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:03.007004 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-583e4ddc-4b2a-4ef8-b2c7-3c094aa29436 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59678ca5f10b440db03e76923977dcc3'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:03.018220 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-583e4ddc-4b2a-4ef8-b2c7-3c094aa29436 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59678ca5f10b440db03e76923977dcc3'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:03.018348 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a080466-0f20-458d-9f27-0380e9b440ee admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:03.022440 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2240a642-323a-49d4-ab4b-41b48bab6d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:03.023114 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2240a642-323a-49d4-ab4b-41b48bab6d1a admin admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:03.023431 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2240a642-323a-49d4-ab4b-41b48bab6d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:03.023714 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2240a642-323a-49d4-ab4b-41b48bab6d1a admin admin] PATH_INFO: `/v3/projects` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:03.024417 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2240a642-323a-49d4-ab4b-41b48bab6d1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:03.026329 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2240a642-323a-49d4-ab4b-41b48bab6d1a admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:03.036670 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1236/2493] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 14 18:06:02 2022] DELETE /identity/v3/users/59678ca5f10b440db03e76923977dcc3 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 18:06:03.041063 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38e7e87-3ce1-42d2-8e7d-2d773ff41b00 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:03.041397 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38e7e87-3ce1-42d2-8e7d-2d773ff41b00 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:03.041644 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38e7e87-3ce1-42d2-8e7d-2d773ff41b00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:03.059800 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-e38e7e87-3ce1-42d2-8e7d-2d773ff41b00 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:06:03.061060 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-e38e7e87-3ce1-42d2-8e7d-2d773ff41b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:03.116406 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1258/2494] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 14 18:06:03 2022] POST /identity/v3/projects => generated 369 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 18:06:03.120942 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2240a642-323a-49d4-ab4b-41b48bab6d1a admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:03.128520 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:06:03.144331 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1237/2495] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:06:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 18:06:03.151288 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38e7e87-3ce1-42d2-8e7d-2d773ff41b00 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:03.152897 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-e38e7e87-3ce1-42d2-8e7d-2d773ff41b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:03.197083 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2240a642-323a-49d4-ab4b-41b48bab6d1a admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:03.202728 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c2226e-2fb7-4294-9ae8-515102aaedc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:03.204006 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c2226e-2fb7-4294-9ae8-515102aaedc3 admin admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:03.204351 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c2226e-2fb7-4294-9ae8-515102aaedc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:03.204919 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c2226e-2fb7-4294-9ae8-515102aaedc3 admin admin] PATH_INFO: `/v3/users` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:03.205351 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c2226e-2fb7-4294-9ae8-515102aaedc3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:03.207483 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c2226e-2fb7-4294-9ae8-515102aaedc3 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:03.217248 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38e7e87-3ce1-42d2-8e7d-2d773ff41b00 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:03.272859 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a075a34-f5e4-41f4-9f57-0d11a0d83046 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5652329c71cd431fb579d69cef933b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:03.274411 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a075a34-f5e4-41f4-9f57-0d11a0d83046 service neutron] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:03.275645 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a075a34-f5e4-41f4-9f57-0d11a0d83046 service neutron] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:03.275944 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a075a34-f5e4-41f4-9f57-0d11a0d83046 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:03.290206 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a075a34-f5e4-41f4-9f57-0d11a0d83046 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:03.292009 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a075a34-f5e4-41f4-9f57-0d11a0d83046 service neutron] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:03.303650 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1238/2496] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 18:06:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 18:06:03.379520 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1259/2497] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 14 18:06:03 2022] POST /identity/v3/users => generated 285 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 18:06:03.382786 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a075a34-f5e4-41f4-9f57-0d11a0d83046 service neutron] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:03.397607 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a075a34-f5e4-41f4-9f57-0d11a0d83046 service neutron] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:03.403220 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3208837b-da1b-48a9-a444-aafa270d74f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:03.404802 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3208837b-da1b-48a9-a444-aafa270d74f6 admin admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:03.404802 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3208837b-da1b-48a9-a444-aafa270d74f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:03.404802 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3208837b-da1b-48a9-a444-aafa270d74f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:03.405270 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3208837b-da1b-48a9-a444-aafa270d74f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:03.407586 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3208837b-da1b-48a9-a444-aafa270d74f6 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:03.419148 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1239/2498] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 18:06:03 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:06:03.423766 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c2226e-2fb7-4294-9ae8-515102aaedc3 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:03.435029 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c2226e-2fb7-4294-9ae8-515102aaedc3 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:03.440889 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4f2678-e7fc-4db7-bb2a-b581714a6a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:03.441569 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4f2678-e7fc-4db7-bb2a-b581714a6a75 admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:03.441862 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4f2678-e7fc-4db7-bb2a-b581714a6a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:03.442148 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4f2678-e7fc-4db7-bb2a-b581714a6a75 admin admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:03.442887 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4f2678-e7fc-4db7-bb2a-b581714a6a75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:03.444529 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4f2678-e7fc-4db7-bb2a-b581714a6a75 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:03.455580 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1260/2499] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 18:06:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 14 18:06:03.459982 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3208837b-da1b-48a9-a444-aafa270d74f6 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:03.471566 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3208837b-da1b-48a9-a444-aafa270d74f6 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:03.477624 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735e25b4-b2a0-4778-9eaa-d09ac351ea49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:03.479092 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735e25b4-b2a0-4778-9eaa-d09ac351ea49 admin admin] REQUEST_METHOD: `PUT` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:03.479627 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735e25b4-b2a0-4778-9eaa-d09ac351ea49 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:03.480117 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735e25b4-b2a0-4778-9eaa-d09ac351ea49 admin admin] PATH_INFO: `/v3/projects/2bafbede00fa4f3f8422c4556939ac02/users/7e1fbce6fdcc4bfda85bf3b9dd50eae7/roles/9ee80134743f4c2b88525b04df2facba` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:03.498136 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735e25b4-b2a0-4778-9eaa-d09ac351ea49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bafbede00fa4f3f8422c4556939ac02, user_id=7e1fbce6fdcc4bfda85bf3b9dd50eae7, role_id=9ee80134743f4c2b88525b04df2facba)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:03.501707 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735e25b4-b2a0-4778-9eaa-d09ac351ea49 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:03.636557 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:06:03.648326 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1240/2500] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 18:06:03 2022] PUT /identity/v3/projects/2bafbede00fa4f3f8422c4556939ac02/users/7e1fbce6fdcc4bfda85bf3b9dd50eae7/roles/9ee80134743f4c2b88525b04df2facba => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:06:03.660505 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4ecc4c-2b45-4f59-b4c8-f42d717b1b1b None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:03.661046 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4ecc4c-2b45-4f59-b4c8-f42d717b1b1b None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:03.661396 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4ecc4c-2b45-4f59-b4c8-f42d717b1b1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:03.690860 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-5f4ecc4c-2b45-4f59-b4c8-f42d717b1b1b None None] MFA Rules not processed for user `7e1fbce6fdcc4bfda85bf3b9dd50eae7`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:06:03.692405 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-5f4ecc4c-2b45-4f59-b4c8-f42d717b1b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:03.780001 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1261/2501] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:06:03 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:06:03.790800 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735e25b4-b2a0-4778-9eaa-d09ac351ea49 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:03.792596 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-735e25b4-b2a0-4778-9eaa-d09ac351ea49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:03.863458 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735e25b4-b2a0-4778-9eaa-d09ac351ea49 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:03.868465 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c83aee-061b-436c-ba2b-482f0a5513e5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359f5ed4eb684e769f552484ca9a34c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:03.869287 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c83aee-061b-436c-ba2b-482f0a5513e5 service glance] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:03.869615 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c83aee-061b-436c-ba2b-482f0a5513e5 service glance] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:03.869970 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c83aee-061b-436c-ba2b-482f0a5513e5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:03.881504 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c83aee-061b-436c-ba2b-482f0a5513e5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:03.883603 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c83aee-061b-436c-ba2b-482f0a5513e5 service glance] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:03.899358 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1241/2502] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 18:06:03 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 18:06:04.290981 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4ecc4c-2b45-4f59-b4c8-f42d717b1b1b None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:04.292239 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-5f4ecc4c-2b45-4f59-b4c8-f42d717b1b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:04.384970 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4ecc4c-2b45-4f59-b4c8-f42d717b1b1b None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:04.393988 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a8210e-bdb5-498e-a27f-5eb9095708c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:04.395207 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a8210e-bdb5-498e-a27f-5eb9095708c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:04.395581 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a8210e-bdb5-498e-a27f-5eb9095708c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:04.395900 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a8210e-bdb5-498e-a27f-5eb9095708c7 admin admin] PATH_INFO: `/v3/projects/08d175b9a23f4eedb5a45ac5fb9f4483` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:04.397341 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a8210e-bdb5-498e-a27f-5eb9095708c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08d175b9a23f4eedb5a45ac5fb9f4483)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:04.399349 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a8210e-bdb5-498e-a27f-5eb9095708c7 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:04.594395 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:06:04.633907 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-03a8210e-bdb5-498e-a27f-5eb9095708c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08d175b9a23f4eedb5a45ac5fb9f4483', 'request_id': 'req-03a8210e-bdb5-498e-a27f-5eb9095708c7'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:04.846100 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-03a8210e-bdb5-498e-a27f-5eb9095708c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08d175b9a23f4eedb5a45ac5fb9f4483', 'request_id': 'req-03a8210e-bdb5-498e-a27f-5eb9095708c7'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:04.853400 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-03a8210e-bdb5-498e-a27f-5eb9095708c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08d175b9a23f4eedb5a45ac5fb9f4483', 'request_id': 'req-03a8210e-bdb5-498e-a27f-5eb9095708c7'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:04.865995 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-03a8210e-bdb5-498e-a27f-5eb9095708c7 admin admin] The token cache is being invalidate because project 08d175b9a23f4eedb5a45ac5fb9f4483 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87019) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:06:04.866289 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-03a8210e-bdb5-498e-a27f-5eb9095708c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:04.866961 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-03a8210e-bdb5-498e-a27f-5eb9095708c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:04.868548 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1262/2503] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 14 18:06:04 2022] DELETE /identity/v3/projects/08d175b9a23f4eedb5a45ac5fb9f4483 => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:06:04.872701 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c83aee-061b-436c-ba2b-482f0a5513e5 service glance] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:04.885546 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c83aee-061b-436c-ba2b-482f0a5513e5 service glance] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:04.955521 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a9cf74-80d9-419a-a705-0f24a5c54b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:04.956425 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a9cf74-80d9-419a-a705-0f24a5c54b00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:04.956716 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a9cf74-80d9-419a-a705-0f24a5c54b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:04.957001 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a9cf74-80d9-419a-a705-0f24a5c54b00 admin admin] PATH_INFO: `/v3/users/34bf0b858caa4ca1a9a66fe2a9cb17b2` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:04.958236 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a9cf74-80d9-419a-a705-0f24a5c54b00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34bf0b858caa4ca1a9a66fe2a9cb17b2)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:04.960496 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a9cf74-80d9-419a-a705-0f24a5c54b00 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:05.457766 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-37a9cf74-80d9-419a-a705-0f24a5c54b00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34bf0b858caa4ca1a9a66fe2a9cb17b2'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:05.458927 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-37a9cf74-80d9-419a-a705-0f24a5c54b00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34bf0b858caa4ca1a9a66fe2a9cb17b2'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:05.459948 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-37a9cf74-80d9-419a-a705-0f24a5c54b00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34bf0b858caa4ca1a9a66fe2a9cb17b2'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:05.659914 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-37a9cf74-80d9-419a-a705-0f24a5c54b00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34bf0b858caa4ca1a9a66fe2a9cb17b2'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:05.676856 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-37a9cf74-80d9-419a-a705-0f24a5c54b00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34bf0b858caa4ca1a9a66fe2a9cb17b2'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:05.702280 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1242/2504] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 14 18:06:04 2022] DELETE /identity/v3/users/34bf0b858caa4ca1a9a66fe2a9cb17b2 => generated 0 bytes in 830 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:06:06.299759 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a8210e-bdb5-498e-a27f-5eb9095708c7 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:06.299759 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-03a8210e-bdb5-498e-a27f-5eb9095708c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:06.336250 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a8210e-bdb5-498e-a27f-5eb9095708c7 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:06.415781 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31198490-faeb-44dd-b30d-5278c6b0fe21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:06.416602 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31198490-faeb-44dd-b30d-5278c6b0fe21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:06.416888 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31198490-faeb-44dd-b30d-5278c6b0fe21 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:06.417166 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31198490-faeb-44dd-b30d-5278c6b0fe21 admin admin] PATH_INFO: `/v3/projects/03b63890f7c6420fa568adedf7260f00` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:06.418464 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31198490-faeb-44dd-b30d-5278c6b0fe21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03b63890f7c6420fa568adedf7260f00)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:06.420589 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31198490-faeb-44dd-b30d-5278c6b0fe21 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:06.446069 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:06:06.602115 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-31198490-faeb-44dd-b30d-5278c6b0fe21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03b63890f7c6420fa568adedf7260f00', 'request_id': 'req-31198490-faeb-44dd-b30d-5278c6b0fe21'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:06.742434 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-31198490-faeb-44dd-b30d-5278c6b0fe21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03b63890f7c6420fa568adedf7260f00', 'request_id': 'req-31198490-faeb-44dd-b30d-5278c6b0fe21'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:06.755515 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-31198490-faeb-44dd-b30d-5278c6b0fe21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03b63890f7c6420fa568adedf7260f00', 'request_id': 'req-31198490-faeb-44dd-b30d-5278c6b0fe21'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:06.757022 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:06:06.768875 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-31198490-faeb-44dd-b30d-5278c6b0fe21 admin admin] The token cache is being invalidate because project 03b63890f7c6420fa568adedf7260f00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87019) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:06:06.769197 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-31198490-faeb-44dd-b30d-5278c6b0fe21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:06.769891 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-31198490-faeb-44dd-b30d-5278c6b0fe21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:06.771532 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1263/2505] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 14 18:06:06 2022] DELETE /identity/v3/projects/03b63890f7c6420fa568adedf7260f00 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 18:06:06.776985 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e337e-4696-407d-80c6-a2f0d404dce9 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:06.777299 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e337e-4696-407d-80c6-a2f0d404dce9 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:06.777586 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e337e-4696-407d-80c6-a2f0d404dce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:06.797522 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-094e337e-4696-407d-80c6-a2f0d404dce9 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:06:06.798781 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-094e337e-4696-407d-80c6-a2f0d404dce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:06.867950 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1243/2506] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:06:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:06:06.876251 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02904bf3-8c24-425f-be5f-613600d48bd3 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:06.876538 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02904bf3-8c24-425f-be5f-613600d48bd3 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:06.876820 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02904bf3-8c24-425f-be5f-613600d48bd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:06.902459 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-02904bf3-8c24-425f-be5f-613600d48bd3 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:06:06.903873 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-02904bf3-8c24-425f-be5f-613600d48bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:06.917649 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1264/2507] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:06:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 18:06:06.921983 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094e337e-4696-407d-80c6-a2f0d404dce9 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:06.932747 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094e337e-4696-407d-80c6-a2f0d404dce9 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:06.938688 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0d6169-cdf2-4166-b68b-53e81a572baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:06.939622 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0d6169-cdf2-4166-b68b-53e81a572baf admin admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:06.940072 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0d6169-cdf2-4166-b68b-53e81a572baf admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:06.940761 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0d6169-cdf2-4166-b68b-53e81a572baf admin admin] PATH_INFO: `/v3/domains` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:06.941786 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0d6169-cdf2-4166-b68b-53e81a572baf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 18:06:06.942270 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0d6169-cdf2-4166-b68b-53e81a572baf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:06.944475 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0d6169-cdf2-4166-b68b-53e81a572baf admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:06.959936 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1244/2508] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 14 18:06:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 18:06:06.964401 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02904bf3-8c24-425f-be5f-613600d48bd3 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:06.975630 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02904bf3-8c24-425f-be5f-613600d48bd3 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:06.980924 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e474254-2dc8-448f-884c-adf551b7498a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:06.981859 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e474254-2dc8-448f-884c-adf551b7498a admin admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:06.982224 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e474254-2dc8-448f-884c-adf551b7498a admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:06.982722 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e474254-2dc8-448f-884c-adf551b7498a admin admin] PATH_INFO: `/v3/projects` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:06.983423 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e474254-2dc8-448f-884c-adf551b7498a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:06.985562 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e474254-2dc8-448f-884c-adf551b7498a admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:07.041861 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:06:07.110407 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1265/2509] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 14 18:06:06 2022] POST /identity/v3/projects => generated 385 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:06:07.112407 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0d6169-cdf2-4166-b68b-53e81a572baf admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:07.125715 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:06:07.127564 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0d6169-cdf2-4166-b68b-53e81a572baf admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:07.192848 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7951296-10b6-412d-a95c-3ad632213baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:07.193709 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7951296-10b6-412d-a95c-3ad632213baf admin admin] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:07.194172 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7951296-10b6-412d-a95c-3ad632213baf admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:07.194574 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7951296-10b6-412d-a95c-3ad632213baf admin admin] PATH_INFO: `/v3/users` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:07.195283 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7951296-10b6-412d-a95c-3ad632213baf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:07.198207 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7951296-10b6-412d-a95c-3ad632213baf admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:07.325875 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1245/2510] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 14 18:06:07 2022] POST /identity/v3/users => generated 293 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:06:07.330114 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e474254-2dc8-448f-884c-adf551b7498a admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:07.342869 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e474254-2dc8-448f-884c-adf551b7498a admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:07.348650 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add78ded-9a9b-4e29-a59b-2224eab63fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:07.349346 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add78ded-9a9b-4e29-a59b-2224eab63fbc admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:07.349635 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add78ded-9a9b-4e29-a59b-2224eab63fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:07.349925 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add78ded-9a9b-4e29-a59b-2224eab63fbc admin admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:07.350673 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add78ded-9a9b-4e29-a59b-2224eab63fbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:07.352357 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add78ded-9a9b-4e29-a59b-2224eab63fbc admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:07.367433 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1266/2511] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 18:06:07 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:06:07.368976 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7951296-10b6-412d-a95c-3ad632213baf admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:07.382248 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7951296-10b6-412d-a95c-3ad632213baf admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:07.399559 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2818f0d8-fd71-4ed7-9799-061b43101550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:07.400321 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2818f0d8-fd71-4ed7-9799-061b43101550 admin admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:07.400637 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2818f0d8-fd71-4ed7-9799-061b43101550 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:07.400921 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2818f0d8-fd71-4ed7-9799-061b43101550 admin admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:07.402131 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2818f0d8-fd71-4ed7-9799-061b43101550 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:07.403924 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2818f0d8-fd71-4ed7-9799-061b43101550 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:07.417268 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1246/2512] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 18:06:07 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:06:07.421684 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add78ded-9a9b-4e29-a59b-2224eab63fbc admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:07.432639 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add78ded-9a9b-4e29-a59b-2224eab63fbc admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:07.438243 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d813d0-ca77-4e15-940f-be67ec88c3dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:07.439167 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d813d0-ca77-4e15-940f-be67ec88c3dd admin admin] REQUEST_METHOD: `PUT` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:07.439508 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d813d0-ca77-4e15-940f-be67ec88c3dd admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:07.439777 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d813d0-ca77-4e15-940f-be67ec88c3dd admin admin] PATH_INFO: `/v3/projects/4cfaf802301e41dab9bdaefd79473724/users/52673d70b18f4239b84a3888689ac042/roles/9ee80134743f4c2b88525b04df2facba` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:07.456496 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d813d0-ca77-4e15-940f-be67ec88c3dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cfaf802301e41dab9bdaefd79473724, user_id=52673d70b18f4239b84a3888689ac042, role_id=9ee80134743f4c2b88525b04df2facba)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:07.459247 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d813d0-ca77-4e15-940f-be67ec88c3dd admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:07.545444 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1267/2513] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 18:06:07 2022] PUT /identity/v3/projects/4cfaf802301e41dab9bdaefd79473724/users/52673d70b18f4239b84a3888689ac042/roles/9ee80134743f4c2b88525b04df2facba => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:06:07.556564 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e93965-19a8-4e20-8138-7c9450cbd32c None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:07.556857 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e93965-19a8-4e20-8138-7c9450cbd32c None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:07.557339 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e93965-19a8-4e20-8138-7c9450cbd32c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:07.587391 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-f2e93965-19a8-4e20-8138-7c9450cbd32c None None] MFA Rules not processed for user `52673d70b18f4239b84a3888689ac042`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:06:07.588828 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-f2e93965-19a8-4e20-8138-7c9450cbd32c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:07.672789 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1247/2514] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:06:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 18:06:07.677676 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d813d0-ca77-4e15-940f-be67ec88c3dd admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:07.769488 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d813d0-ca77-4e15-940f-be67ec88c3dd admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:07.775437 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7abcc8-003f-4188-952b-90cff519cf89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:07.776121 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7abcc8-003f-4188-952b-90cff519cf89 admin admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:07.776407 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7abcc8-003f-4188-952b-90cff519cf89 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:07.777013 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7abcc8-003f-4188-952b-90cff519cf89 admin admin] PATH_INFO: `/v3/projects` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:07.777723 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7abcc8-003f-4188-952b-90cff519cf89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:07.779708 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7abcc8-003f-4188-952b-90cff519cf89 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:07.877155 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:06:07.887682 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1268/2515] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 14 18:06:07 2022] POST /identity/v3/projects => generated 385 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:06:07.888911 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e93965-19a8-4e20-8138-7c9450cbd32c None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:07.902762 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e93965-19a8-4e20-8138-7c9450cbd32c None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:07.972633 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea0b3d0-2d6c-4b42-a190-f48e24ca9067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:07.973431 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea0b3d0-2d6c-4b42-a190-f48e24ca9067 admin admin] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:07.973792 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea0b3d0-2d6c-4b42-a190-f48e24ca9067 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:07.974417 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea0b3d0-2d6c-4b42-a190-f48e24ca9067 admin admin] PATH_INFO: `/v3/users` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:07.975188 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea0b3d0-2d6c-4b42-a190-f48e24ca9067 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:07.977498 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea0b3d0-2d6c-4b42-a190-f48e24ca9067 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:07.988981 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:06:08.114544 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1248/2516] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 14 18:06:07 2022] POST /identity/v3/users => generated 299 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:06:08.119835 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7abcc8-003f-4188-952b-90cff519cf89 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:08.135988 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7abcc8-003f-4188-952b-90cff519cf89 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:08.140733 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac44819-827d-4e21-ac09-645a7e2e2611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:08.141417 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac44819-827d-4e21-ac09-645a7e2e2611 admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:08.142295 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac44819-827d-4e21-ac09-645a7e2e2611 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:08.142604 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac44819-827d-4e21-ac09-645a7e2e2611 admin admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:08.143422 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac44819-827d-4e21-ac09-645a7e2e2611 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:08.145068 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac44819-827d-4e21-ac09-645a7e2e2611 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:08.157034 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1269/2517] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 18:06:08 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:06:08.161484 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea0b3d0-2d6c-4b42-a190-f48e24ca9067 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:08.171686 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea0b3d0-2d6c-4b42-a190-f48e24ca9067 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:08.176381 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d58c34-0bd9-47a7-b41f-34a3a4bbeafd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:08.177264 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d58c34-0bd9-47a7-b41f-34a3a4bbeafd admin admin] REQUEST_METHOD: `PUT` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:08.177549 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d58c34-0bd9-47a7-b41f-34a3a4bbeafd admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:08.177829 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d58c34-0bd9-47a7-b41f-34a3a4bbeafd admin admin] PATH_INFO: `/v3/projects/e6255357b16448e4a74c8d743ee5461b/users/1278edf7f2ea4e6cba2d2a83f9c5ce3c/roles/1348580877d04014bfdec4d866b98a74` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:08.193912 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d58c34-0bd9-47a7-b41f-34a3a4bbeafd admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6255357b16448e4a74c8d743ee5461b, user_id=1278edf7f2ea4e6cba2d2a83f9c5ce3c, role_id=1348580877d04014bfdec4d866b98a74)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:08.196724 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d58c34-0bd9-47a7-b41f-34a3a4bbeafd admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:08.317757 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1249/2518] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 18:06:08 2022] PUT /identity/v3/projects/e6255357b16448e4a74c8d743ee5461b/users/1278edf7f2ea4e6cba2d2a83f9c5ce3c/roles/1348580877d04014bfdec4d866b98a74 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:06:08.321947 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac44819-827d-4e21-ac09-645a7e2e2611 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:08.332568 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac44819-827d-4e21-ac09-645a7e2e2611 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:08.399429 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a105ea0-57c5-49f0-9c0a-097c3016ae4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:08.400127 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a105ea0-57c5-49f0-9c0a-097c3016ae4a admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:08.400469 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a105ea0-57c5-49f0-9c0a-097c3016ae4a admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:08.400696 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a105ea0-57c5-49f0-9c0a-097c3016ae4a admin admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:08.401444 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a105ea0-57c5-49f0-9c0a-097c3016ae4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:08.403350 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a105ea0-57c5-49f0-9c0a-097c3016ae4a admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:08.414396 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1270/2519] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 18:06:08 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:06:08.420682 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d58c34-0bd9-47a7-b41f-34a3a4bbeafd admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:08.420985 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a105ea0-57c5-49f0-9c0a-097c3016ae4a admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:08.423349 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-0a105ea0-57c5-49f0-9c0a-097c3016ae4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:08.438931 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d58c34-0bd9-47a7-b41f-34a3a4bbeafd admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:08.444969 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a105ea0-57c5-49f0-9c0a-097c3016ae4a admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:08.447948 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f040e5-b2d1-4483-b9bf-62cb092c22f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:08.449454 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f040e5-b2d1-4483-b9bf-62cb092c22f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:08.449952 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f040e5-b2d1-4483-b9bf-62cb092c22f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:08.450440 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f040e5-b2d1-4483-b9bf-62cb092c22f8 admin admin] PATH_INFO: `/v3/projects/e6255357b16448e4a74c8d743ee5461b/users/1278edf7f2ea4e6cba2d2a83f9c5ce3c/roles/1348580877d04014bfdec4d866b98a74` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:08.452905 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8e9eba-cb8f-463c-ada3-27db904a98fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:08.454180 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f040e5-b2d1-4483-b9bf-62cb092c22f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6255357b16448e4a74c8d743ee5461b, user_id=1278edf7f2ea4e6cba2d2a83f9c5ce3c, role_id=1348580877d04014bfdec4d866b98a74)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:08.454361 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8e9eba-cb8f-463c-ada3-27db904a98fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:08.455351 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8e9eba-cb8f-463c-ada3-27db904a98fb admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:08.455712 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8e9eba-cb8f-463c-ada3-27db904a98fb admin admin] PATH_INFO: `/v3/users/192aa2e17bee4fe4b2bc9cb9cce64833` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:08.457178 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f040e5-b2d1-4483-b9bf-62cb092c22f8 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:08.457321 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8e9eba-cb8f-463c-ada3-27db904a98fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=192aa2e17bee4fe4b2bc9cb9cce64833)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:08.459248 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8e9eba-cb8f-463c-ada3-27db904a98fb admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:08.469412 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1250/2520] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 18:06:08 2022] PUT /identity/v3/projects/e6255357b16448e4a74c8d743ee5461b/users/1278edf7f2ea4e6cba2d2a83f9c5ce3c/roles/1348580877d04014bfdec4d866b98a74 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 18:06:08.480982 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd6868e-5cb4-41e8-9063-cfc1a51c8bb0 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:08.481359 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd6868e-5cb4-41e8-9063-cfc1a51c8bb0 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:08.492540 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd6868e-5cb4-41e8-9063-cfc1a51c8bb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:08.512278 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-8bd6868e-5cb4-41e8-9063-cfc1a51c8bb0 None None] MFA Rules not processed for user `1278edf7f2ea4e6cba2d2a83f9c5ce3c`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:06:08.513503 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-8bd6868e-5cb4-41e8-9063-cfc1a51c8bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:08.593068 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1251/2521] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:06:08 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 18:06:08.607005 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd6868e-5cb4-41e8-9063-cfc1a51c8bb0 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:08.608665 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-8bd6868e-5cb4-41e8-9063-cfc1a51c8bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:08.678749 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd6868e-5cb4-41e8-9063-cfc1a51c8bb0 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:08.682526 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196add57-fa15-41f8-b6dc-6aaede254338 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17945e7d72954b8787e0ba09a9903247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:08.683181 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196add57-fa15-41f8-b6dc-6aaede254338 service cinder] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:08.683506 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196add57-fa15-41f8-b6dc-6aaede254338 service cinder] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:08.683787 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196add57-fa15-41f8-b6dc-6aaede254338 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:08.696398 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196add57-fa15-41f8-b6dc-6aaede254338 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:08.699149 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196add57-fa15-41f8-b6dc-6aaede254338 service cinder] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:08.705865 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-2d8e9eba-cb8f-463c-ada3-27db904a98fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '192aa2e17bee4fe4b2bc9cb9cce64833'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:08.706753 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-2d8e9eba-cb8f-463c-ada3-27db904a98fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '192aa2e17bee4fe4b2bc9cb9cce64833'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:08.707712 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-2d8e9eba-cb8f-463c-ada3-27db904a98fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '192aa2e17bee4fe4b2bc9cb9cce64833'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:08.719800 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1252/2522] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 18:06:08 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:06:08.792843 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196add57-fa15-41f8-b6dc-6aaede254338 service cinder] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:08.805354 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-2d8e9eba-cb8f-463c-ada3-27db904a98fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '192aa2e17bee4fe4b2bc9cb9cce64833'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:08.819489 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-2d8e9eba-cb8f-463c-ada3-27db904a98fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '192aa2e17bee4fe4b2bc9cb9cce64833'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:08.848301 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1271/2523] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 14 18:06:08 2022] DELETE /identity/v3/users/192aa2e17bee4fe4b2bc9cb9cce64833 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 18:06:08.854207 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48761f5c-b627-41c9-ac26-ac033880650f None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:08.854207 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48761f5c-b627-41c9-ac26-ac033880650f None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:08.854207 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48761f5c-b627-41c9-ac26-ac033880650f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:08.877952 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:06:08.881212 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-48761f5c-b627-41c9-ac26-ac033880650f None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:06:08.882548 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-48761f5c-b627-41c9-ac26-ac033880650f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:08.913214 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196add57-fa15-41f8-b6dc-6aaede254338 service cinder] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:08.971611 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:06:08.989639 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1272/2524] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:06:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:06:09.006053 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48761f5c-b627-41c9-ac26-ac033880650f None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:09.007748 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-48761f5c-b627-41c9-ac26-ac033880650f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:09.013623 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ce79f6-fe7d-4822-9ee8-dbe2f4fedd19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:09.014536 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ce79f6-fe7d-4822-9ee8-dbe2f4fedd19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:09.014824 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ce79f6-fe7d-4822-9ee8-dbe2f4fedd19 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:09.015105 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ce79f6-fe7d-4822-9ee8-dbe2f4fedd19 admin admin] PATH_INFO: `/v3/users/52673d70b18f4239b84a3888689ac042` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:09.016612 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ce79f6-fe7d-4822-9ee8-dbe2f4fedd19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52673d70b18f4239b84a3888689ac042)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:09.018385 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ce79f6-fe7d-4822-9ee8-dbe2f4fedd19 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:09.096504 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48761f5c-b627-41c9-ac26-ac033880650f None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:09.100965 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fe249b-25c9-4572-9511-55ca79cccd0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5652329c71cd431fb579d69cef933b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:09.101700 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe249b-25c9-4572-9511-55ca79cccd0e service neutron] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:09.101936 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe249b-25c9-4572-9511-55ca79cccd0e service neutron] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:09.102242 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe249b-25c9-4572-9511-55ca79cccd0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:09.112250 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fe249b-25c9-4572-9511-55ca79cccd0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:09.114672 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fe249b-25c9-4572-9511-55ca79cccd0e service neutron] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:09.126163 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1273/2525] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 18:06:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:06:09.407513 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-14ce79f6-fe7d-4822-9ee8-dbe2f4fedd19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52673d70b18f4239b84a3888689ac042'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:09.408708 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-14ce79f6-fe7d-4822-9ee8-dbe2f4fedd19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52673d70b18f4239b84a3888689ac042'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:09.410480 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-14ce79f6-fe7d-4822-9ee8-dbe2f4fedd19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52673d70b18f4239b84a3888689ac042'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:09.520082 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-14ce79f6-fe7d-4822-9ee8-dbe2f4fedd19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52673d70b18f4239b84a3888689ac042'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:09.530955 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-14ce79f6-fe7d-4822-9ee8-dbe2f4fedd19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52673d70b18f4239b84a3888689ac042'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:09.551453 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1253/2526] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 14 18:06:08 2022] DELETE /identity/v3/users/52673d70b18f4239b84a3888689ac042 => generated 0 bytes in 759 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 18:06:09.557125 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17385b2-e913-4b14-9a4a-3b048ca580f8 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:09.557698 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17385b2-e913-4b14-9a4a-3b048ca580f8 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:09.557698 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17385b2-e913-4b14-9a4a-3b048ca580f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:09.577099 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-c17385b2-e913-4b14-9a4a-3b048ca580f8 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:06:09.578540 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-c17385b2-e913-4b14-9a4a-3b048ca580f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:09.643623 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1274/2527] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:06:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:06:09.653897 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ce79f6-fe7d-4822-9ee8-dbe2f4fedd19 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:09.655828 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-14ce79f6-fe7d-4822-9ee8-dbe2f4fedd19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:09.721017 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ce79f6-fe7d-4822-9ee8-dbe2f4fedd19 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:09.726238 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66527b7c-646b-49b7-ac93-d3d503545885 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5652329c71cd431fb579d69cef933b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:09.726910 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66527b7c-646b-49b7-ac93-d3d503545885 service neutron] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:09.732265 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66527b7c-646b-49b7-ac93-d3d503545885 service neutron] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:09.732265 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66527b7c-646b-49b7-ac93-d3d503545885 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:09.732452 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17385b2-e913-4b14-9a4a-3b048ca580f8 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:09.732452 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-c17385b2-e913-4b14-9a4a-3b048ca580f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:09.740079 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66527b7c-646b-49b7-ac93-d3d503545885 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:09.741545 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66527b7c-646b-49b7-ac93-d3d503545885 service neutron] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:09.744804 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17385b2-e913-4b14-9a4a-3b048ca580f8 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:09.750082 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5bce7a-33f3-4b81-bd32-952abf633af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:09.750977 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5bce7a-33f3-4b81-bd32-952abf633af8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:09.751265 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5bce7a-33f3-4b81-bd32-952abf633af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:09.751585 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5bce7a-33f3-4b81-bd32-952abf633af8 admin admin] PATH_INFO: `/v3/projects/4beb2a5b15b440a699f11f2f83e02f4b` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:09.752897 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5bce7a-33f3-4b81-bd32-952abf633af8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4beb2a5b15b440a699f11f2f83e02f4b)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:09.754867 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1254/2528] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 18:06:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:06:09.755039 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5bce7a-33f3-4b81-bd32-952abf633af8 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:09.924732 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-2e5bce7a-33f3-4b81-bd32-952abf633af8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4beb2a5b15b440a699f11f2f83e02f4b', 'request_id': 'req-2e5bce7a-33f3-4b81-bd32-952abf633af8'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:10.047416 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-2e5bce7a-33f3-4b81-bd32-952abf633af8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4beb2a5b15b440a699f11f2f83e02f4b', 'request_id': 'req-2e5bce7a-33f3-4b81-bd32-952abf633af8'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:10.054539 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-2e5bce7a-33f3-4b81-bd32-952abf633af8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4beb2a5b15b440a699f11f2f83e02f4b', 'request_id': 'req-2e5bce7a-33f3-4b81-bd32-952abf633af8'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:10.067435 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-2e5bce7a-33f3-4b81-bd32-952abf633af8 admin admin] The token cache is being invalidate because project 4beb2a5b15b440a699f11f2f83e02f4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87019) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:06:10.067737 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-2e5bce7a-33f3-4b81-bd32-952abf633af8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:10.068536 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-2e5bce7a-33f3-4b81-bd32-952abf633af8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:10.070150 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1275/2529] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 14 18:06:09 2022] DELETE /identity/v3/projects/4beb2a5b15b440a699f11f2f83e02f4b => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 18:06:10.074748 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66527b7c-646b-49b7-ac93-d3d503545885 service neutron] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:10.089589 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66527b7c-646b-49b7-ac93-d3d503545885 service neutron] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:10.107611 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:06:10.169838 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d516ca-ea3f-44bc-9340-1fd0776d38da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:10.170851 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d516ca-ea3f-44bc-9340-1fd0776d38da admin admin] REQUEST_METHOD: `DELETE` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:10.171167 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d516ca-ea3f-44bc-9340-1fd0776d38da admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:10.172233 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d516ca-ea3f-44bc-9340-1fd0776d38da admin admin] PATH_INFO: `/v3/users/c0c500b78d88466a9f0b09ba2874f8f7` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:10.176985 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d516ca-ea3f-44bc-9340-1fd0776d38da admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0c500b78d88466a9f0b09ba2874f8f7)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:10.176985 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d516ca-ea3f-44bc-9340-1fd0776d38da admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:10.227415 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5bce7a-33f3-4b81-bd32-952abf633af8 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:10.228956 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-2e5bce7a-33f3-4b81-bd32-952abf633af8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:10.244314 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5bce7a-33f3-4b81-bd32-952abf633af8 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:10.249700 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d6b650-785d-485b-9ef7-363bd9fde2f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:10.250829 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d6b650-785d-485b-9ef7-363bd9fde2f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:10.251018 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d6b650-785d-485b-9ef7-363bd9fde2f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:10.251389 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d6b650-785d-485b-9ef7-363bd9fde2f7 admin admin] PATH_INFO: `/v3/projects/4cfaf802301e41dab9bdaefd79473724` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:10.252738 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d6b650-785d-485b-9ef7-363bd9fde2f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cfaf802301e41dab9bdaefd79473724)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:10.255409 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d6b650-785d-485b-9ef7-363bd9fde2f7 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:10.279554 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:06:10.454902 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-25d516ca-ea3f-44bc-9340-1fd0776d38da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0c500b78d88466a9f0b09ba2874f8f7'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:10.455798 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-25d516ca-ea3f-44bc-9340-1fd0776d38da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0c500b78d88466a9f0b09ba2874f8f7'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:10.456796 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-25d516ca-ea3f-44bc-9340-1fd0776d38da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0c500b78d88466a9f0b09ba2874f8f7'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:10.457567 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-35d6b650-785d-485b-9ef7-363bd9fde2f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cfaf802301e41dab9bdaefd79473724', 'request_id': 'req-35d6b650-785d-485b-9ef7-363bd9fde2f7'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:10.538970 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-25d516ca-ea3f-44bc-9340-1fd0776d38da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0c500b78d88466a9f0b09ba2874f8f7'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:10.547687 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-25d516ca-ea3f-44bc-9340-1fd0776d38da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0c500b78d88466a9f0b09ba2874f8f7'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:10.572128 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1255/2530] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 14 18:06:10 2022] DELETE /identity/v3/users/c0c500b78d88466a9f0b09ba2874f8f7 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 18:06:10.647930 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-35d6b650-785d-485b-9ef7-363bd9fde2f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cfaf802301e41dab9bdaefd79473724', 'request_id': 'req-35d6b650-785d-485b-9ef7-363bd9fde2f7'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:10.659468 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-35d6b650-785d-485b-9ef7-363bd9fde2f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cfaf802301e41dab9bdaefd79473724', 'request_id': 'req-35d6b650-785d-485b-9ef7-363bd9fde2f7'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:10.669279 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-35d6b650-785d-485b-9ef7-363bd9fde2f7 admin admin] The token cache is being invalidate because project 4cfaf802301e41dab9bdaefd79473724 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87019) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:06:10.669932 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-35d6b650-785d-485b-9ef7-363bd9fde2f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:10.670694 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-35d6b650-785d-485b-9ef7-363bd9fde2f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:10.672275 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1276/2531] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 14 18:06:10 2022] DELETE /identity/v3/projects/4cfaf802301e41dab9bdaefd79473724 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 18:06:10.677964 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d516ca-ea3f-44bc-9340-1fd0776d38da admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:10.680412 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-25d516ca-ea3f-44bc-9340-1fd0776d38da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:10.759058 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d516ca-ea3f-44bc-9340-1fd0776d38da admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:10.764482 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfe424e-bf3f-4039-a64f-9f0350bf6b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:10.765633 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfe424e-bf3f-4039-a64f-9f0350bf6b20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:10.766139 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfe424e-bf3f-4039-a64f-9f0350bf6b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:10.766637 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfe424e-bf3f-4039-a64f-9f0350bf6b20 admin admin] PATH_INFO: `/v3/users/1278edf7f2ea4e6cba2d2a83f9c5ce3c` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:10.768205 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfe424e-bf3f-4039-a64f-9f0350bf6b20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1278edf7f2ea4e6cba2d2a83f9c5ce3c)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:10.772113 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfe424e-bf3f-4039-a64f-9f0350bf6b20 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:11.009947 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:06:11.018241 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-3cfe424e-bf3f-4039-a64f-9f0350bf6b20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1278edf7f2ea4e6cba2d2a83f9c5ce3c'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:11.019063 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-3cfe424e-bf3f-4039-a64f-9f0350bf6b20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1278edf7f2ea4e6cba2d2a83f9c5ce3c'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:11.020149 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-3cfe424e-bf3f-4039-a64f-9f0350bf6b20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1278edf7f2ea4e6cba2d2a83f9c5ce3c'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:11.142110 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-3cfe424e-bf3f-4039-a64f-9f0350bf6b20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1278edf7f2ea4e6cba2d2a83f9c5ce3c'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:11.155598 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d6b650-785d-485b-9ef7-363bd9fde2f7 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:11.157624 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-35d6b650-785d-485b-9ef7-363bd9fde2f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:11.164723 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-3cfe424e-bf3f-4039-a64f-9f0350bf6b20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1278edf7f2ea4e6cba2d2a83f9c5ce3c'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:11.188985 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1256/2532] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 14 18:06:10 2022] DELETE /identity/v3/users/1278edf7f2ea4e6cba2d2a83f9c5ce3c => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:06:11.260500 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d6b650-785d-485b-9ef7-363bd9fde2f7 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:11.359571 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294350c9-0dd5-4614-a8dc-23d11c8e0946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:11.364868 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294350c9-0dd5-4614-a8dc-23d11c8e0946 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:11.365160 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294350c9-0dd5-4614-a8dc-23d11c8e0946 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:11.365537 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294350c9-0dd5-4614-a8dc-23d11c8e0946 admin admin] PATH_INFO: `/v3/projects/0a3b2b0e44f24fe087c1fab5fc5cd258` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:11.366835 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294350c9-0dd5-4614-a8dc-23d11c8e0946 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a3b2b0e44f24fe087c1fab5fc5cd258)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:11.368856 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294350c9-0dd5-4614-a8dc-23d11c8e0946 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:11.585672 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-294350c9-0dd5-4614-a8dc-23d11c8e0946 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a3b2b0e44f24fe087c1fab5fc5cd258', 'request_id': 'req-294350c9-0dd5-4614-a8dc-23d11c8e0946'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:11.589339 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:06:11.702905 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-294350c9-0dd5-4614-a8dc-23d11c8e0946 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a3b2b0e44f24fe087c1fab5fc5cd258', 'request_id': 'req-294350c9-0dd5-4614-a8dc-23d11c8e0946'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:11.712260 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfe424e-bf3f-4039-a64f-9f0350bf6b20 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:11.712512 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-3cfe424e-bf3f-4039-a64f-9f0350bf6b20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:11.717111 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-294350c9-0dd5-4614-a8dc-23d11c8e0946 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a3b2b0e44f24fe087c1fab5fc5cd258', 'request_id': 'req-294350c9-0dd5-4614-a8dc-23d11c8e0946'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:11.727685 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfe424e-bf3f-4039-a64f-9f0350bf6b20 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:11.739855 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-294350c9-0dd5-4614-a8dc-23d11c8e0946 admin admin] The token cache is being invalidate because project 0a3b2b0e44f24fe087c1fab5fc5cd258 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87019) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:06:11.740483 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-294350c9-0dd5-4614-a8dc-23d11c8e0946 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:11.741679 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-294350c9-0dd5-4614-a8dc-23d11c8e0946 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:11.743445 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1277/2533] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 14 18:06:11 2022] DELETE /identity/v3/projects/0a3b2b0e44f24fe087c1fab5fc5cd258 => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 18:06:11.749086 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d52657-7d93-4742-91f5-c226da8e2464 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:11.749086 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d52657-7d93-4742-91f5-c226da8e2464 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:11.749086 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d52657-7d93-4742-91f5-c226da8e2464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:11.768455 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-c9d52657-7d93-4742-91f5-c226da8e2464 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:06:11.772275 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-c9d52657-7d93-4742-91f5-c226da8e2464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:11.794630 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279e5e0d-db3d-4277-aae6-7193238a373f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:11.795673 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279e5e0d-db3d-4277-aae6-7193238a373f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:11.795974 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279e5e0d-db3d-4277-aae6-7193238a373f admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:11.796264 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279e5e0d-db3d-4277-aae6-7193238a373f admin admin] PATH_INFO: `/v3/projects/e6255357b16448e4a74c8d743ee5461b` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:11.797773 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279e5e0d-db3d-4277-aae6-7193238a373f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6255357b16448e4a74c8d743ee5461b)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:11.799823 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279e5e0d-db3d-4277-aae6-7193238a373f admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:11.835681 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1278/2534] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:06:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 18:06:11.844581 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b4a402-10e7-46b6-9a00-7d75cede8218 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:11.844877 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b4a402-10e7-46b6-9a00-7d75cede8218 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:11.845161 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b4a402-10e7-46b6-9a00-7d75cede8218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:11.865120 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-c8b4a402-10e7-46b6-9a00-7d75cede8218 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:06:11.866331 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-c8b4a402-10e7-46b6-9a00-7d75cede8218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:11.874709 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1279/2535] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:06:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 18:06:11.878934 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b4a402-10e7-46b6-9a00-7d75cede8218 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:11.888689 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b4a402-10e7-46b6-9a00-7d75cede8218 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:11.893610 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142c6e12-f95c-4568-b8e2-e1b602570a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:11.894619 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142c6e12-f95c-4568-b8e2-e1b602570a93 admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:11.894943 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142c6e12-f95c-4568-b8e2-e1b602570a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:11.895233 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142c6e12-f95c-4568-b8e2-e1b602570a93 admin admin] PATH_INFO: `/v3/domains` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:11.896028 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142c6e12-f95c-4568-b8e2-e1b602570a93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 18:06:11.896348 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142c6e12-f95c-4568-b8e2-e1b602570a93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:11.897980 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142c6e12-f95c-4568-b8e2-e1b602570a93 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:11.911358 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1280/2536] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 14 18:06:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 18:06:11.915989 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142c6e12-f95c-4568-b8e2-e1b602570a93 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:11.926968 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142c6e12-f95c-4568-b8e2-e1b602570a93 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:11.933722 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb950dde-efbd-4f03-b815-573d51d3b972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:11.934406 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb950dde-efbd-4f03-b815-573d51d3b972 admin admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:11.934698 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb950dde-efbd-4f03-b815-573d51d3b972 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:11.934981 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb950dde-efbd-4f03-b815-573d51d3b972 admin admin] PATH_INFO: `/v3/projects` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:11.935739 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb950dde-efbd-4f03-b815-573d51d3b972 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:11.937974 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb950dde-efbd-4f03-b815-573d51d3b972 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:11.965223 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-279e5e0d-db3d-4277-aae6-7193238a373f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6255357b16448e4a74c8d743ee5461b', 'request_id': 'req-279e5e0d-db3d-4277-aae6-7193238a373f'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:12.053058 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-279e5e0d-db3d-4277-aae6-7193238a373f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6255357b16448e4a74c8d743ee5461b', 'request_id': 'req-279e5e0d-db3d-4277-aae6-7193238a373f'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:12.060031 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-279e5e0d-db3d-4277-aae6-7193238a373f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6255357b16448e4a74c8d743ee5461b', 'request_id': 'req-279e5e0d-db3d-4277-aae6-7193238a373f'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:12.063617 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1281/2537] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 14 18:06:11 2022] POST /identity/v3/projects => generated 387 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 18:06:12.068686 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb950dde-efbd-4f03-b815-573d51d3b972 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:12.077669 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-279e5e0d-db3d-4277-aae6-7193238a373f admin admin] The token cache is being invalidate because project e6255357b16448e4a74c8d743ee5461b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:06:12.077963 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-279e5e0d-db3d-4277-aae6-7193238a373f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:12.079425 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-279e5e0d-db3d-4277-aae6-7193238a373f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:12.080799 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1257/2538] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 14 18:06:11 2022] DELETE /identity/v3/projects/e6255357b16448e4a74c8d743ee5461b => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 18:06:12.090093 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fed071-6be3-41ac-8fe3-3dff193dd223 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:12.090572 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fed071-6be3-41ac-8fe3-3dff193dd223 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:12.091051 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fed071-6be3-41ac-8fe3-3dff193dd223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:12.116714 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-82fed071-6be3-41ac-8fe3-3dff193dd223 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:06:12.118411 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-82fed071-6be3-41ac-8fe3-3dff193dd223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:12.145506 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb950dde-efbd-4f03-b815-573d51d3b972 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:12.150708 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a988711-993c-4e3e-9ac8-c887c91ba1c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:12.151437 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a988711-993c-4e3e-9ac8-c887c91ba1c1 admin admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:12.151722 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a988711-993c-4e3e-9ac8-c887c91ba1c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:12.152255 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a988711-993c-4e3e-9ac8-c887c91ba1c1 admin admin] PATH_INFO: `/v3/users` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:12.152966 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a988711-993c-4e3e-9ac8-c887c91ba1c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:12.154890 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a988711-993c-4e3e-9ac8-c887c91ba1c1 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:12.166439 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:06:12.189157 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1258/2539] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:06:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 18:06:12.197838 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36ea31d-262c-47b4-a6fc-dd9d97062312 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:12.198132 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36ea31d-262c-47b4-a6fc-dd9d97062312 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:12.198421 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36ea31d-262c-47b4-a6fc-dd9d97062312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:12.217427 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-e36ea31d-262c-47b4-a6fc-dd9d97062312 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:06:12.218572 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-e36ea31d-262c-47b4-a6fc-dd9d97062312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:12.227069 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1259/2540] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:06:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 18:06:12.235973 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36ea31d-262c-47b4-a6fc-dd9d97062312 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:12.243196 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36ea31d-262c-47b4-a6fc-dd9d97062312 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:12.248405 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5191423d-5780-4359-9a94-d0f9abc978b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:12.249080 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5191423d-5780-4359-9a94-d0f9abc978b3 admin admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:12.249367 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5191423d-5780-4359-9a94-d0f9abc978b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:12.249649 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5191423d-5780-4359-9a94-d0f9abc978b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:12.250383 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5191423d-5780-4359-9a94-d0f9abc978b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 18:06:12.250691 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5191423d-5780-4359-9a94-d0f9abc978b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:12.252340 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5191423d-5780-4359-9a94-d0f9abc978b3 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:12.268941 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1260/2541] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 14 18:06:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 18:06:12.270213 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1282/2542] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 14 18:06:12 2022] POST /identity/v3/users => generated 294 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 18:06:12.274246 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a988711-993c-4e3e-9ac8-c887c91ba1c1 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:12.274376 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5191423d-5780-4359-9a94-d0f9abc978b3 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:12.276194 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-5191423d-5780-4359-9a94-d0f9abc978b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:12.286786 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a988711-993c-4e3e-9ac8-c887c91ba1c1 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:12.289668 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5191423d-5780-4359-9a94-d0f9abc978b3 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:12.292793 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc370f5-6aae-4761-b2b4-9ddf025b6302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:12.293552 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc370f5-6aae-4761-b2b4-9ddf025b6302 admin admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:12.293979 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc370f5-6aae-4761-b2b4-9ddf025b6302 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:12.294257 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc370f5-6aae-4761-b2b4-9ddf025b6302 admin admin] PATH_INFO: `/v3/projects` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:12.294383 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319f48e8-a304-40bb-a091-9dc4ed6b12dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:12.295111 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319f48e8-a304-40bb-a091-9dc4ed6b12dd admin admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:12.295491 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319f48e8-a304-40bb-a091-9dc4ed6b12dd admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:12.295717 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319f48e8-a304-40bb-a091-9dc4ed6b12dd admin admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:12.296412 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc370f5-6aae-4761-b2b4-9ddf025b6302 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:12.296530 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319f48e8-a304-40bb-a091-9dc4ed6b12dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:12.298046 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319f48e8-a304-40bb-a091-9dc4ed6b12dd admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:12.298369 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc370f5-6aae-4761-b2b4-9ddf025b6302 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:12.309857 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1261/2543] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 18:06:12 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 14 18:06:12.313791 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319f48e8-a304-40bb-a091-9dc4ed6b12dd admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:12.326566 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319f48e8-a304-40bb-a091-9dc4ed6b12dd admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:12.332115 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9cca7b-a8c5-4eb9-8b78-24dd7dc85a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:12.332717 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9cca7b-a8c5-4eb9-8b78-24dd7dc85a8c admin admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:12.333004 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9cca7b-a8c5-4eb9-8b78-24dd7dc85a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:12.333283 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9cca7b-a8c5-4eb9-8b78-24dd7dc85a8c admin admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:12.334010 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9cca7b-a8c5-4eb9-8b78-24dd7dc85a8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:12.335813 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9cca7b-a8c5-4eb9-8b78-24dd7dc85a8c admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:12.349654 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1262/2544] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 18:06:12 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 14 18:06:12.354160 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9cca7b-a8c5-4eb9-8b78-24dd7dc85a8c admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:12.365843 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9cca7b-a8c5-4eb9-8b78-24dd7dc85a8c admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:12.370669 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85993b64-cd3f-4181-be15-8daca6671ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:12.371613 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85993b64-cd3f-4181-be15-8daca6671ca9 admin admin] REQUEST_METHOD: `PUT` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:12.371987 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85993b64-cd3f-4181-be15-8daca6671ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:12.372275 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85993b64-cd3f-4181-be15-8daca6671ca9 admin admin] PATH_INFO: `/v3/projects/ffb7c93beba049d3b0a4871db73f7ea1/users/6b4b0657cc864c74a1e568b645088ff9/roles/9ee80134743f4c2b88525b04df2facba` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:12.391371 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85993b64-cd3f-4181-be15-8daca6671ca9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffb7c93beba049d3b0a4871db73f7ea1, user_id=6b4b0657cc864c74a1e568b645088ff9, role_id=9ee80134743f4c2b88525b04df2facba)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:12.392479 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85993b64-cd3f-4181-be15-8daca6671ca9 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:12.400603 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1283/2545] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 14 18:06:12 2022] POST /identity/v3/projects => generated 379 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:06:12.405052 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc370f5-6aae-4761-b2b4-9ddf025b6302 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:12.475363 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc370f5-6aae-4761-b2b4-9ddf025b6302 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:12.480150 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de02929-1ca8-4897-8024-c8e30922b322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:12.480847 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de02929-1ca8-4897-8024-c8e30922b322 admin admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:12.481133 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de02929-1ca8-4897-8024-c8e30922b322 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:12.481415 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de02929-1ca8-4897-8024-c8e30922b322 admin admin] PATH_INFO: `/v3/users` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:12.482175 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de02929-1ca8-4897-8024-c8e30922b322 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:12.484193 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de02929-1ca8-4897-8024-c8e30922b322 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:12.500626 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1263/2546] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 18:06:12 2022] PUT /identity/v3/projects/ffb7c93beba049d3b0a4871db73f7ea1/users/6b4b0657cc864c74a1e568b645088ff9/roles/9ee80134743f4c2b88525b04df2facba => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 18:06:12.512487 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5165e974-54b1-45f4-b107-2c29d843ef52 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:12.512772 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5165e974-54b1-45f4-b107-2c29d843ef52 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:12.513052 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5165e974-54b1-45f4-b107-2c29d843ef52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:12.542778 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-5165e974-54b1-45f4-b107-2c29d843ef52 None None] MFA Rules not processed for user `6b4b0657cc864c74a1e568b645088ff9`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:06:12.546264 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-5165e974-54b1-45f4-b107-2c29d843ef52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:12.606064 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1284/2547] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 14 18:06:12 2022] POST /identity/v3/users => generated 290 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 18:06:12.609985 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de02929-1ca8-4897-8024-c8e30922b322 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:12.622462 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de02929-1ca8-4897-8024-c8e30922b322 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:12.627466 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1264/2548] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:06:12 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:06:12.631187 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5165e974-54b1-45f4-b107-2c29d843ef52 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:12.698534 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1df269-598a-42e2-bb99-275815645824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:12.701367 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1df269-598a-42e2-bb99-275815645824 admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:12.701367 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1df269-598a-42e2-bb99-275815645824 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:12.701367 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1df269-598a-42e2-bb99-275815645824 admin admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:12.701367 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1df269-598a-42e2-bb99-275815645824 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:12.702221 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1df269-598a-42e2-bb99-275815645824 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:12.711630 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5165e974-54b1-45f4-b107-2c29d843ef52 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:12.715885 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1285/2549] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 18:06:12 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 14 18:06:12.719816 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5a0fb8-d4ca-450d-9761-170f13de3198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:12.720508 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a0fb8-d4ca-450d-9761-170f13de3198 admin admin] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:12.720644 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1df269-598a-42e2-bb99-275815645824 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:12.720795 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a0fb8-d4ca-450d-9761-170f13de3198 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:12.721081 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a0fb8-d4ca-450d-9761-170f13de3198 admin admin] PATH_INFO: `/v3/projects` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:12.721791 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5a0fb8-d4ca-450d-9761-170f13de3198 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:12.723849 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5a0fb8-d4ca-450d-9761-170f13de3198 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:12.731218 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1df269-598a-42e2-bb99-275815645824 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:12.736342 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813a713c-1e16-433f-8096-a6f61e2d83d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:12.737004 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813a713c-1e16-433f-8096-a6f61e2d83d9 admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:12.737304 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813a713c-1e16-433f-8096-a6f61e2d83d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:12.739573 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813a713c-1e16-433f-8096-a6f61e2d83d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:12.740445 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813a713c-1e16-433f-8096-a6f61e2d83d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:12.742129 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813a713c-1e16-433f-8096-a6f61e2d83d9 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:12.755705 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1286/2550] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 18:06:12 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:06:12.759850 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813a713c-1e16-433f-8096-a6f61e2d83d9 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:12.770788 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813a713c-1e16-433f-8096-a6f61e2d83d9 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:12.776199 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47436e80-5317-4305-b056-8cf5abe337f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:12.777448 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47436e80-5317-4305-b056-8cf5abe337f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:12.777739 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47436e80-5317-4305-b056-8cf5abe337f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:12.780206 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47436e80-5317-4305-b056-8cf5abe337f5 admin admin] PATH_INFO: `/v3/projects/a70e7d716ebc489b9bb7b1d95717b0f2/users/df5c5a085633482a8149471d2ae5b273/roles/9ee80134743f4c2b88525b04df2facba` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:12.794053 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47436e80-5317-4305-b056-8cf5abe337f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a70e7d716ebc489b9bb7b1d95717b0f2, user_id=df5c5a085633482a8149471d2ae5b273, role_id=9ee80134743f4c2b88525b04df2facba)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:12.796777 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47436e80-5317-4305-b056-8cf5abe337f5 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:12.807052 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1265/2551] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 14 18:06:12 2022] POST /identity/v3/projects => generated 387 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 18:06:12.811253 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5a0fb8-d4ca-450d-9761-170f13de3198 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:12.823024 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=93,keystone:DELETE=2,keystone:INSERT=5 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:06:12.874930 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1287/2552] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 18:06:12 2022] PUT /identity/v3/projects/a70e7d716ebc489b9bb7b1d95717b0f2/users/df5c5a085633482a8149471d2ae5b273/roles/9ee80134743f4c2b88525b04df2facba => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 18:06:12.885896 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5a0fb8-d4ca-450d-9761-170f13de3198 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:12.887687 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d243b8c0-a469-4bb8-be6a-10abe1b30b96 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:12.887982 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d243b8c0-a469-4bb8-be6a-10abe1b30b96 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:12.888331 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d243b8c0-a469-4bb8-be6a-10abe1b30b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:12.918343 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-d243b8c0-a469-4bb8-be6a-10abe1b30b96 None None] MFA Rules not processed for user `df5c5a085633482a8149471d2ae5b273`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:06:12.919599 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-d243b8c0-a469-4bb8-be6a-10abe1b30b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:12.957507 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ced017-3c1d-437b-9c03-96393af43948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:12.958190 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ced017-3c1d-437b-9c03-96393af43948 admin admin] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:12.958474 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ced017-3c1d-437b-9c03-96393af43948 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:12.958754 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ced017-3c1d-437b-9c03-96393af43948 admin admin] PATH_INFO: `/v3/users` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:12.961044 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ced017-3c1d-437b-9c03-96393af43948 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:12.961520 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ced017-3c1d-437b-9c03-96393af43948 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:12.991965 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1288/2553] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:06:12 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 18:06:12.997036 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d243b8c0-a469-4bb8-be6a-10abe1b30b96 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:13.008933 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d243b8c0-a469-4bb8-be6a-10abe1b30b96 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:13.013673 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b8f558-3271-486b-b22f-bec68cfd155b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:13.015641 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b8f558-3271-486b-b22f-bec68cfd155b admin admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:13.015641 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b8f558-3271-486b-b22f-bec68cfd155b admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:13.015641 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b8f558-3271-486b-b22f-bec68cfd155b admin admin] PATH_INFO: `/v3/projects` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:13.015641 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b8f558-3271-486b-b22f-bec68cfd155b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:13.018169 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b8f558-3271-486b-b22f-bec68cfd155b admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:13.041510 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1266/2554] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 14 18:06:12 2022] POST /identity/v3/users => generated 294 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 18:06:13.048658 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ced017-3c1d-437b-9c03-96393af43948 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:13.060763 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ced017-3c1d-437b-9c03-96393af43948 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:13.072759 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e1d103-cbdc-4333-811e-a8df2376b21e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:13.073875 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e1d103-cbdc-4333-811e-a8df2376b21e admin admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:13.074215 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e1d103-cbdc-4333-811e-a8df2376b21e admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:13.074495 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e1d103-cbdc-4333-811e-a8df2376b21e admin admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:13.075230 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e1d103-cbdc-4333-811e-a8df2376b21e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:13.076901 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e1d103-cbdc-4333-811e-a8df2376b21e admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:13.088666 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1267/2555] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 18:06:13 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:06:13.093067 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e1d103-cbdc-4333-811e-a8df2376b21e admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:13.106576 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e1d103-cbdc-4333-811e-a8df2376b21e admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:13.111324 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bcd218-3e98-496c-87f3-bf01457d1c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:13.112001 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bcd218-3e98-496c-87f3-bf01457d1c3d admin admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:13.112286 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bcd218-3e98-496c-87f3-bf01457d1c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:13.112657 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bcd218-3e98-496c-87f3-bf01457d1c3d admin admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:13.114646 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bcd218-3e98-496c-87f3-bf01457d1c3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:13.116348 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bcd218-3e98-496c-87f3-bf01457d1c3d admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:13.126198 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1289/2556] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 14 18:06:12 2022] POST /identity/v3/projects => generated 379 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 18:06:13.134371 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b8f558-3271-486b-b22f-bec68cfd155b admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:13.137101 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1268/2557] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 18:06:13 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 14 18:06:13.142091 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bcd218-3e98-496c-87f3-bf01457d1c3d admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:13.153531 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bcd218-3e98-496c-87f3-bf01457d1c3d admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:13.226257 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:06:13.242364 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b8f558-3271-486b-b22f-bec68cfd155b admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:13.245275 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747acc75-629c-4811-a98a-7d75f1dbbbe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:13.245275 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747acc75-629c-4811-a98a-7d75f1dbbbe1 admin admin] REQUEST_METHOD: `PUT` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:13.245275 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747acc75-629c-4811-a98a-7d75f1dbbbe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:13.245713 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747acc75-629c-4811-a98a-7d75f1dbbbe1 admin admin] PATH_INFO: `/v3/projects/6a4cc2599a9c457ca14fe370306106fc/users/fd8583a6c0af4df6ad84cf842a8a281e/roles/9ee80134743f4c2b88525b04df2facba` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:13.250710 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f91c8bc-577f-4176-bcdc-796a9adc5928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:13.251666 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f91c8bc-577f-4176-bcdc-796a9adc5928 admin admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:13.251891 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f91c8bc-577f-4176-bcdc-796a9adc5928 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:13.252202 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f91c8bc-577f-4176-bcdc-796a9adc5928 admin admin] PATH_INFO: `/v3/users` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:13.256790 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f91c8bc-577f-4176-bcdc-796a9adc5928 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:13.256790 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f91c8bc-577f-4176-bcdc-796a9adc5928 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:13.265829 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747acc75-629c-4811-a98a-7d75f1dbbbe1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a4cc2599a9c457ca14fe370306106fc, user_id=fd8583a6c0af4df6ad84cf842a8a281e, role_id=9ee80134743f4c2b88525b04df2facba)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:13.269543 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747acc75-629c-4811-a98a-7d75f1dbbbe1 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:13.397204 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1269/2558] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 18:06:13 2022] PUT /identity/v3/projects/6a4cc2599a9c457ca14fe370306106fc/users/fd8583a6c0af4df6ad84cf842a8a281e/roles/9ee80134743f4c2b88525b04df2facba => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 18:06:13.400759 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1290/2559] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 14 18:06:13 2022] POST /identity/v3/users => generated 296 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:06:13.403237 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747acc75-629c-4811-a98a-7d75f1dbbbe1 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:13.411994 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cb9133-3072-414e-858f-5358269325af None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:13.413309 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cb9133-3072-414e-858f-5358269325af None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:13.413630 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cb9133-3072-414e-858f-5358269325af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:13.448776 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-70cb9133-3072-414e-858f-5358269325af None None] MFA Rules not processed for user `fd8583a6c0af4df6ad84cf842a8a281e`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:06:13.449997 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-70cb9133-3072-414e-858f-5358269325af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:13.484768 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747acc75-629c-4811-a98a-7d75f1dbbbe1 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:13.491492 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e7f5f8-bd6c-443c-9ea9-3b8717f70872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:13.492193 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e7f5f8-bd6c-443c-9ea9-3b8717f70872 admin admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:13.492556 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e7f5f8-bd6c-443c-9ea9-3b8717f70872 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:13.492831 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e7f5f8-bd6c-443c-9ea9-3b8717f70872 admin admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:13.494040 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e7f5f8-bd6c-443c-9ea9-3b8717f70872 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:13.495176 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e7f5f8-bd6c-443c-9ea9-3b8717f70872 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:13.509113 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1270/2560] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 18:06:13 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:06:13.514642 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e7f5f8-bd6c-443c-9ea9-3b8717f70872 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:13.524822 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1291/2561] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:06:13 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 18:06:13.525976 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e7f5f8-bd6c-443c-9ea9-3b8717f70872 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:13.529421 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cb9133-3072-414e-858f-5358269325af None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:13.531665 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b0d733-1ad2-4b99-a640-33b9f79175ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:13.532565 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b0d733-1ad2-4b99-a640-33b9f79175ce admin admin] REQUEST_METHOD: `PUT` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:13.532870 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b0d733-1ad2-4b99-a640-33b9f79175ce admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:13.533152 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b0d733-1ad2-4b99-a640-33b9f79175ce admin admin] PATH_INFO: `/v3/projects/c1ea29f78bb44cc39ff1bba9b409c0c8/users/4ba0d82d5592401cb7b6cf2fe8550106/roles/1348580877d04014bfdec4d866b98a74` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:13.541157 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cb9133-3072-414e-858f-5358269325af None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:13.546137 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490d8190-274b-4177-a581-c42b4d31245d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:13.546796 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490d8190-274b-4177-a581-c42b4d31245d admin admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:13.547083 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490d8190-274b-4177-a581-c42b4d31245d admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:13.547404 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490d8190-274b-4177-a581-c42b4d31245d admin admin] PATH_INFO: `/v3/projects` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:13.548104 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490d8190-274b-4177-a581-c42b4d31245d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:13.550615 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490d8190-274b-4177-a581-c42b4d31245d admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:13.551652 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b0d733-1ad2-4b99-a640-33b9f79175ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1ea29f78bb44cc39ff1bba9b409c0c8, user_id=4ba0d82d5592401cb7b6cf2fe8550106, role_id=1348580877d04014bfdec4d866b98a74)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:13.554488 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b0d733-1ad2-4b99-a640-33b9f79175ce admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:13.601441 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:06:13.687742 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1271/2562] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 18:06:13 2022] PUT /identity/v3/projects/c1ea29f78bb44cc39ff1bba9b409c0c8/users/4ba0d82d5592401cb7b6cf2fe8550106/roles/1348580877d04014bfdec4d866b98a74 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 18:06:13.692483 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b0d733-1ad2-4b99-a640-33b9f79175ce admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:13.714107 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:06:13.723383 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1292/2563] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 14 18:06:13 2022] POST /identity/v3/projects => generated 387 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 18:06:13.725044 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490d8190-274b-4177-a581-c42b4d31245d admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:13.775029 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b0d733-1ad2-4b99-a640-33b9f79175ce admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:13.803678 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490d8190-274b-4177-a581-c42b4d31245d admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:13.811808 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115bd029-55ce-42a1-9a96-b4f7c5a98597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:13.812494 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115bd029-55ce-42a1-9a96-b4f7c5a98597 admin admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:13.812791 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115bd029-55ce-42a1-9a96-b4f7c5a98597 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:13.813065 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115bd029-55ce-42a1-9a96-b4f7c5a98597 admin admin] PATH_INFO: `/v3/users` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:13.813771 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115bd029-55ce-42a1-9a96-b4f7c5a98597 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:13.817678 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115bd029-55ce-42a1-9a96-b4f7c5a98597 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:13.844932 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd12ab9c-de8f-4a9e-b1db-9e72f9d43c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:13.845624 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd12ab9c-de8f-4a9e-b1db-9e72f9d43c9e admin admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:13.845908 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd12ab9c-de8f-4a9e-b1db-9e72f9d43c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:13.846193 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd12ab9c-de8f-4a9e-b1db-9e72f9d43c9e admin admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:13.850657 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd12ab9c-de8f-4a9e-b1db-9e72f9d43c9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:13.850657 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd12ab9c-de8f-4a9e-b1db-9e72f9d43c9e admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:13.860853 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1272/2564] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 18:06:13 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:06:13.866019 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd12ab9c-de8f-4a9e-b1db-9e72f9d43c9e admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:13.877025 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd12ab9c-de8f-4a9e-b1db-9e72f9d43c9e admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:13.882853 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500f6cb6-f3f3-4c86-b3a9-9957eb75bfd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:13.883928 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500f6cb6-f3f3-4c86-b3a9-9957eb75bfd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:13.884209 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500f6cb6-f3f3-4c86-b3a9-9957eb75bfd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:13.884491 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500f6cb6-f3f3-4c86-b3a9-9957eb75bfd5 admin admin] PATH_INFO: `/v3/projects/c1ea29f78bb44cc39ff1bba9b409c0c8/users/4ba0d82d5592401cb7b6cf2fe8550106/roles/1348580877d04014bfdec4d866b98a74` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:13.886603 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500f6cb6-f3f3-4c86-b3a9-9957eb75bfd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1ea29f78bb44cc39ff1bba9b409c0c8, user_id=4ba0d82d5592401cb7b6cf2fe8550106, role_id=1348580877d04014bfdec4d866b98a74)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:13.889558 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500f6cb6-f3f3-4c86-b3a9-9957eb75bfd5 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:13.904249 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1273/2565] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 18:06:13 2022] PUT /identity/v3/projects/c1ea29f78bb44cc39ff1bba9b409c0c8/users/4ba0d82d5592401cb7b6cf2fe8550106/roles/1348580877d04014bfdec4d866b98a74 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 18:06:13.921672 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f48896-7746-4c20-a0ae-01dc85fdda14 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:13.921967 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f48896-7746-4c20-a0ae-01dc85fdda14 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:13.922258 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f48896-7746-4c20-a0ae-01dc85fdda14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:13.952395 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1293/2566] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 14 18:06:13 2022] POST /identity/v3/users => generated 300 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:06:13.954258 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-e4f48896-7746-4c20-a0ae-01dc85fdda14 None None] MFA Rules not processed for user `4ba0d82d5592401cb7b6cf2fe8550106`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:06:13.955546 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-e4f48896-7746-4c20-a0ae-01dc85fdda14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:13.957376 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115bd029-55ce-42a1-9a96-b4f7c5a98597 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:13.967329 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115bd029-55ce-42a1-9a96-b4f7c5a98597 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:14.030517 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e66258-5928-479b-903f-aa62b8924a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:14.031117 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e66258-5928-479b-903f-aa62b8924a27 admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:14.031493 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e66258-5928-479b-903f-aa62b8924a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:14.031779 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e66258-5928-479b-903f-aa62b8924a27 admin admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:14.032515 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e66258-5928-479b-903f-aa62b8924a27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:14.034127 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e66258-5928-479b-903f-aa62b8924a27 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:14.036745 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1274/2567] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:06:13 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 18:06:14.045567 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1294/2568] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 18:06:13 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 14 18:06:14.049815 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f48896-7746-4c20-a0ae-01dc85fdda14 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:14.053433 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e66258-5928-479b-903f-aa62b8924a27 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:14.055101 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-a6e66258-5928-479b-903f-aa62b8924a27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:14.060854 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f48896-7746-4c20-a0ae-01dc85fdda14 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:14.065581 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d601fa8-e467-4f9c-8dd2-305fef9e504d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:14.068594 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d601fa8-e467-4f9c-8dd2-305fef9e504d admin admin] REQUEST_METHOD: `PUT` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:14.068594 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d601fa8-e467-4f9c-8dd2-305fef9e504d admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:14.068594 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d601fa8-e467-4f9c-8dd2-305fef9e504d admin admin] PATH_INFO: `/v3/projects/84885394ddc8447995f0e99c2dcddb9c/users/709949b8eaf744abbc45e8a67cdbda4a/roles/1348580877d04014bfdec4d866b98a74` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:14.084056 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d601fa8-e467-4f9c-8dd2-305fef9e504d admin admin] RBAC: Authorizing `identity:create_grant(project_id=84885394ddc8447995f0e99c2dcddb9c, user_id=709949b8eaf744abbc45e8a67cdbda4a, role_id=1348580877d04014bfdec4d866b98a74)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:14.086973 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d601fa8-e467-4f9c-8dd2-305fef9e504d admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:14.103552 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:06:14.125898 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e66258-5928-479b-903f-aa62b8924a27 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:14.125898 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7387f796-8fa7-4b7a-9418-e37d751b18f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17945e7d72954b8787e0ba09a9903247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:14.126353 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7387f796-8fa7-4b7a-9418-e37d751b18f7 service cinder] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:14.126755 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7387f796-8fa7-4b7a-9418-e37d751b18f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:14.127094 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7387f796-8fa7-4b7a-9418-e37d751b18f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:14.138328 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7387f796-8fa7-4b7a-9418-e37d751b18f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:14.139803 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7387f796-8fa7-4b7a-9418-e37d751b18f7 service cinder] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:14.151488 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1295/2569] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 18:06:14 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 18:06:14.232919 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1275/2570] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 18:06:14 2022] PUT /identity/v3/projects/84885394ddc8447995f0e99c2dcddb9c/users/709949b8eaf744abbc45e8a67cdbda4a/roles/1348580877d04014bfdec4d866b98a74 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:06:14.237062 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7387f796-8fa7-4b7a-9418-e37d751b18f7 service cinder] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:14.249525 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7387f796-8fa7-4b7a-9418-e37d751b18f7 service cinder] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:14.257369 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:06:14.360815 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42641c08-6021-4e84-abec-ad3c173911c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:14.361768 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42641c08-6021-4e84-abec-ad3c173911c0 admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:14.362176 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42641c08-6021-4e84-abec-ad3c173911c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:14.363477 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42641c08-6021-4e84-abec-ad3c173911c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:14.364650 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42641c08-6021-4e84-abec-ad3c173911c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:14.366717 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42641c08-6021-4e84-abec-ad3c173911c0 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:14.381153 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1296/2571] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 18:06:14 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:06:14.387841 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d601fa8-e467-4f9c-8dd2-305fef9e504d admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:14.417626 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d601fa8-e467-4f9c-8dd2-305fef9e504d admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:14.423560 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2d2ebc-6249-4840-a789-c8d247c66789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:14.424244 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2d2ebc-6249-4840-a789-c8d247c66789 admin admin] REQUEST_METHOD: `PUT` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:14.424537 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2d2ebc-6249-4840-a789-c8d247c66789 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:14.425801 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2d2ebc-6249-4840-a789-c8d247c66789 admin admin] PATH_INFO: `/v3/projects/84885394ddc8447995f0e99c2dcddb9c/users/709949b8eaf744abbc45e8a67cdbda4a/roles/1348580877d04014bfdec4d866b98a74` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:14.428345 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2d2ebc-6249-4840-a789-c8d247c66789 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84885394ddc8447995f0e99c2dcddb9c, user_id=709949b8eaf744abbc45e8a67cdbda4a, role_id=1348580877d04014bfdec4d866b98a74)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:14.431069 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2d2ebc-6249-4840-a789-c8d247c66789 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:14.453080 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1276/2572] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 18:06:14 2022] PUT /identity/v3/projects/84885394ddc8447995f0e99c2dcddb9c/users/709949b8eaf744abbc45e8a67cdbda4a/roles/1348580877d04014bfdec4d866b98a74 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:06:14.465192 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f5f64a-7f76-44ee-860d-6a5f0d033abe None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:14.465467 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f5f64a-7f76-44ee-860d-6a5f0d033abe None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:14.466077 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f5f64a-7f76-44ee-860d-6a5f0d033abe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:14.498560 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-f5f5f64a-7f76-44ee-860d-6a5f0d033abe None None] MFA Rules not processed for user `709949b8eaf744abbc45e8a67cdbda4a`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:06:14.500152 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-f5f5f64a-7f76-44ee-860d-6a5f0d033abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:14.600023 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1297/2573] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:06:14 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:06:14.628864 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2d2ebc-6249-4840-a789-c8d247c66789 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:14.695937 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2d2ebc-6249-4840-a789-c8d247c66789 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:14.699769 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95da280a-0081-4f56-b42a-8eadc9404a34 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17945e7d72954b8787e0ba09a9903247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:14.700427 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95da280a-0081-4f56-b42a-8eadc9404a34 service cinder] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:14.700714 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95da280a-0081-4f56-b42a-8eadc9404a34 service cinder] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:14.700995 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95da280a-0081-4f56-b42a-8eadc9404a34 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:14.712485 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95da280a-0081-4f56-b42a-8eadc9404a34 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:14.713934 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95da280a-0081-4f56-b42a-8eadc9404a34 service cinder] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:14.724088 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1277/2574] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 18:06:14 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:06:14.779100 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:06:15.412607 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f5f64a-7f76-44ee-860d-6a5f0d033abe None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:15.483600 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f5f64a-7f76-44ee-860d-6a5f0d033abe None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:15.487154 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcf069f-ae67-4275-9d9c-d58e3cb06be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:15.493805 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcf069f-ae67-4275-9d9c-d58e3cb06be1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:15.493805 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcf069f-ae67-4275-9d9c-d58e3cb06be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:15.493805 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcf069f-ae67-4275-9d9c-d58e3cb06be1 admin admin] PATH_INFO: `/v3/users/df5c5a085633482a8149471d2ae5b273` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:15.493805 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcf069f-ae67-4275-9d9c-d58e3cb06be1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df5c5a085633482a8149471d2ae5b273)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:15.493805 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcf069f-ae67-4275-9d9c-d58e3cb06be1 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:15.750918 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-7bcf069f-ae67-4275-9d9c-d58e3cb06be1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df5c5a085633482a8149471d2ae5b273'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:15.751643 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-7bcf069f-ae67-4275-9d9c-d58e3cb06be1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df5c5a085633482a8149471d2ae5b273'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:15.752270 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-7bcf069f-ae67-4275-9d9c-d58e3cb06be1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df5c5a085633482a8149471d2ae5b273'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:15.864132 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-7bcf069f-ae67-4275-9d9c-d58e3cb06be1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df5c5a085633482a8149471d2ae5b273'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:15.872003 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-7bcf069f-ae67-4275-9d9c-d58e3cb06be1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df5c5a085633482a8149471d2ae5b273'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:15.882534 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:06:15.890488 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1298/2575] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 14 18:06:15 2022] DELETE /identity/v3/users/df5c5a085633482a8149471d2ae5b273 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:06:15.896405 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d87af1-eccf-4599-abab-5b6285d6739c None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:15.896896 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d87af1-eccf-4599-abab-5b6285d6739c None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:15.896992 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d87af1-eccf-4599-abab-5b6285d6739c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:15.915659 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-64d87af1-eccf-4599-abab-5b6285d6739c None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:06:15.916884 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-64d87af1-eccf-4599-abab-5b6285d6739c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:15.959691 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:06:15.986414 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1278/2576] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:06:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:06:15.996669 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcf069f-ae67-4275-9d9c-d58e3cb06be1 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:15.998427 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-7bcf069f-ae67-4275-9d9c-d58e3cb06be1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:16.062164 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcf069f-ae67-4275-9d9c-d58e3cb06be1 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:16.066527 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a62598-99b8-48cb-bfd2-a348634b6fc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5652329c71cd431fb579d69cef933b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:16.067164 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a62598-99b8-48cb-bfd2-a348634b6fc2 service neutron] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:16.067487 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a62598-99b8-48cb-bfd2-a348634b6fc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:16.067775 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a62598-99b8-48cb-bfd2-a348634b6fc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:16.078005 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a62598-99b8-48cb-bfd2-a348634b6fc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:16.079539 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a62598-99b8-48cb-bfd2-a348634b6fc2 service neutron] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:16.089679 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1299/2577] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 18:06:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:06:16.226441 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d87af1-eccf-4599-abab-5b6285d6739c None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:16.227885 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-64d87af1-eccf-4599-abab-5b6285d6739c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:16.288532 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d87af1-eccf-4599-abab-5b6285d6739c None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:16.292285 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e526224-20ef-4bc4-b40b-ae9f7e1bfaf8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17945e7d72954b8787e0ba09a9903247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:16.292946 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e526224-20ef-4bc4-b40b-ae9f7e1bfaf8 service cinder] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:16.293235 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e526224-20ef-4bc4-b40b-ae9f7e1bfaf8 service cinder] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:16.293517 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e526224-20ef-4bc4-b40b-ae9f7e1bfaf8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:16.295326 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-9e526224-20ef-4bc4-b40b-ae9f7e1bfaf8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:16.368980 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e526224-20ef-4bc4-b40b-ae9f7e1bfaf8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:16.370449 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e526224-20ef-4bc4-b40b-ae9f7e1bfaf8 service cinder] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:16.380027 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1279/2578] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 18:06:16 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:06:16.664866 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a62598-99b8-48cb-bfd2-a348634b6fc2 service neutron] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:16.667135 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-73a62598-99b8-48cb-bfd2-a348634b6fc2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:16.682218 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a62598-99b8-48cb-bfd2-a348634b6fc2 service neutron] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:16.687876 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167ec8e4-832f-449f-91ec-e7b1e7d3bd88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:16.688858 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167ec8e4-832f-449f-91ec-e7b1e7d3bd88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:16.689219 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167ec8e4-832f-449f-91ec-e7b1e7d3bd88 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:16.689604 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167ec8e4-832f-449f-91ec-e7b1e7d3bd88 admin admin] PATH_INFO: `/v3/projects/a70e7d716ebc489b9bb7b1d95717b0f2` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:16.691656 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167ec8e4-832f-449f-91ec-e7b1e7d3bd88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a70e7d716ebc489b9bb7b1d95717b0f2)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:16.693694 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167ec8e4-832f-449f-91ec-e7b1e7d3bd88 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:16.830340 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-167ec8e4-832f-449f-91ec-e7b1e7d3bd88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a70e7d716ebc489b9bb7b1d95717b0f2', 'request_id': 'req-167ec8e4-832f-449f-91ec-e7b1e7d3bd88'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:16.896662 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-167ec8e4-832f-449f-91ec-e7b1e7d3bd88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a70e7d716ebc489b9bb7b1d95717b0f2', 'request_id': 'req-167ec8e4-832f-449f-91ec-e7b1e7d3bd88'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:16.904718 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-167ec8e4-832f-449f-91ec-e7b1e7d3bd88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a70e7d716ebc489b9bb7b1d95717b0f2', 'request_id': 'req-167ec8e4-832f-449f-91ec-e7b1e7d3bd88'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:16.918657 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-167ec8e4-832f-449f-91ec-e7b1e7d3bd88 admin admin] The token cache is being invalidate because project a70e7d716ebc489b9bb7b1d95717b0f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87019) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:06:16.918871 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-167ec8e4-832f-449f-91ec-e7b1e7d3bd88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:16.919674 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-167ec8e4-832f-449f-91ec-e7b1e7d3bd88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:16.921557 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1300/2579] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 14 18:06:16 2022] DELETE /identity/v3/projects/a70e7d716ebc489b9bb7b1d95717b0f2 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:06:16.926885 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e526224-20ef-4bc4-b40b-ae9f7e1bfaf8 service cinder] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:16.938154 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e526224-20ef-4bc4-b40b-ae9f7e1bfaf8 service cinder] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:17.000572 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d1476e-a014-49a9-a871-dca2579f4173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:17.001490 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d1476e-a014-49a9-a871-dca2579f4173 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:17.001777 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d1476e-a014-49a9-a871-dca2579f4173 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:17.002058 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d1476e-a014-49a9-a871-dca2579f4173 admin admin] PATH_INFO: `/v3/users/4ba0d82d5592401cb7b6cf2fe8550106` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:17.003406 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d1476e-a014-49a9-a871-dca2579f4173 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ba0d82d5592401cb7b6cf2fe8550106)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:17.005360 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d1476e-a014-49a9-a871-dca2579f4173 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:17.237477 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:06:17.243972 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-e3d1476e-a014-49a9-a871-dca2579f4173 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ba0d82d5592401cb7b6cf2fe8550106'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:17.244780 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-e3d1476e-a014-49a9-a871-dca2579f4173 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ba0d82d5592401cb7b6cf2fe8550106'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:17.245432 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-e3d1476e-a014-49a9-a871-dca2579f4173 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ba0d82d5592401cb7b6cf2fe8550106'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:17.355678 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-e3d1476e-a014-49a9-a871-dca2579f4173 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ba0d82d5592401cb7b6cf2fe8550106'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:17.366382 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-e3d1476e-a014-49a9-a871-dca2579f4173 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ba0d82d5592401cb7b6cf2fe8550106'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:17.386039 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1280/2580] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 14 18:06:16 2022] DELETE /identity/v3/users/4ba0d82d5592401cb7b6cf2fe8550106 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:06:17.864256 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167ec8e4-832f-449f-91ec-e7b1e7d3bd88 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:17.865750 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-167ec8e4-832f-449f-91ec-e7b1e7d3bd88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:17.882125 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167ec8e4-832f-449f-91ec-e7b1e7d3bd88 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:17.942700 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3edaaec-d6b0-4057-8798-b3f7c36fe148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:17.943619 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3edaaec-d6b0-4057-8798-b3f7c36fe148 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:17.943912 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3edaaec-d6b0-4057-8798-b3f7c36fe148 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:17.944196 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3edaaec-d6b0-4057-8798-b3f7c36fe148 admin admin] PATH_INFO: `/v3/projects/c1ea29f78bb44cc39ff1bba9b409c0c8` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:17.945400 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3edaaec-d6b0-4057-8798-b3f7c36fe148 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1ea29f78bb44cc39ff1bba9b409c0c8)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:17.947383 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3edaaec-d6b0-4057-8798-b3f7c36fe148 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:17.971288 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:06:18.105555 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-a3edaaec-d6b0-4057-8798-b3f7c36fe148 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1ea29f78bb44cc39ff1bba9b409c0c8', 'request_id': 'req-a3edaaec-d6b0-4057-8798-b3f7c36fe148'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:18.227862 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-a3edaaec-d6b0-4057-8798-b3f7c36fe148 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1ea29f78bb44cc39ff1bba9b409c0c8', 'request_id': 'req-a3edaaec-d6b0-4057-8798-b3f7c36fe148'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:18.234853 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-a3edaaec-d6b0-4057-8798-b3f7c36fe148 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1ea29f78bb44cc39ff1bba9b409c0c8', 'request_id': 'req-a3edaaec-d6b0-4057-8798-b3f7c36fe148'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:18.246635 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-a3edaaec-d6b0-4057-8798-b3f7c36fe148 admin admin] The token cache is being invalidate because project c1ea29f78bb44cc39ff1bba9b409c0c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87019) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:06:18.246928 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-a3edaaec-d6b0-4057-8798-b3f7c36fe148 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:18.247769 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-a3edaaec-d6b0-4057-8798-b3f7c36fe148 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:18.249526 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1301/2581] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 14 18:06:17 2022] DELETE /identity/v3/projects/c1ea29f78bb44cc39ff1bba9b409c0c8 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:06:18.258166 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d506d9e-1b1b-4cef-8b1d-944174289cee None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:18.258660 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d506d9e-1b1b-4cef-8b1d-944174289cee None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:18.258757 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d506d9e-1b1b-4cef-8b1d-944174289cee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:18.281217 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-2d506d9e-1b1b-4cef-8b1d-944174289cee None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:06:18.284879 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-2d506d9e-1b1b-4cef-8b1d-944174289cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:18.350643 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1281/2582] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:06:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 18:06:18.359804 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e14b0e-f952-4f95-8ab2-86aa966d7766 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:18.360092 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e14b0e-f952-4f95-8ab2-86aa966d7766 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:18.360376 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e14b0e-f952-4f95-8ab2-86aa966d7766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:18.380075 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-75e14b0e-f952-4f95-8ab2-86aa966d7766 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:06:18.381298 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-75e14b0e-f952-4f95-8ab2-86aa966d7766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:18.389443 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1302/2583] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:06:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:06:18.393871 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d506d9e-1b1b-4cef-8b1d-944174289cee None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:18.404176 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d506d9e-1b1b-4cef-8b1d-944174289cee None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:18.408933 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a592718f-406c-4207-9086-bc45c9707fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:18.410231 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a592718f-406c-4207-9086-bc45c9707fb0 admin admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:18.410596 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a592718f-406c-4207-9086-bc45c9707fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:18.410837 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a592718f-406c-4207-9086-bc45c9707fb0 admin admin] PATH_INFO: `/v3/domains` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:18.411598 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a592718f-406c-4207-9086-bc45c9707fb0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 18:06:18.411914 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a592718f-406c-4207-9086-bc45c9707fb0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:18.413518 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a592718f-406c-4207-9086-bc45c9707fb0 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:18.425949 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1282/2584] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 14 18:06:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 18:06:18.430541 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e14b0e-f952-4f95-8ab2-86aa966d7766 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:18.440158 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e14b0e-f952-4f95-8ab2-86aa966d7766 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:18.445305 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e06d8d7-ee99-4bec-b905-01af497a4928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:18.445980 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e06d8d7-ee99-4bec-b905-01af497a4928 admin admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:18.446274 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e06d8d7-ee99-4bec-b905-01af497a4928 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:18.446689 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e06d8d7-ee99-4bec-b905-01af497a4928 admin admin] PATH_INFO: `/v3/projects` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:18.447426 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e06d8d7-ee99-4bec-b905-01af497a4928 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:18.449379 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e06d8d7-ee99-4bec-b905-01af497a4928 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:18.556255 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1303/2585] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 14 18:06:18 2022] POST /identity/v3/projects => generated 375 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 18:06:18.557360 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a592718f-406c-4207-9086-bc45c9707fb0 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:18.567884 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a592718f-406c-4207-9086-bc45c9707fb0 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:18.627922 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e962653d-8a81-4e49-9c3f-3bf7a30f5228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:18.628695 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e962653d-8a81-4e49-9c3f-3bf7a30f5228 admin admin] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:18.628990 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e962653d-8a81-4e49-9c3f-3bf7a30f5228 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:18.629272 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e962653d-8a81-4e49-9c3f-3bf7a30f5228 admin admin] PATH_INFO: `/v3/users` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:18.629968 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e962653d-8a81-4e49-9c3f-3bf7a30f5228 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:18.631976 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e962653d-8a81-4e49-9c3f-3bf7a30f5228 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:18.728230 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1283/2586] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 14 18:06:18 2022] POST /identity/v3/users => generated 288 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:06:18.732535 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e06d8d7-ee99-4bec-b905-01af497a4928 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:18.744965 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e06d8d7-ee99-4bec-b905-01af497a4928 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:18.750203 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ae512f-7a46-41ac-9cac-bc98d82276f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:18.751131 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae512f-7a46-41ac-9cac-bc98d82276f9 admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:18.751290 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae512f-7a46-41ac-9cac-bc98d82276f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:18.751780 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae512f-7a46-41ac-9cac-bc98d82276f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:18.752258 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ae512f-7a46-41ac-9cac-bc98d82276f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:18.753849 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ae512f-7a46-41ac-9cac-bc98d82276f9 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:18.775097 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1304/2587] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 18:06:18 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:06:18.779809 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e962653d-8a81-4e49-9c3f-3bf7a30f5228 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:18.791957 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e962653d-8a81-4e49-9c3f-3bf7a30f5228 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:18.796818 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c830def-0b20-40ee-a4f6-c3f951cbe6b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:18.797566 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c830def-0b20-40ee-a4f6-c3f951cbe6b5 admin admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:18.797852 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c830def-0b20-40ee-a4f6-c3f951cbe6b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:18.798150 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c830def-0b20-40ee-a4f6-c3f951cbe6b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:18.799372 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c830def-0b20-40ee-a4f6-c3f951cbe6b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:18.800998 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c830def-0b20-40ee-a4f6-c3f951cbe6b5 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:18.815560 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1284/2588] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 18:06:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:06:18.816796 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ae512f-7a46-41ac-9cac-bc98d82276f9 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:18.827425 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ae512f-7a46-41ac-9cac-bc98d82276f9 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:18.833173 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec3efba-de11-4c75-bf59-635b8b9db822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:18.834077 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec3efba-de11-4c75-bf59-635b8b9db822 admin admin] REQUEST_METHOD: `PUT` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:18.834365 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec3efba-de11-4c75-bf59-635b8b9db822 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:18.834703 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec3efba-de11-4c75-bf59-635b8b9db822 admin admin] PATH_INFO: `/v3/projects/acb9e08baf7146329f9cd685d8150237/users/878893f3008045f8b2100d71c549db17/roles/9ee80134743f4c2b88525b04df2facba` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:18.850787 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec3efba-de11-4c75-bf59-635b8b9db822 admin admin] RBAC: Authorizing `identity:create_grant(project_id=acb9e08baf7146329f9cd685d8150237, user_id=878893f3008045f8b2100d71c549db17, role_id=9ee80134743f4c2b88525b04df2facba)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:18.853546 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec3efba-de11-4c75-bf59-635b8b9db822 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:18.996613 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1305/2589] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 18:06:18 2022] PUT /identity/v3/projects/acb9e08baf7146329f9cd685d8150237/users/878893f3008045f8b2100d71c549db17/roles/9ee80134743f4c2b88525b04df2facba => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:06:19.007160 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc943491-654c-48f4-91fd-7355daaf51a0 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:19.007525 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc943491-654c-48f4-91fd-7355daaf51a0 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:19.007925 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc943491-654c-48f4-91fd-7355daaf51a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:19.041087 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-bc943491-654c-48f4-91fd-7355daaf51a0 None None] MFA Rules not processed for user `878893f3008045f8b2100d71c549db17`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:06:19.042504 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-bc943491-654c-48f4-91fd-7355daaf51a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:19.059094 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:06:19.116762 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1285/2590] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:06:19 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:06:19.129414 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec3efba-de11-4c75-bf59-635b8b9db822 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:19.130806 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-cec3efba-de11-4c75-bf59-635b8b9db822 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:19.190333 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec3efba-de11-4c75-bf59-635b8b9db822 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:19.195207 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1986020b-28cb-456c-b52b-213e0ff64864 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17945e7d72954b8787e0ba09a9903247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:19.196011 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1986020b-28cb-456c-b52b-213e0ff64864 service cinder] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:19.196301 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1986020b-28cb-456c-b52b-213e0ff64864 service cinder] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:19.196769 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1986020b-28cb-456c-b52b-213e0ff64864 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:19.205259 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1986020b-28cb-456c-b52b-213e0ff64864 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:19.207431 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1986020b-28cb-456c-b52b-213e0ff64864 service cinder] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:19.216590 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1306/2591] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 18:06:19 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:06:21.962598 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc943491-654c-48f4-91fd-7355daaf51a0 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:21.964762 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-bc943491-654c-48f4-91fd-7355daaf51a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:21.978495 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc943491-654c-48f4-91fd-7355daaf51a0 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:21.983107 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d15eb08-dce6-480f-969c-b7ae15f0878f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17945e7d72954b8787e0ba09a9903247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:21.983952 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d15eb08-dce6-480f-969c-b7ae15f0878f service cinder] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:21.984250 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d15eb08-dce6-480f-969c-b7ae15f0878f service cinder] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:21.984535 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d15eb08-dce6-480f-969c-b7ae15f0878f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:21.986619 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-4d15eb08-dce6-480f-969c-b7ae15f0878f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:22.052547 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d15eb08-dce6-480f-969c-b7ae15f0878f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:22.053987 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d15eb08-dce6-480f-969c-b7ae15f0878f service cinder] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:22.063986 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1286/2592] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 18:06:21 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:06:22.328031 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1986020b-28cb-456c-b52b-213e0ff64864 service cinder] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:22.329461 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-1986020b-28cb-456c-b52b-213e0ff64864 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:22.385225 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:06:22.403356 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1986020b-28cb-456c-b52b-213e0ff64864 service cinder] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:22.408178 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69b406d-9e77-4b9e-a29c-0183d690dde7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:22.409053 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69b406d-9e77-4b9e-a29c-0183d690dde7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:22.409346 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69b406d-9e77-4b9e-a29c-0183d690dde7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:22.410277 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69b406d-9e77-4b9e-a29c-0183d690dde7 admin admin] PATH_INFO: `/v3/users/e9825391e82f449cb659a3dfca0fd1ea` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:22.411818 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69b406d-9e77-4b9e-a29c-0183d690dde7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9825391e82f449cb659a3dfca0fd1ea)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:22.413742 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69b406d-9e77-4b9e-a29c-0183d690dde7 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:22.628150 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-c69b406d-9e77-4b9e-a29c-0183d690dde7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9825391e82f449cb659a3dfca0fd1ea'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:22.629422 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-c69b406d-9e77-4b9e-a29c-0183d690dde7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9825391e82f449cb659a3dfca0fd1ea'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:22.630025 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-c69b406d-9e77-4b9e-a29c-0183d690dde7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9825391e82f449cb659a3dfca0fd1ea'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:22.685245 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-c69b406d-9e77-4b9e-a29c-0183d690dde7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9825391e82f449cb659a3dfca0fd1ea'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:22.694289 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-c69b406d-9e77-4b9e-a29c-0183d690dde7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9825391e82f449cb659a3dfca0fd1ea'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:22.713343 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1307/2593] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 14 18:06:22 2022] DELETE /identity/v3/users/e9825391e82f449cb659a3dfca0fd1ea => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:06:22.718111 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fedf98-b7f9-48e4-a3e3-c002ac0bde00 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:22.718410 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fedf98-b7f9-48e4-a3e3-c002ac0bde00 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:22.718704 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fedf98-b7f9-48e4-a3e3-c002ac0bde00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:22.736888 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-24fedf98-b7f9-48e4-a3e3-c002ac0bde00 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:06:22.738396 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-24fedf98-b7f9-48e4-a3e3-c002ac0bde00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:22.803314 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1287/2594] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:06:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:06:22.813336 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69b406d-9e77-4b9e-a29c-0183d690dde7 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:22.814780 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-c69b406d-9e77-4b9e-a29c-0183d690dde7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:22.874255 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69b406d-9e77-4b9e-a29c-0183d690dde7 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:22.879148 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9781ba-27a7-4020-b5d5-3c9e8e31a423 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5652329c71cd431fb579d69cef933b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:22.880059 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9781ba-27a7-4020-b5d5-3c9e8e31a423 service neutron] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:22.880352 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9781ba-27a7-4020-b5d5-3c9e8e31a423 service neutron] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:22.880635 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9781ba-27a7-4020-b5d5-3c9e8e31a423 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:22.891937 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9781ba-27a7-4020-b5d5-3c9e8e31a423 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:22.893456 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9781ba-27a7-4020-b5d5-3c9e8e31a423 service neutron] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:22.911226 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1308/2595] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 18:06:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 18:06:23.357225 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fedf98-b7f9-48e4-a3e3-c002ac0bde00 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:23.358503 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-24fedf98-b7f9-48e4-a3e3-c002ac0bde00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:23.373028 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fedf98-b7f9-48e4-a3e3-c002ac0bde00 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:23.377913 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8956109-b04d-44fb-bd49-b6dbc10e587f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:23.379448 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8956109-b04d-44fb-bd49-b6dbc10e587f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:23.379962 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8956109-b04d-44fb-bd49-b6dbc10e587f admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:23.380278 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8956109-b04d-44fb-bd49-b6dbc10e587f admin admin] PATH_INFO: `/v3/projects/a34a6566f23042bdbcb4077a2c32cb35` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:23.381518 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8956109-b04d-44fb-bd49-b6dbc10e587f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a34a6566f23042bdbcb4077a2c32cb35)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:23.383529 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8956109-b04d-44fb-bd49-b6dbc10e587f admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:23.502463 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:06:23.505278 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-e8956109-b04d-44fb-bd49-b6dbc10e587f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a34a6566f23042bdbcb4077a2c32cb35', 'request_id': 'req-e8956109-b04d-44fb-bd49-b6dbc10e587f'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:23.639426 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-e8956109-b04d-44fb-bd49-b6dbc10e587f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a34a6566f23042bdbcb4077a2c32cb35', 'request_id': 'req-e8956109-b04d-44fb-bd49-b6dbc10e587f'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:23.645734 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-e8956109-b04d-44fb-bd49-b6dbc10e587f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a34a6566f23042bdbcb4077a2c32cb35', 'request_id': 'req-e8956109-b04d-44fb-bd49-b6dbc10e587f'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:23.657580 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-e8956109-b04d-44fb-bd49-b6dbc10e587f admin admin] The token cache is being invalidate because project a34a6566f23042bdbcb4077a2c32cb35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:06:23.657868 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-e8956109-b04d-44fb-bd49-b6dbc10e587f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:23.658504 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-e8956109-b04d-44fb-bd49-b6dbc10e587f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:23.660848 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1288/2596] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 14 18:06:23 2022] DELETE /identity/v3/projects/a34a6566f23042bdbcb4077a2c32cb35 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:06:23.665322 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9781ba-27a7-4020-b5d5-3c9e8e31a423 service neutron] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:23.676809 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9781ba-27a7-4020-b5d5-3c9e8e31a423 service neutron] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:23.736571 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae839366-4c4f-43e7-ba73-f415974ba280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:23.737499 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae839366-4c4f-43e7-ba73-f415974ba280 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:23.739153 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae839366-4c4f-43e7-ba73-f415974ba280 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:23.739534 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae839366-4c4f-43e7-ba73-f415974ba280 admin admin] PATH_INFO: `/v3/users/da21fedd5be74ec797abb9b1d2fa711e` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:23.741519 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae839366-4c4f-43e7-ba73-f415974ba280 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da21fedd5be74ec797abb9b1d2fa711e)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:23.743769 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae839366-4c4f-43e7-ba73-f415974ba280 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:23.757966 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:06:24.273353 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-ae839366-4c4f-43e7-ba73-f415974ba280 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da21fedd5be74ec797abb9b1d2fa711e'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:24.274027 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-ae839366-4c4f-43e7-ba73-f415974ba280 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da21fedd5be74ec797abb9b1d2fa711e'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:24.274654 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-ae839366-4c4f-43e7-ba73-f415974ba280 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da21fedd5be74ec797abb9b1d2fa711e'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:24.333174 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-ae839366-4c4f-43e7-ba73-f415974ba280 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da21fedd5be74ec797abb9b1d2fa711e'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:24.340991 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-ae839366-4c4f-43e7-ba73-f415974ba280 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da21fedd5be74ec797abb9b1d2fa711e'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:24.358735 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1309/2597] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 14 18:06:23 2022] DELETE /identity/v3/users/da21fedd5be74ec797abb9b1d2fa711e => generated 0 bytes in 694 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:06:24.774845 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8956109-b04d-44fb-bd49-b6dbc10e587f admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:24.776392 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-e8956109-b04d-44fb-bd49-b6dbc10e587f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:24.793135 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8956109-b04d-44fb-bd49-b6dbc10e587f admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:24.858203 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b930db5e-abd6-41fa-afc8-ae3f8a0cd9b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:24.859082 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b930db5e-abd6-41fa-afc8-ae3f8a0cd9b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:24.859407 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b930db5e-abd6-41fa-afc8-ae3f8a0cd9b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:24.859702 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b930db5e-abd6-41fa-afc8-ae3f8a0cd9b0 admin admin] PATH_INFO: `/v3/projects/8ad5c06706764d3eaca45ba4921d5cb4` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:24.860942 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b930db5e-abd6-41fa-afc8-ae3f8a0cd9b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ad5c06706764d3eaca45ba4921d5cb4)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:24.863919 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b930db5e-abd6-41fa-afc8-ae3f8a0cd9b0 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:25.032391 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-b930db5e-abd6-41fa-afc8-ae3f8a0cd9b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ad5c06706764d3eaca45ba4921d5cb4', 'request_id': 'req-b930db5e-abd6-41fa-afc8-ae3f8a0cd9b0'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:25.178200 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-b930db5e-abd6-41fa-afc8-ae3f8a0cd9b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ad5c06706764d3eaca45ba4921d5cb4', 'request_id': 'req-b930db5e-abd6-41fa-afc8-ae3f8a0cd9b0'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:25.184844 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-b930db5e-abd6-41fa-afc8-ae3f8a0cd9b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ad5c06706764d3eaca45ba4921d5cb4', 'request_id': 'req-b930db5e-abd6-41fa-afc8-ae3f8a0cd9b0'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:25.196709 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-b930db5e-abd6-41fa-afc8-ae3f8a0cd9b0 admin admin] The token cache is being invalidate because project 8ad5c06706764d3eaca45ba4921d5cb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:06:25.197019 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-b930db5e-abd6-41fa-afc8-ae3f8a0cd9b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:25.197658 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-b930db5e-abd6-41fa-afc8-ae3f8a0cd9b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:25.199595 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1289/2598] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 14 18:06:24 2022] DELETE /identity/v3/projects/8ad5c06706764d3eaca45ba4921d5cb4 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:06:25.204653 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65db9bba-0e44-45e2-a8ac-0a6efde2d43f None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:25.207225 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65db9bba-0e44-45e2-a8ac-0a6efde2d43f None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:25.207225 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65db9bba-0e44-45e2-a8ac-0a6efde2d43f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:25.224826 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-65db9bba-0e44-45e2-a8ac-0a6efde2d43f None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:06:25.226092 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-65db9bba-0e44-45e2-a8ac-0a6efde2d43f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:25.315227 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1310/2599] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:06:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:06:25.323545 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b5cdef-725f-42d6-bcd4-7d82328e3add None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:25.323842 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b5cdef-725f-42d6-bcd4-7d82328e3add None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:25.324210 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b5cdef-725f-42d6-bcd4-7d82328e3add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:25.342628 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-a2b5cdef-725f-42d6-bcd4-7d82328e3add None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:06:25.346460 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-a2b5cdef-725f-42d6-bcd4-7d82328e3add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:25.353413 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1290/2600] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:06:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:06:25.357942 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65db9bba-0e44-45e2-a8ac-0a6efde2d43f None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:25.368938 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65db9bba-0e44-45e2-a8ac-0a6efde2d43f None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:25.373842 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13e77be-f147-4bf9-a8bf-e78c6b489be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:25.375143 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13e77be-f147-4bf9-a8bf-e78c6b489be9 admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:25.375661 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13e77be-f147-4bf9-a8bf-e78c6b489be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:25.375958 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13e77be-f147-4bf9-a8bf-e78c6b489be9 admin admin] PATH_INFO: `/v3/domains` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:25.377197 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13e77be-f147-4bf9-a8bf-e78c6b489be9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 18:06:25.377955 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13e77be-f147-4bf9-a8bf-e78c6b489be9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:25.379358 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13e77be-f147-4bf9-a8bf-e78c6b489be9 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:25.392725 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1311/2601] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 14 18:06:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 18:06:25.398129 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b5cdef-725f-42d6-bcd4-7d82328e3add None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:25.407835 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b5cdef-725f-42d6-bcd4-7d82328e3add None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:25.414176 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9774b420-ca37-459d-9235-3afdb8148a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:25.414912 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9774b420-ca37-459d-9235-3afdb8148a7d admin admin] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:25.415201 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9774b420-ca37-459d-9235-3afdb8148a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:25.415522 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9774b420-ca37-459d-9235-3afdb8148a7d admin admin] PATH_INFO: `/v3/projects` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:25.416246 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9774b420-ca37-459d-9235-3afdb8148a7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:25.418172 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9774b420-ca37-459d-9235-3afdb8148a7d admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:25.518102 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1291/2602] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 14 18:06:25 2022] POST /identity/v3/projects => generated 381 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:06:25.522909 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13e77be-f147-4bf9-a8bf-e78c6b489be9 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:25.533783 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13e77be-f147-4bf9-a8bf-e78c6b489be9 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:25.592819 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd92cb5-1828-45c0-b4d8-781320794ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:25.593495 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd92cb5-1828-45c0-b4d8-781320794ff3 admin admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:25.596837 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd92cb5-1828-45c0-b4d8-781320794ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:25.597691 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd92cb5-1828-45c0-b4d8-781320794ff3 admin admin] PATH_INFO: `/v3/users` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:25.598692 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd92cb5-1828-45c0-b4d8-781320794ff3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:25.600769 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd92cb5-1828-45c0-b4d8-781320794ff3 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:25.771141 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1312/2603] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 14 18:06:25 2022] POST /identity/v3/users => generated 291 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 18:06:25.776177 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9774b420-ca37-459d-9235-3afdb8148a7d admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:25.793853 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9774b420-ca37-459d-9235-3afdb8148a7d admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:25.800516 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63252dd6-6636-4e51-93f1-47028eba41c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:25.801476 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63252dd6-6636-4e51-93f1-47028eba41c0 admin admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:25.801771 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63252dd6-6636-4e51-93f1-47028eba41c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:25.802064 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63252dd6-6636-4e51-93f1-47028eba41c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:25.802922 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63252dd6-6636-4e51-93f1-47028eba41c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:25.804572 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63252dd6-6636-4e51-93f1-47028eba41c0 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:25.819108 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1292/2604] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 18:06:25 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:06:25.833756 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd92cb5-1828-45c0-b4d8-781320794ff3 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:25.844064 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd92cb5-1828-45c0-b4d8-781320794ff3 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:25.850157 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376c15e0-8c66-4d5c-b906-84bbcde1b7f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:25.850981 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376c15e0-8c66-4d5c-b906-84bbcde1b7f4 admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:25.851251 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376c15e0-8c66-4d5c-b906-84bbcde1b7f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:25.851564 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376c15e0-8c66-4d5c-b906-84bbcde1b7f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:25.852311 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376c15e0-8c66-4d5c-b906-84bbcde1b7f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:25.853921 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376c15e0-8c66-4d5c-b906-84bbcde1b7f4 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:25.855630 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:06:25.871269 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1313/2605] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 18:06:25 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:06:25.872546 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63252dd6-6636-4e51-93f1-47028eba41c0 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:25.883978 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63252dd6-6636-4e51-93f1-47028eba41c0 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:25.893899 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc666dc4-1ccf-4002-ae97-56138b6a1b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:25.895014 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc666dc4-1ccf-4002-ae97-56138b6a1b44 admin admin] REQUEST_METHOD: `PUT` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:25.895594 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc666dc4-1ccf-4002-ae97-56138b6a1b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:25.896026 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc666dc4-1ccf-4002-ae97-56138b6a1b44 admin admin] PATH_INFO: `/v3/projects/bb5f4de2450240f18108195710a073dd/users/0c3078c405e3487793dceac281ba03b9/roles/9ee80134743f4c2b88525b04df2facba` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:25.918432 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc666dc4-1ccf-4002-ae97-56138b6a1b44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb5f4de2450240f18108195710a073dd, user_id=0c3078c405e3487793dceac281ba03b9, role_id=9ee80134743f4c2b88525b04df2facba)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:25.922411 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc666dc4-1ccf-4002-ae97-56138b6a1b44 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:26.031127 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1293/2606] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 18:06:25 2022] PUT /identity/v3/projects/bb5f4de2450240f18108195710a073dd/users/0c3078c405e3487793dceac281ba03b9/roles/9ee80134743f4c2b88525b04df2facba => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:06:26.042495 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b19e61-0cab-4bf9-a4e9-0d47854d58b5 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:26.042701 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b19e61-0cab-4bf9-a4e9-0d47854d58b5 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:26.042993 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b19e61-0cab-4bf9-a4e9-0d47854d58b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:26.070778 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-57b19e61-0cab-4bf9-a4e9-0d47854d58b5 None None] MFA Rules not processed for user `0c3078c405e3487793dceac281ba03b9`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:06:26.072034 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-57b19e61-0cab-4bf9-a4e9-0d47854d58b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:26.142660 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1314/2607] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:06:26 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:06:26.147406 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc666dc4-1ccf-4002-ae97-56138b6a1b44 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:26.152307 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:06:26.216033 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc666dc4-1ccf-4002-ae97-56138b6a1b44 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:26.221116 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836645fb-bd9f-466c-b121-a698d0e183fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:26.221787 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836645fb-bd9f-466c-b121-a698d0e183fc admin admin] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:26.222845 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836645fb-bd9f-466c-b121-a698d0e183fc admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:26.223201 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836645fb-bd9f-466c-b121-a698d0e183fc admin admin] PATH_INFO: `/v3/projects` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:26.223942 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836645fb-bd9f-466c-b121-a698d0e183fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:26.225886 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836645fb-bd9f-466c-b121-a698d0e183fc admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:26.346085 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1294/2608] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 14 18:06:26 2022] POST /identity/v3/projects => generated 379 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:06:26.350578 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b19e61-0cab-4bf9-a4e9-0d47854d58b5 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:26.361621 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b19e61-0cab-4bf9-a4e9-0d47854d58b5 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:26.423121 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903021a7-5366-4abd-be8e-c95bb69a81e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:26.423836 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903021a7-5366-4abd-be8e-c95bb69a81e4 admin admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:26.424128 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903021a7-5366-4abd-be8e-c95bb69a81e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:26.424415 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903021a7-5366-4abd-be8e-c95bb69a81e4 admin admin] PATH_INFO: `/v3/users` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:26.425156 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903021a7-5366-4abd-be8e-c95bb69a81e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:26.427172 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903021a7-5366-4abd-be8e-c95bb69a81e4 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:26.578984 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1315/2609] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 14 18:06:26 2022] POST /identity/v3/users => generated 296 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:06:26.583852 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836645fb-bd9f-466c-b121-a698d0e183fc admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:26.594398 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836645fb-bd9f-466c-b121-a698d0e183fc admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:26.599052 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0775725-49a4-458f-88a5-1132e961694a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:26.599694 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0775725-49a4-458f-88a5-1132e961694a admin admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:26.599984 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0775725-49a4-458f-88a5-1132e961694a admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:26.600265 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0775725-49a4-458f-88a5-1132e961694a admin admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:26.601021 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0775725-49a4-458f-88a5-1132e961694a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:26.602626 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0775725-49a4-458f-88a5-1132e961694a admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:26.613483 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1295/2610] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 18:06:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:06:26.621625 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903021a7-5366-4abd-be8e-c95bb69a81e4 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:26.632964 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903021a7-5366-4abd-be8e-c95bb69a81e4 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:26.638161 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bed96b-4f95-4b81-922e-194d150b35e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:26.639067 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bed96b-4f95-4b81-922e-194d150b35e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:26.639378 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bed96b-4f95-4b81-922e-194d150b35e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:26.641630 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bed96b-4f95-4b81-922e-194d150b35e5 admin admin] PATH_INFO: `/v3/projects/a4276fc99c7d4df3be12f0fc71356ca0/users/90e7dc7b9da646f0b043e48bc4ac7d41/roles/1348580877d04014bfdec4d866b98a74` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:26.656671 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bed96b-4f95-4b81-922e-194d150b35e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4276fc99c7d4df3be12f0fc71356ca0, user_id=90e7dc7b9da646f0b043e48bc4ac7d41, role_id=1348580877d04014bfdec4d866b98a74)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:26.659366 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bed96b-4f95-4b81-922e-194d150b35e5 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:26.745243 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1316/2611] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 18:06:26 2022] PUT /identity/v3/projects/a4276fc99c7d4df3be12f0fc71356ca0/users/90e7dc7b9da646f0b043e48bc4ac7d41/roles/1348580877d04014bfdec4d866b98a74 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:06:26.749417 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0775725-49a4-458f-88a5-1132e961694a admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:26.760221 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0775725-49a4-458f-88a5-1132e961694a admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:26.820079 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc0d650-08a2-4557-a426-cf94686c7178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:26.820808 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc0d650-08a2-4557-a426-cf94686c7178 admin admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:26.821046 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc0d650-08a2-4557-a426-cf94686c7178 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:26.821291 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc0d650-08a2-4557-a426-cf94686c7178 admin admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:26.822029 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc0d650-08a2-4557-a426-cf94686c7178 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:26.823851 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc0d650-08a2-4557-a426-cf94686c7178 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:26.840706 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1296/2612] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 18:06:26 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:06:26.844921 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bed96b-4f95-4b81-922e-194d150b35e5 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:26.856467 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bed96b-4f95-4b81-922e-194d150b35e5 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:26.862060 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d608eb1-476a-4cc5-92c6-e9fec5941dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:26.862990 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d608eb1-476a-4cc5-92c6-e9fec5941dc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:26.863286 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d608eb1-476a-4cc5-92c6-e9fec5941dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:26.864203 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d608eb1-476a-4cc5-92c6-e9fec5941dc9 admin admin] PATH_INFO: `/v3/projects/a4276fc99c7d4df3be12f0fc71356ca0/users/90e7dc7b9da646f0b043e48bc4ac7d41/roles/1348580877d04014bfdec4d866b98a74` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:26.866271 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d608eb1-476a-4cc5-92c6-e9fec5941dc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4276fc99c7d4df3be12f0fc71356ca0, user_id=90e7dc7b9da646f0b043e48bc4ac7d41, role_id=1348580877d04014bfdec4d866b98a74)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:26.869052 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d608eb1-476a-4cc5-92c6-e9fec5941dc9 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:26.880196 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1317/2613] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 18:06:26 2022] PUT /identity/v3/projects/a4276fc99c7d4df3be12f0fc71356ca0/users/90e7dc7b9da646f0b043e48bc4ac7d41/roles/1348580877d04014bfdec4d866b98a74 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:06:26.891755 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b453f78-d2a6-4b92-baec-6e529726cff0 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:26.892085 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b453f78-d2a6-4b92-baec-6e529726cff0 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:26.892464 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b453f78-d2a6-4b92-baec-6e529726cff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:26.922034 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-4b453f78-d2a6-4b92-baec-6e529726cff0 None None] MFA Rules not processed for user `90e7dc7b9da646f0b043e48bc4ac7d41`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:06:26.923245 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-4b453f78-d2a6-4b92-baec-6e529726cff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:26.992378 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:06:26.997531 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1297/2614] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:06:26 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 18:06:27.367154 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d608eb1-476a-4cc5-92c6-e9fec5941dc9 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:27.369323 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-9d608eb1-476a-4cc5-92c6-e9fec5941dc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:27.372231 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b453f78-d2a6-4b92-baec-6e529726cff0 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:27.373621 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-4b453f78-d2a6-4b92-baec-6e529726cff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:27.419105 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:06:27.436075 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b453f78-d2a6-4b92-baec-6e529726cff0 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:27.439965 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b642dc-0cfc-4ed8-a00f-874e0bfb8c9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17945e7d72954b8787e0ba09a9903247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:27.440619 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b642dc-0cfc-4ed8-a00f-874e0bfb8c9a service cinder] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:27.440920 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b642dc-0cfc-4ed8-a00f-874e0bfb8c9a service cinder] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:27.441189 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b642dc-0cfc-4ed8-a00f-874e0bfb8c9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:27.443923 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d608eb1-476a-4cc5-92c6-e9fec5941dc9 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:27.448542 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7c4430-5227-4943-aaa1-ac457d57cdc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:27.449416 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7c4430-5227-4943-aaa1-ac457d57cdc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:27.449707 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7c4430-5227-4943-aaa1-ac457d57cdc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:27.449983 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7c4430-5227-4943-aaa1-ac457d57cdc6 admin admin] PATH_INFO: `/v3/users/6b4b0657cc864c74a1e568b645088ff9` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:27.451201 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7c4430-5227-4943-aaa1-ac457d57cdc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b4b0657cc864c74a1e568b645088ff9)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:27.452591 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b642dc-0cfc-4ed8-a00f-874e0bfb8c9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:27.453174 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7c4430-5227-4943-aaa1-ac457d57cdc6 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:27.454020 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b642dc-0cfc-4ed8-a00f-874e0bfb8c9a service cinder] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:27.465561 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1298/2615] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 18:06:27 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 18:06:27.773407 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-6a7c4430-5227-4943-aaa1-ac457d57cdc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b4b0657cc864c74a1e568b645088ff9'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:27.774187 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-6a7c4430-5227-4943-aaa1-ac457d57cdc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b4b0657cc864c74a1e568b645088ff9'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:27.774808 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-6a7c4430-5227-4943-aaa1-ac457d57cdc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b4b0657cc864c74a1e568b645088ff9'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:27.856230 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-6a7c4430-5227-4943-aaa1-ac457d57cdc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b4b0657cc864c74a1e568b645088ff9'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:27.864610 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-6a7c4430-5227-4943-aaa1-ac457d57cdc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b4b0657cc864c74a1e568b645088ff9'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:27.883390 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1318/2616] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 14 18:06:27 2022] DELETE /identity/v3/users/6b4b0657cc864c74a1e568b645088ff9 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:06:27.887855 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3242975-c76c-4c2d-a08f-748bc6e5db6c None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:27.888329 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3242975-c76c-4c2d-a08f-748bc6e5db6c None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:27.888507 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3242975-c76c-4c2d-a08f-748bc6e5db6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:27.914885 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-a3242975-c76c-4c2d-a08f-748bc6e5db6c None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:06:27.914885 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-a3242975-c76c-4c2d-a08f-748bc6e5db6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:27.972212 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1299/2617] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:06:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 18:06:27.982172 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7c4430-5227-4943-aaa1-ac457d57cdc6 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:27.983708 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-6a7c4430-5227-4943-aaa1-ac457d57cdc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:28.046036 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7c4430-5227-4943-aaa1-ac457d57cdc6 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:28.049831 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fd5bd3-ca30-4a90-8c94-e18972d27e66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5652329c71cd431fb579d69cef933b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:28.050509 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fd5bd3-ca30-4a90-8c94-e18972d27e66 service neutron] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:28.050781 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fd5bd3-ca30-4a90-8c94-e18972d27e66 service neutron] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:28.051747 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fd5bd3-ca30-4a90-8c94-e18972d27e66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:28.061340 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fd5bd3-ca30-4a90-8c94-e18972d27e66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:28.064115 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fd5bd3-ca30-4a90-8c94-e18972d27e66 service neutron] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:28.072563 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1319/2618] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 18:06:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:06:28.496154 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3242975-c76c-4c2d-a08f-748bc6e5db6c None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:28.497743 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-a3242975-c76c-4c2d-a08f-748bc6e5db6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:28.512118 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3242975-c76c-4c2d-a08f-748bc6e5db6c None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:28.516922 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58052320-7524-4c09-bd24-0c28e05039c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:28.517798 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58052320-7524-4c09-bd24-0c28e05039c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:28.518127 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58052320-7524-4c09-bd24-0c28e05039c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:28.518414 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58052320-7524-4c09-bd24-0c28e05039c0 admin admin] PATH_INFO: `/v3/projects/ffb7c93beba049d3b0a4871db73f7ea1` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:28.519936 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58052320-7524-4c09-bd24-0c28e05039c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffb7c93beba049d3b0a4871db73f7ea1)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:28.521898 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58052320-7524-4c09-bd24-0c28e05039c0 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:28.681669 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fd5bd3-ca30-4a90-8c94-e18972d27e66 service neutron] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:28.683102 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-75fd5bd3-ca30-4a90-8c94-e18972d27e66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:28.684232 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-58052320-7524-4c09-bd24-0c28e05039c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffb7c93beba049d3b0a4871db73f7ea1', 'request_id': 'req-58052320-7524-4c09-bd24-0c28e05039c0'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:28.750820 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fd5bd3-ca30-4a90-8c94-e18972d27e66 service neutron] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:28.755128 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:06:28.808533 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0fa8fa-6499-44cb-ba7e-9e5c97b4eab1 tempest-VolumeQuotaClassesTest-310699516 tempest-VolumeQuotaClassesTest-310699516-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90e7dc7b9da646f0b043e48bc4ac7d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4276fc99c7d4df3be12f0fc71356ca0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:28.809195 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0fa8fa-6499-44cb-ba7e-9e5c97b4eab1 tempest-VolumeQuotaClassesTest-310699516 tempest-VolumeQuotaClassesTest-310699516-project-admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:28.809483 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0fa8fa-6499-44cb-ba7e-9e5c97b4eab1 tempest-VolumeQuotaClassesTest-310699516 tempest-VolumeQuotaClassesTest-310699516-project-admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:28.809763 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0fa8fa-6499-44cb-ba7e-9e5c97b4eab1 tempest-VolumeQuotaClassesTest-310699516 tempest-VolumeQuotaClassesTest-310699516-project-admin] PATH_INFO: `/v3/domains` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:28.810490 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0fa8fa-6499-44cb-ba7e-9e5c97b4eab1 tempest-VolumeQuotaClassesTest-310699516 tempest-VolumeQuotaClassesTest-310699516-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 18:06:28.810804 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0fa8fa-6499-44cb-ba7e-9e5c97b4eab1 tempest-VolumeQuotaClassesTest-310699516 tempest-VolumeQuotaClassesTest-310699516-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:28.812430 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0fa8fa-6499-44cb-ba7e-9e5c97b4eab1 tempest-VolumeQuotaClassesTest-310699516 tempest-VolumeQuotaClassesTest-310699516-project-admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:28.823949 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1320/2619] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 14 18:06:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 18:06:28.828319 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0fa8fa-6499-44cb-ba7e-9e5c97b4eab1 tempest-VolumeQuotaClassesTest-310699516 tempest-VolumeQuotaClassesTest-310699516-project-admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:28.831364 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-58052320-7524-4c09-bd24-0c28e05039c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffb7c93beba049d3b0a4871db73f7ea1', 'request_id': 'req-58052320-7524-4c09-bd24-0c28e05039c0'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:28.836699 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-58052320-7524-4c09-bd24-0c28e05039c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffb7c93beba049d3b0a4871db73f7ea1', 'request_id': 'req-58052320-7524-4c09-bd24-0c28e05039c0'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:28.839020 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0fa8fa-6499-44cb-ba7e-9e5c97b4eab1 tempest-VolumeQuotaClassesTest-310699516 tempest-VolumeQuotaClassesTest-310699516-project-admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:28.843969 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aa0f36-32d0-48db-9a49-63d227847f80 tempest-VolumeQuotaClassesTest-310699516 tempest-VolumeQuotaClassesTest-310699516-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90e7dc7b9da646f0b043e48bc4ac7d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4276fc99c7d4df3be12f0fc71356ca0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:28.844641 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aa0f36-32d0-48db-9a49-63d227847f80 tempest-VolumeQuotaClassesTest-310699516 tempest-VolumeQuotaClassesTest-310699516-project-admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:28.844931 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aa0f36-32d0-48db-9a49-63d227847f80 tempest-VolumeQuotaClassesTest-310699516 tempest-VolumeQuotaClassesTest-310699516-project-admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:28.845213 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aa0f36-32d0-48db-9a49-63d227847f80 tempest-VolumeQuotaClassesTest-310699516 tempest-VolumeQuotaClassesTest-310699516-project-admin] PATH_INFO: `/v3/projects` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:28.846260 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aa0f36-32d0-48db-9a49-63d227847f80 tempest-VolumeQuotaClassesTest-310699516 tempest-VolumeQuotaClassesTest-310699516-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:28.849278 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aa0f36-32d0-48db-9a49-63d227847f80 tempest-VolumeQuotaClassesTest-310699516 tempest-VolumeQuotaClassesTest-310699516-project-admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:28.851171 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-58052320-7524-4c09-bd24-0c28e05039c0 admin admin] The token cache is being invalidate because project ffb7c93beba049d3b0a4871db73f7ea1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:06:28.851512 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-58052320-7524-4c09-bd24-0c28e05039c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:28.852178 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-58052320-7524-4c09-bd24-0c28e05039c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:28.853749 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1300/2620] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 14 18:06:28 2022] DELETE /identity/v3/projects/ffb7c93beba049d3b0a4871db73f7ea1 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:06:28.857946 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58052320-7524-4c09-bd24-0c28e05039c0 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:28.859401 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-58052320-7524-4c09-bd24-0c28e05039c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:28.890341 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:06:28.931558 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58052320-7524-4c09-bd24-0c28e05039c0 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:28.936574 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb750a8b-0e6f-43c9-9b75-8089bcdffe5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:28.937462 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb750a8b-0e6f-43c9-9b75-8089bcdffe5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:28.937753 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb750a8b-0e6f-43c9-9b75-8089bcdffe5d admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:28.938035 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb750a8b-0e6f-43c9-9b75-8089bcdffe5d admin admin] PATH_INFO: `/v3/users/fd8583a6c0af4df6ad84cf842a8a281e` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:28.939363 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb750a8b-0e6f-43c9-9b75-8089bcdffe5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd8583a6c0af4df6ad84cf842a8a281e)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:28.941328 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb750a8b-0e6f-43c9-9b75-8089bcdffe5d admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:28.981280 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1321/2621] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 14 18:06:28 2022] POST /identity/v3/projects => generated 355 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 18:06:28.984305 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aa0f36-32d0-48db-9a49-63d227847f80 tempest-VolumeQuotaClassesTest-310699516 tempest-VolumeQuotaClassesTest-310699516-project-admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:28.985977 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-29aa0f36-32d0-48db-9a49-63d227847f80 tempest-VolumeQuotaClassesTest-310699516 tempest-VolumeQuotaClassesTest-310699516-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:29.064070 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aa0f36-32d0-48db-9a49-63d227847f80 tempest-VolumeQuotaClassesTest-310699516 tempest-VolumeQuotaClassesTest-310699516-project-admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:29.068906 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde4017b-f1f6-440f-aefa-0084d9b94bbf tempest-VolumeQuotaClassesTest-310699516 tempest-VolumeQuotaClassesTest-310699516-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90e7dc7b9da646f0b043e48bc4ac7d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4276fc99c7d4df3be12f0fc71356ca0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:29.069580 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde4017b-f1f6-440f-aefa-0084d9b94bbf tempest-VolumeQuotaClassesTest-310699516 tempest-VolumeQuotaClassesTest-310699516-project-admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:29.069875 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde4017b-f1f6-440f-aefa-0084d9b94bbf tempest-VolumeQuotaClassesTest-310699516 tempest-VolumeQuotaClassesTest-310699516-project-admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:29.070163 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde4017b-f1f6-440f-aefa-0084d9b94bbf tempest-VolumeQuotaClassesTest-310699516 tempest-VolumeQuotaClassesTest-310699516-project-admin] PATH_INFO: `/v3/domains` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:29.070895 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde4017b-f1f6-440f-aefa-0084d9b94bbf tempest-VolumeQuotaClassesTest-310699516 tempest-VolumeQuotaClassesTest-310699516-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 18:06:29.071219 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde4017b-f1f6-440f-aefa-0084d9b94bbf tempest-VolumeQuotaClassesTest-310699516 tempest-VolumeQuotaClassesTest-310699516-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:29.072858 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde4017b-f1f6-440f-aefa-0084d9b94bbf tempest-VolumeQuotaClassesTest-310699516 tempest-VolumeQuotaClassesTest-310699516-project-admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:29.084485 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1322/2622] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 14 18:06:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 18:06:29.121249 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde4017b-f1f6-440f-aefa-0084d9b94bbf tempest-VolumeQuotaClassesTest-310699516 tempest-VolumeQuotaClassesTest-310699516-project-admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:29.131772 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde4017b-f1f6-440f-aefa-0084d9b94bbf tempest-VolumeQuotaClassesTest-310699516 tempest-VolumeQuotaClassesTest-310699516-project-admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:29.136831 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399c4706-15b0-4a82-bc78-8c6df6775523 tempest-VolumeQuotaClassesTest-310699516 tempest-VolumeQuotaClassesTest-310699516-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90e7dc7b9da646f0b043e48bc4ac7d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4276fc99c7d4df3be12f0fc71356ca0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:29.140049 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399c4706-15b0-4a82-bc78-8c6df6775523 tempest-VolumeQuotaClassesTest-310699516 tempest-VolumeQuotaClassesTest-310699516-project-admin] REQUEST_METHOD: `DELETE` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:29.140049 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399c4706-15b0-4a82-bc78-8c6df6775523 tempest-VolumeQuotaClassesTest-310699516 tempest-VolumeQuotaClassesTest-310699516-project-admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:29.140049 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399c4706-15b0-4a82-bc78-8c6df6775523 tempest-VolumeQuotaClassesTest-310699516 tempest-VolumeQuotaClassesTest-310699516-project-admin] PATH_INFO: `/v3/projects/5c7e2555d377473eb9b54fbcc702e26c` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:29.140049 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399c4706-15b0-4a82-bc78-8c6df6775523 tempest-VolumeQuotaClassesTest-310699516 tempest-VolumeQuotaClassesTest-310699516-project-admin] RBAC: Authorizing `identity:delete_project(project_id=5c7e2555d377473eb9b54fbcc702e26c)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:29.141371 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399c4706-15b0-4a82-bc78-8c6df6775523 tempest-VolumeQuotaClassesTest-310699516 tempest-VolumeQuotaClassesTest-310699516-project-admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:29.221693 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-eb750a8b-0e6f-43c9-9b75-8089bcdffe5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd8583a6c0af4df6ad84cf842a8a281e'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:29.222436 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-eb750a8b-0e6f-43c9-9b75-8089bcdffe5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd8583a6c0af4df6ad84cf842a8a281e'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:29.223721 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-eb750a8b-0e6f-43c9-9b75-8089bcdffe5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd8583a6c0af4df6ad84cf842a8a281e'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:29.258609 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-399c4706-15b0-4a82-bc78-8c6df6775523 tempest-VolumeQuotaClassesTest-310699516 tempest-VolumeQuotaClassesTest-310699516-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c7e2555d377473eb9b54fbcc702e26c', 'request_id': 'req-399c4706-15b0-4a82-bc78-8c6df6775523'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:29.298016 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-eb750a8b-0e6f-43c9-9b75-8089bcdffe5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd8583a6c0af4df6ad84cf842a8a281e'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:29.306195 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-eb750a8b-0e6f-43c9-9b75-8089bcdffe5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd8583a6c0af4df6ad84cf842a8a281e'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:29.324910 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1301/2623] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 14 18:06:28 2022] DELETE /identity/v3/users/fd8583a6c0af4df6ad84cf842a8a281e => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 18:06:29.355561 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-399c4706-15b0-4a82-bc78-8c6df6775523 tempest-VolumeQuotaClassesTest-310699516 tempest-VolumeQuotaClassesTest-310699516-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c7e2555d377473eb9b54fbcc702e26c', 'request_id': 'req-399c4706-15b0-4a82-bc78-8c6df6775523'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:29.365514 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-399c4706-15b0-4a82-bc78-8c6df6775523 tempest-VolumeQuotaClassesTest-310699516 tempest-VolumeQuotaClassesTest-310699516-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c7e2555d377473eb9b54fbcc702e26c', 'request_id': 'req-399c4706-15b0-4a82-bc78-8c6df6775523'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:29.370363 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:06:29.376803 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-399c4706-15b0-4a82-bc78-8c6df6775523 tempest-VolumeQuotaClassesTest-310699516 tempest-VolumeQuotaClassesTest-310699516-project-admin] The token cache is being invalidate because project 5c7e2555d377473eb9b54fbcc702e26c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87019) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:06:29.377051 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-399c4706-15b0-4a82-bc78-8c6df6775523 tempest-VolumeQuotaClassesTest-310699516 tempest-VolumeQuotaClassesTest-310699516-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:29.377752 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-399c4706-15b0-4a82-bc78-8c6df6775523 tempest-VolumeQuotaClassesTest-310699516 tempest-VolumeQuotaClassesTest-310699516-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:29.380686 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1323/2624] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 14 18:06:29 2022] DELETE /identity/v3/projects/5c7e2555d377473eb9b54fbcc702e26c => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 18:06:29.818951 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb750a8b-0e6f-43c9-9b75-8089bcdffe5d admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:29.820514 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-eb750a8b-0e6f-43c9-9b75-8089bcdffe5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:29.891825 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb750a8b-0e6f-43c9-9b75-8089bcdffe5d admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:29.897015 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c3ba10-8202-435c-9a26-dad8aeb44051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:29.898772 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c3ba10-8202-435c-9a26-dad8aeb44051 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:29.898772 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c3ba10-8202-435c-9a26-dad8aeb44051 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:29.898772 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c3ba10-8202-435c-9a26-dad8aeb44051 admin admin] PATH_INFO: `/v3/projects/6a4cc2599a9c457ca14fe370306106fc` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:29.900907 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c3ba10-8202-435c-9a26-dad8aeb44051 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a4cc2599a9c457ca14fe370306106fc)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:29.903365 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c3ba10-8202-435c-9a26-dad8aeb44051 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:30.045537 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:06:30.048461 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-58c3ba10-8202-435c-9a26-dad8aeb44051 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a4cc2599a9c457ca14fe370306106fc', 'request_id': 'req-58c3ba10-8202-435c-9a26-dad8aeb44051'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:30.171273 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399c4706-15b0-4a82-bc78-8c6df6775523 tempest-VolumeQuotaClassesTest-310699516 tempest-VolumeQuotaClassesTest-310699516-project-admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:30.173335 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-399c4706-15b0-4a82-bc78-8c6df6775523 tempest-VolumeQuotaClassesTest-310699516 tempest-VolumeQuotaClassesTest-310699516-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:30.174181 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-58c3ba10-8202-435c-9a26-dad8aeb44051 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a4cc2599a9c457ca14fe370306106fc', 'request_id': 'req-58c3ba10-8202-435c-9a26-dad8aeb44051'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:30.188614 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-58c3ba10-8202-435c-9a26-dad8aeb44051 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a4cc2599a9c457ca14fe370306106fc', 'request_id': 'req-58c3ba10-8202-435c-9a26-dad8aeb44051'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:30.201075 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-58c3ba10-8202-435c-9a26-dad8aeb44051 admin admin] The token cache is being invalidate because project 6a4cc2599a9c457ca14fe370306106fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:06:30.201464 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-58c3ba10-8202-435c-9a26-dad8aeb44051 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:30.202213 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-58c3ba10-8202-435c-9a26-dad8aeb44051 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:30.204259 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1302/2625] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 14 18:06:29 2022] DELETE /identity/v3/projects/6a4cc2599a9c457ca14fe370306106fc => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 18:06:30.208899 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c3ba10-8202-435c-9a26-dad8aeb44051 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:30.210290 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-58c3ba10-8202-435c-9a26-dad8aeb44051 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:30.245054 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399c4706-15b0-4a82-bc78-8c6df6775523 tempest-VolumeQuotaClassesTest-310699516 tempest-VolumeQuotaClassesTest-310699516-project-admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:30.277628 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c3ba10-8202-435c-9a26-dad8aeb44051 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:30.283749 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cea489e-ffae-48aa-bc7d-26c8f94fca4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:30.284752 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cea489e-ffae-48aa-bc7d-26c8f94fca4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:30.285043 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cea489e-ffae-48aa-bc7d-26c8f94fca4d admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:30.286215 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cea489e-ffae-48aa-bc7d-26c8f94fca4d admin admin] PATH_INFO: `/v3/users/709949b8eaf744abbc45e8a67cdbda4a` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:30.287565 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cea489e-ffae-48aa-bc7d-26c8f94fca4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=709949b8eaf744abbc45e8a67cdbda4a)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:30.289560 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cea489e-ffae-48aa-bc7d-26c8f94fca4d admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:30.310757 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b426b73-42cc-42b7-b58b-4d95382ac9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:30.312974 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b426b73-42cc-42b7-b58b-4d95382ac9e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:30.312974 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b426b73-42cc-42b7-b58b-4d95382ac9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:30.312974 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b426b73-42cc-42b7-b58b-4d95382ac9e5 admin admin] PATH_INFO: `/v3/users/0c3078c405e3487793dceac281ba03b9` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:30.313772 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b426b73-42cc-42b7-b58b-4d95382ac9e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c3078c405e3487793dceac281ba03b9)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:30.315834 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b426b73-42cc-42b7-b58b-4d95382ac9e5 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:30.723694 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-1b426b73-42cc-42b7-b58b-4d95382ac9e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c3078c405e3487793dceac281ba03b9'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:30.724896 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-1b426b73-42cc-42b7-b58b-4d95382ac9e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c3078c405e3487793dceac281ba03b9'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:30.725524 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-1b426b73-42cc-42b7-b58b-4d95382ac9e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c3078c405e3487793dceac281ba03b9'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:30.788398 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-9cea489e-ffae-48aa-bc7d-26c8f94fca4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '709949b8eaf744abbc45e8a67cdbda4a'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:30.789076 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-9cea489e-ffae-48aa-bc7d-26c8f94fca4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '709949b8eaf744abbc45e8a67cdbda4a'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:30.789713 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-9cea489e-ffae-48aa-bc7d-26c8f94fca4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '709949b8eaf744abbc45e8a67cdbda4a'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:30.881775 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-1b426b73-42cc-42b7-b58b-4d95382ac9e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c3078c405e3487793dceac281ba03b9'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:30.889960 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-1b426b73-42cc-42b7-b58b-4d95382ac9e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c3078c405e3487793dceac281ba03b9'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:30.911043 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1324/2626] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 14 18:06:30 2022] DELETE /identity/v3/users/0c3078c405e3487793dceac281ba03b9 => generated 0 bytes in 740 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 18:06:30.916074 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10c831c-d163-4b43-8cc5-a8e6d825eff0 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:30.916375 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10c831c-d163-4b43-8cc5-a8e6d825eff0 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:30.916666 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10c831c-d163-4b43-8cc5-a8e6d825eff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:30.936546 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-c10c831c-d163-4b43-8cc5-a8e6d825eff0 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:06:30.938091 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-c10c831c-d163-4b43-8cc5-a8e6d825eff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:30.955223 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:06:30.960903 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-9cea489e-ffae-48aa-bc7d-26c8f94fca4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '709949b8eaf744abbc45e8a67cdbda4a'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:30.968657 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-9cea489e-ffae-48aa-bc7d-26c8f94fca4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '709949b8eaf744abbc45e8a67cdbda4a'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:30.990933 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1303/2627] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 14 18:06:30 2022] DELETE /identity/v3/users/709949b8eaf744abbc45e8a67cdbda4a => generated 0 bytes in 782 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 18:06:31.001302 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1325/2628] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:06:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 18:06:31.012161 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cea489e-ffae-48aa-bc7d-26c8f94fca4d admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:31.013860 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-9cea489e-ffae-48aa-bc7d-26c8f94fca4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:31.076834 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cea489e-ffae-48aa-bc7d-26c8f94fca4d admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:31.081040 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65665e7-a878-4526-aa75-69445987c585 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5652329c71cd431fb579d69cef933b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:31.081719 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65665e7-a878-4526-aa75-69445987c585 service neutron] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:31.082003 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65665e7-a878-4526-aa75-69445987c585 service neutron] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:31.082302 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65665e7-a878-4526-aa75-69445987c585 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:31.088689 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:06:31.145800 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65665e7-a878-4526-aa75-69445987c585 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:31.147246 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65665e7-a878-4526-aa75-69445987c585 service neutron] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:31.157544 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1304/2629] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 18:06:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:06:31.499752 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10c831c-d163-4b43-8cc5-a8e6d825eff0 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:31.501279 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-c10c831c-d163-4b43-8cc5-a8e6d825eff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:31.514751 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10c831c-d163-4b43-8cc5-a8e6d825eff0 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:31.532350 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a25e0c-5fa6-4249-b550-a97349578938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:31.534647 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a25e0c-5fa6-4249-b550-a97349578938 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:31.534647 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a25e0c-5fa6-4249-b550-a97349578938 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:31.534647 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a25e0c-5fa6-4249-b550-a97349578938 admin admin] PATH_INFO: `/v3/projects/84885394ddc8447995f0e99c2dcddb9c` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:31.536021 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a25e0c-5fa6-4249-b550-a97349578938 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84885394ddc8447995f0e99c2dcddb9c)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:31.539882 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a25e0c-5fa6-4249-b550-a97349578938 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:31.677402 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65665e7-a878-4526-aa75-69445987c585 service neutron] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:31.679097 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-e65665e7-a878-4526-aa75-69445987c585 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:31.693722 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-c5a25e0c-5fa6-4249-b550-a97349578938 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84885394ddc8447995f0e99c2dcddb9c', 'request_id': 'req-c5a25e0c-5fa6-4249-b550-a97349578938'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:31.695175 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65665e7-a878-4526-aa75-69445987c585 service neutron] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:31.754612 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e7297d-2762-4f5d-ad7f-15fb935e8106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:31.755822 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e7297d-2762-4f5d-ad7f-15fb935e8106 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:31.756140 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e7297d-2762-4f5d-ad7f-15fb935e8106 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:31.756401 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e7297d-2762-4f5d-ad7f-15fb935e8106 admin admin] PATH_INFO: `/v3/projects/bb5f4de2450240f18108195710a073dd` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:31.757700 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e7297d-2762-4f5d-ad7f-15fb935e8106 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb5f4de2450240f18108195710a073dd)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:31.759653 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e7297d-2762-4f5d-ad7f-15fb935e8106 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:31.806854 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-c5a25e0c-5fa6-4249-b550-a97349578938 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84885394ddc8447995f0e99c2dcddb9c', 'request_id': 'req-c5a25e0c-5fa6-4249-b550-a97349578938'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:31.813740 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-c5a25e0c-5fa6-4249-b550-a97349578938 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84885394ddc8447995f0e99c2dcddb9c', 'request_id': 'req-c5a25e0c-5fa6-4249-b550-a97349578938'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:31.825509 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-c5a25e0c-5fa6-4249-b550-a97349578938 admin admin] The token cache is being invalidate because project 84885394ddc8447995f0e99c2dcddb9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87019) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:06:31.825810 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-c5a25e0c-5fa6-4249-b550-a97349578938 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:31.826470 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-c5a25e0c-5fa6-4249-b550-a97349578938 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:31.828068 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1326/2630] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 14 18:06:31 2022] DELETE /identity/v3/projects/84885394ddc8447995f0e99c2dcddb9c => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:06:31.834452 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794c9cab-2fbf-4438-b448-26e4cce1e53c None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:31.835187 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794c9cab-2fbf-4438-b448-26e4cce1e53c None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:31.835187 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794c9cab-2fbf-4438-b448-26e4cce1e53c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:31.855070 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-794c9cab-2fbf-4438-b448-26e4cce1e53c None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:06:31.856309 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-794c9cab-2fbf-4438-b448-26e4cce1e53c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:31.865420 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1327/2631] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:06:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 18:06:31.873608 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbc1c01-cb70-4312-82de-45f8f3d16119 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:31.873901 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbc1c01-cb70-4312-82de-45f8f3d16119 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:31.874184 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbc1c01-cb70-4312-82de-45f8f3d16119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:31.894297 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-3dbc1c01-cb70-4312-82de-45f8f3d16119 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:06:31.896223 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-3dbc1c01-cb70-4312-82de-45f8f3d16119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:31.905079 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1328/2632] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:06:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 18:06:31.909218 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbc1c01-cb70-4312-82de-45f8f3d16119 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:31.918947 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbc1c01-cb70-4312-82de-45f8f3d16119 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:31.923745 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d022321-64a7-4d7c-a683-0302e8c192d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:31.924394 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d022321-64a7-4d7c-a683-0302e8c192d2 admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:31.924682 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d022321-64a7-4d7c-a683-0302e8c192d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:31.924969 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d022321-64a7-4d7c-a683-0302e8c192d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:31.925688 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d022321-64a7-4d7c-a683-0302e8c192d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 18:06:31.926005 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d022321-64a7-4d7c-a683-0302e8c192d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:31.927667 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d022321-64a7-4d7c-a683-0302e8c192d2 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:31.939569 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1329/2633] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 14 18:06:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 18:06:31.944586 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d022321-64a7-4d7c-a683-0302e8c192d2 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:31.954536 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d022321-64a7-4d7c-a683-0302e8c192d2 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:31.960426 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190137a5-0227-4b4f-9f88-bf81f143aa89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:31.961228 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190137a5-0227-4b4f-9f88-bf81f143aa89 admin admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:31.961529 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190137a5-0227-4b4f-9f88-bf81f143aa89 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:31.961816 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190137a5-0227-4b4f-9f88-bf81f143aa89 admin admin] PATH_INFO: `/v3/projects` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:31.962551 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190137a5-0227-4b4f-9f88-bf81f143aa89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:31.964497 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190137a5-0227-4b4f-9f88-bf81f143aa89 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:31.979002 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-06e7297d-2762-4f5d-ad7f-15fb935e8106 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb5f4de2450240f18108195710a073dd', 'request_id': 'req-06e7297d-2762-4f5d-ad7f-15fb935e8106'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:32.147885 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-06e7297d-2762-4f5d-ad7f-15fb935e8106 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb5f4de2450240f18108195710a073dd', 'request_id': 'req-06e7297d-2762-4f5d-ad7f-15fb935e8106'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:32.154663 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-06e7297d-2762-4f5d-ad7f-15fb935e8106 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb5f4de2450240f18108195710a073dd', 'request_id': 'req-06e7297d-2762-4f5d-ad7f-15fb935e8106'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:32.159246 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1330/2634] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 14 18:06:31 2022] POST /identity/v3/projects => generated 381 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 18:06:32.160264 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190137a5-0227-4b4f-9f88-bf81f143aa89 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:32.166587 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-06e7297d-2762-4f5d-ad7f-15fb935e8106 admin admin] The token cache is being invalidate because project bb5f4de2450240f18108195710a073dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:06:32.172891 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-06e7297d-2762-4f5d-ad7f-15fb935e8106 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:32.172891 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-06e7297d-2762-4f5d-ad7f-15fb935e8106 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:32.172891 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1305/2635] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 14 18:06:31 2022] DELETE /identity/v3/projects/bb5f4de2450240f18108195710a073dd => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 18:06:32.173870 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e7297d-2762-4f5d-ad7f-15fb935e8106 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:32.175323 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-06e7297d-2762-4f5d-ad7f-15fb935e8106 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:32.230743 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:06:32.234851 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190137a5-0227-4b4f-9f88-bf81f143aa89 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:32.240167 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607729a3-d25a-4991-9ad6-d0e8971eafae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:32.240858 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607729a3-d25a-4991-9ad6-d0e8971eafae admin admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:32.241151 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607729a3-d25a-4991-9ad6-d0e8971eafae admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:32.241433 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607729a3-d25a-4991-9ad6-d0e8971eafae admin admin] PATH_INFO: `/v3/users` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:32.242128 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607729a3-d25a-4991-9ad6-d0e8971eafae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:32.244105 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607729a3-d25a-4991-9ad6-d0e8971eafae admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:32.248332 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e7297d-2762-4f5d-ad7f-15fb935e8106 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:32.253335 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbbda11-0057-4360-83dd-ed6bb654d20a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:32.254224 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbbda11-0057-4360-83dd-ed6bb654d20a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:32.254515 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbbda11-0057-4360-83dd-ed6bb654d20a admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:32.255688 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbbda11-0057-4360-83dd-ed6bb654d20a admin admin] PATH_INFO: `/v3/users/90e7dc7b9da646f0b043e48bc4ac7d41` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:32.257223 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbbda11-0057-4360-83dd-ed6bb654d20a admin admin] RBAC: Authorizing `identity:delete_user(user_id=90e7dc7b9da646f0b043e48bc4ac7d41)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:32.259450 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbbda11-0057-4360-83dd-ed6bb654d20a admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:32.427551 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1331/2636] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 14 18:06:32 2022] POST /identity/v3/users => generated 291 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 18:06:32.429651 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607729a3-d25a-4991-9ad6-d0e8971eafae admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:32.431365 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-607729a3-d25a-4991-9ad6-d0e8971eafae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:32.445518 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607729a3-d25a-4991-9ad6-d0e8971eafae admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:32.452442 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adc91b5-3163-4e37-8691-16a12ff33fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:32.456808 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adc91b5-3163-4e37-8691-16a12ff33fc8 admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:32.456808 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adc91b5-3163-4e37-8691-16a12ff33fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:32.456808 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adc91b5-3163-4e37-8691-16a12ff33fc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:32.456808 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adc91b5-3163-4e37-8691-16a12ff33fc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:32.456808 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adc91b5-3163-4e37-8691-16a12ff33fc8 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:32.470285 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1332/2637] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 18:06:32 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 14 18:06:32.471402 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adc91b5-3163-4e37-8691-16a12ff33fc8 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:32.482286 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adc91b5-3163-4e37-8691-16a12ff33fc8 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:32.487018 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced5fce1-5cb9-43ca-b905-407726b99911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:32.491348 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced5fce1-5cb9-43ca-b905-407726b99911 admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:32.491348 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced5fce1-5cb9-43ca-b905-407726b99911 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:32.491348 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced5fce1-5cb9-43ca-b905-407726b99911 admin admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:32.491348 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced5fce1-5cb9-43ca-b905-407726b99911 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:32.491348 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced5fce1-5cb9-43ca-b905-407726b99911 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:32.502751 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1333/2638] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 18:06:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 14 18:06:32.508394 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced5fce1-5cb9-43ca-b905-407726b99911 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:32.518379 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced5fce1-5cb9-43ca-b905-407726b99911 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:32.523244 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6053f96-fb4b-4e84-8e77-6207ad8c9eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:32.524150 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6053f96-fb4b-4e84-8e77-6207ad8c9eb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:32.524438 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6053f96-fb4b-4e84-8e77-6207ad8c9eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:32.524720 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6053f96-fb4b-4e84-8e77-6207ad8c9eb5 admin admin] PATH_INFO: `/v3/projects/d300d229be624b94ab10275e24f38a59/users/5eb206ab0ebd4fd68630a286237d73ee/roles/9ee80134743f4c2b88525b04df2facba` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:32.539327 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:06:32.540846 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6053f96-fb4b-4e84-8e77-6207ad8c9eb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d300d229be624b94ab10275e24f38a59, user_id=5eb206ab0ebd4fd68630a286237d73ee, role_id=9ee80134743f4c2b88525b04df2facba)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:32.543835 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6053f96-fb4b-4e84-8e77-6207ad8c9eb5 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:32.609046 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-1bbbda11-0057-4360-83dd-ed6bb654d20a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90e7dc7b9da646f0b043e48bc4ac7d41'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:32.609744 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-1bbbda11-0057-4360-83dd-ed6bb654d20a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90e7dc7b9da646f0b043e48bc4ac7d41'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:32.610439 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-1bbbda11-0057-4360-83dd-ed6bb654d20a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90e7dc7b9da646f0b043e48bc4ac7d41'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:32.675600 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1334/2639] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 18:06:32 2022] PUT /identity/v3/projects/d300d229be624b94ab10275e24f38a59/users/5eb206ab0ebd4fd68630a286237d73ee/roles/9ee80134743f4c2b88525b04df2facba => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 18:06:32.688945 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefd8ed7-7a94-4e85-a17f-11aa16c71f42 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:32.689202 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefd8ed7-7a94-4e85-a17f-11aa16c71f42 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:32.689490 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefd8ed7-7a94-4e85-a17f-11aa16c71f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:32.716853 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-eefd8ed7-7a94-4e85-a17f-11aa16c71f42 None None] MFA Rules not processed for user `5eb206ab0ebd4fd68630a286237d73ee`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:06:32.718067 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-eefd8ed7-7a94-4e85-a17f-11aa16c71f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:32.737986 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-1bbbda11-0057-4360-83dd-ed6bb654d20a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90e7dc7b9da646f0b043e48bc4ac7d41'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:32.746901 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-1bbbda11-0057-4360-83dd-ed6bb654d20a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90e7dc7b9da646f0b043e48bc4ac7d41'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:32.765086 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1306/2640] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 14 18:06:32 2022] DELETE /identity/v3/users/90e7dc7b9da646f0b043e48bc4ac7d41 => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 18:06:32.786086 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1335/2641] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:06:32 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 18:06:32.791482 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbbda11-0057-4360-83dd-ed6bb654d20a admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:32.793173 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-1bbbda11-0057-4360-83dd-ed6bb654d20a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:32.860521 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbbda11-0057-4360-83dd-ed6bb654d20a admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:32.865855 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64c8263-6d30-4b3f-b486-ff77d319db76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:32.866527 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64c8263-6d30-4b3f-b486-ff77d319db76 admin admin] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:32.866816 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64c8263-6d30-4b3f-b486-ff77d319db76 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:32.867102 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64c8263-6d30-4b3f-b486-ff77d319db76 admin admin] PATH_INFO: `/v3/projects` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:32.867891 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64c8263-6d30-4b3f-b486-ff77d319db76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:32.869809 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64c8263-6d30-4b3f-b486-ff77d319db76 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:32.980633 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1307/2642] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 14 18:06:32 2022] POST /identity/v3/projects => generated 383 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:06:32.984750 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefd8ed7-7a94-4e85-a17f-11aa16c71f42 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:33.064528 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefd8ed7-7a94-4e85-a17f-11aa16c71f42 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:33.124804 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d68cd4f-3996-436b-a138-e7c94620ec56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:33.125564 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d68cd4f-3996-436b-a138-e7c94620ec56 admin admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:33.125853 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d68cd4f-3996-436b-a138-e7c94620ec56 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:33.126139 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d68cd4f-3996-436b-a138-e7c94620ec56 admin admin] PATH_INFO: `/v3/users` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:33.126837 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d68cd4f-3996-436b-a138-e7c94620ec56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:33.128849 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d68cd4f-3996-436b-a138-e7c94620ec56 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:33.217901 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64c8263-6d30-4b3f-b486-ff77d319db76 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:33.219764 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-a64c8263-6d30-4b3f-b486-ff77d319db76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:33.235366 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64c8263-6d30-4b3f-b486-ff77d319db76 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:33.240119 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21465a4-39fa-4bc3-9f34-0441d8c59996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:33.241659 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21465a4-39fa-4bc3-9f34-0441d8c59996 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:33.241958 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21465a4-39fa-4bc3-9f34-0441d8c59996 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:33.242317 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21465a4-39fa-4bc3-9f34-0441d8c59996 admin admin] PATH_INFO: `/v3/projects/a4276fc99c7d4df3be12f0fc71356ca0` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:33.246112 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21465a4-39fa-4bc3-9f34-0441d8c59996 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4276fc99c7d4df3be12f0fc71356ca0)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:33.246523 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21465a4-39fa-4bc3-9f34-0441d8c59996 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:33.254128 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1336/2643] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 14 18:06:32 2022] POST /identity/v3/users => generated 298 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:06:33.255729 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d68cd4f-3996-436b-a138-e7c94620ec56 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:33.265931 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d68cd4f-3996-436b-a138-e7c94620ec56 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:33.271017 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bea62e-f927-474d-9894-b04223d48699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:33.271730 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bea62e-f927-474d-9894-b04223d48699 admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:33.272022 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bea62e-f927-474d-9894-b04223d48699 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:33.272304 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bea62e-f927-474d-9894-b04223d48699 admin admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:33.273046 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bea62e-f927-474d-9894-b04223d48699 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:33.274653 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bea62e-f927-474d-9894-b04223d48699 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:33.285101 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1337/2644] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 18:06:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:06:33.290377 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bea62e-f927-474d-9894-b04223d48699 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:33.300142 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bea62e-f927-474d-9894-b04223d48699 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:33.306083 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156b520a-9b2f-4741-b46e-0660daf472de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:33.306967 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b520a-9b2f-4741-b46e-0660daf472de admin admin] REQUEST_METHOD: `PUT` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:33.307251 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b520a-9b2f-4741-b46e-0660daf472de admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:33.307573 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b520a-9b2f-4741-b46e-0660daf472de admin admin] PATH_INFO: `/v3/projects/6e11e3e52ccf432ba7738c9265b480d8/users/4dca297827544443af971932982fde58/roles/1348580877d04014bfdec4d866b98a74` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:33.323137 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156b520a-9b2f-4741-b46e-0660daf472de admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e11e3e52ccf432ba7738c9265b480d8, user_id=4dca297827544443af971932982fde58, role_id=1348580877d04014bfdec4d866b98a74)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:33.325854 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156b520a-9b2f-4741-b46e-0660daf472de admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:33.445617 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1338/2645] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 18:06:33 2022] PUT /identity/v3/projects/6e11e3e52ccf432ba7738c9265b480d8/users/4dca297827544443af971932982fde58/roles/1348580877d04014bfdec4d866b98a74 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 18:06:33.451698 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156b520a-9b2f-4741-b46e-0660daf472de admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:33.454903 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-d21465a4-39fa-4bc3-9f34-0441d8c59996 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4276fc99c7d4df3be12f0fc71356ca0', 'request_id': 'req-d21465a4-39fa-4bc3-9f34-0441d8c59996'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:33.514438 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156b520a-9b2f-4741-b46e-0660daf472de admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:33.555672 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-d21465a4-39fa-4bc3-9f34-0441d8c59996 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4276fc99c7d4df3be12f0fc71356ca0', 'request_id': 'req-d21465a4-39fa-4bc3-9f34-0441d8c59996'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:33.562913 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-d21465a4-39fa-4bc3-9f34-0441d8c59996 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4276fc99c7d4df3be12f0fc71356ca0', 'request_id': 'req-d21465a4-39fa-4bc3-9f34-0441d8c59996'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:33.577472 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-d21465a4-39fa-4bc3-9f34-0441d8c59996 admin admin] The token cache is being invalidate because project a4276fc99c7d4df3be12f0fc71356ca0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:06:33.577890 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-d21465a4-39fa-4bc3-9f34-0441d8c59996 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:33.578660 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-d21465a4-39fa-4bc3-9f34-0441d8c59996 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:33.579130 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904cc115-d420-4582-a213-673d7f087756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:33.579848 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904cc115-d420-4582-a213-673d7f087756 admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:33.580143 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904cc115-d420-4582-a213-673d7f087756 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:33.580436 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904cc115-d420-4582-a213-673d7f087756 admin admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:33.580637 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1308/2646] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 14 18:06:33 2022] DELETE /identity/v3/projects/a4276fc99c7d4df3be12f0fc71356ca0 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:06:33.581246 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904cc115-d420-4582-a213-673d7f087756 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:33.582945 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904cc115-d420-4582-a213-673d7f087756 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:33.586532 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e877369-a0d2-4959-bf1a-01de804cab92 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:33.587053 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e877369-a0d2-4959-bf1a-01de804cab92 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:33.587371 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e877369-a0d2-4959-bf1a-01de804cab92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:33.594131 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1339/2647] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 18:06:33 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 14 18:06:33.598216 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904cc115-d420-4582-a213-673d7f087756 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:33.600497 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-904cc115-d420-4582-a213-673d7f087756 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:33.607041 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-0e877369-a0d2-4959-bf1a-01de804cab92 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:06:33.608539 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-0e877369-a0d2-4959-bf1a-01de804cab92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:33.613218 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904cc115-d420-4582-a213-673d7f087756 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:33.617373 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1309/2648] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:06:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:06:33.618580 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316cd511-99e4-4524-910b-bf444da0dcc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:33.619503 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316cd511-99e4-4524-910b-bf444da0dcc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:33.619797 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316cd511-99e4-4524-910b-bf444da0dcc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:33.620079 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316cd511-99e4-4524-910b-bf444da0dcc2 admin admin] PATH_INFO: `/v3/projects/6e11e3e52ccf432ba7738c9265b480d8/users/4dca297827544443af971932982fde58/roles/1348580877d04014bfdec4d866b98a74` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:33.622160 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316cd511-99e4-4524-910b-bf444da0dcc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e11e3e52ccf432ba7738c9265b480d8, user_id=4dca297827544443af971932982fde58, role_id=1348580877d04014bfdec4d866b98a74)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:33.624877 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316cd511-99e4-4524-910b-bf444da0dcc2 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:33.625024 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733b6cda-03cf-44c1-af91-d0035abc3821 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:33.626071 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733b6cda-03cf-44c1-af91-d0035abc3821 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:33.626071 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733b6cda-03cf-44c1-af91-d0035abc3821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:33.636681 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1340/2649] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 18:06:33 2022] PUT /identity/v3/projects/6e11e3e52ccf432ba7738c9265b480d8/users/4dca297827544443af971932982fde58/roles/1348580877d04014bfdec4d866b98a74 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 18:06:33.645152 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-733b6cda-03cf-44c1-af91-d0035abc3821 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:06:33.647481 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-733b6cda-03cf-44c1-af91-d0035abc3821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:33.653501 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec1ee89-d8f3-4688-9f85-9ce28a28281d None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:33.653801 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec1ee89-d8f3-4688-9f85-9ce28a28281d None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:33.654096 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec1ee89-d8f3-4688-9f85-9ce28a28281d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:33.687631 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-9ec1ee89-d8f3-4688-9f85-9ce28a28281d None None] MFA Rules not processed for user `4dca297827544443af971932982fde58`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:06:33.688969 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-9ec1ee89-d8f3-4688-9f85-9ce28a28281d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:33.723031 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1310/2650] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:06:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 18:06:33.724854 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733b6cda-03cf-44c1-af91-d0035abc3821 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:33.737292 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733b6cda-03cf-44c1-af91-d0035abc3821 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:33.743409 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a68999b-cd25-4339-8ed2-3a2c90cb6308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:33.744154 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a68999b-cd25-4339-8ed2-3a2c90cb6308 admin admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:33.744447 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a68999b-cd25-4339-8ed2-3a2c90cb6308 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:33.744734 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a68999b-cd25-4339-8ed2-3a2c90cb6308 admin admin] PATH_INFO: `/v3/domains` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:33.745505 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a68999b-cd25-4339-8ed2-3a2c90cb6308 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 18:06:33.745999 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a68999b-cd25-4339-8ed2-3a2c90cb6308 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:33.747724 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a68999b-cd25-4339-8ed2-3a2c90cb6308 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:33.762730 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1311/2651] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 14 18:06:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 18:06:33.768320 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a68999b-cd25-4339-8ed2-3a2c90cb6308 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:33.780443 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a68999b-cd25-4339-8ed2-3a2c90cb6308 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:33.781504 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1341/2652] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:06:33 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 18:06:33.786990 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80532ff8-42bc-4f5a-a6ff-fdb5e67ef413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:33.787833 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80532ff8-42bc-4f5a-a6ff-fdb5e67ef413 admin admin] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:33.788128 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80532ff8-42bc-4f5a-a6ff-fdb5e67ef413 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:33.788411 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80532ff8-42bc-4f5a-a6ff-fdb5e67ef413 admin admin] PATH_INFO: `/v3/projects` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:33.789766 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80532ff8-42bc-4f5a-a6ff-fdb5e67ef413 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:33.791809 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80532ff8-42bc-4f5a-a6ff-fdb5e67ef413 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:33.797274 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec1ee89-d8f3-4688-9f85-9ce28a28281d None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:33.798730 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-9ec1ee89-d8f3-4688-9f85-9ce28a28281d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:33.807774 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:06:33.839603 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:06:33.865461 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec1ee89-d8f3-4688-9f85-9ce28a28281d None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:33.869267 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12708aca-2404-42f2-bb90-c335091ec715 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17945e7d72954b8787e0ba09a9903247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:33.869932 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12708aca-2404-42f2-bb90-c335091ec715 service cinder] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:33.870217 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12708aca-2404-42f2-bb90-c335091ec715 service cinder] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:33.870532 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12708aca-2404-42f2-bb90-c335091ec715 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:33.880754 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12708aca-2404-42f2-bb90-c335091ec715 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:33.882424 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12708aca-2404-42f2-bb90-c335091ec715 service cinder] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:33.893051 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1342/2653] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 18:06:33 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 18:06:33.950927 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1312/2654] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 14 18:06:33 2022] POST /identity/v3/projects => generated 409 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:06:33.955073 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12708aca-2404-42f2-bb90-c335091ec715 service cinder] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:33.966364 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12708aca-2404-42f2-bb90-c335091ec715 service cinder] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:34.041003 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80532ff8-42bc-4f5a-a6ff-fdb5e67ef413 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:34.041454 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-80532ff8-42bc-4f5a-a6ff-fdb5e67ef413 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:34.055997 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a53e96d-e811-4449-9a7a-93b13db3afa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:34.056686 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a53e96d-e811-4449-9a7a-93b13db3afa5 admin admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:34.057120 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a53e96d-e811-4449-9a7a-93b13db3afa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:34.059186 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a53e96d-e811-4449-9a7a-93b13db3afa5 admin admin] PATH_INFO: `/v3/users` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:34.060117 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a53e96d-e811-4449-9a7a-93b13db3afa5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:34.062300 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a53e96d-e811-4449-9a7a-93b13db3afa5 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:34.116715 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80532ff8-42bc-4f5a-a6ff-fdb5e67ef413 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:34.120621 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6239a0e-54ad-429d-9ece-7d422d3389a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17945e7d72954b8787e0ba09a9903247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:34.121351 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6239a0e-54ad-429d-9ece-7d422d3389a8 service cinder] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:34.121712 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6239a0e-54ad-429d-9ece-7d422d3389a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:34.122062 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6239a0e-54ad-429d-9ece-7d422d3389a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:34.123990 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-b6239a0e-54ad-429d-9ece-7d422d3389a8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:34.184425 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6239a0e-54ad-429d-9ece-7d422d3389a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:34.185895 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6239a0e-54ad-429d-9ece-7d422d3389a8 service cinder] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:34.196942 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1343/2655] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 14 18:06:33 2022] POST /identity/v3/users => generated 305 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:06:34.198027 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a53e96d-e811-4449-9a7a-93b13db3afa5 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:34.200407 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1313/2656] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 18:06:34 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 18:06:34.209966 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a53e96d-e811-4449-9a7a-93b13db3afa5 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:34.215045 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3492e6-45a5-4d3e-bdd1-48857147ec33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:34.215809 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3492e6-45a5-4d3e-bdd1-48857147ec33 admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:34.216058 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3492e6-45a5-4d3e-bdd1-48857147ec33 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:34.216357 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3492e6-45a5-4d3e-bdd1-48857147ec33 admin admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:34.217087 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3492e6-45a5-4d3e-bdd1-48857147ec33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:34.218758 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3492e6-45a5-4d3e-bdd1-48857147ec33 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:34.229423 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1344/2657] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 18:06:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:06:34.233439 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6239a0e-54ad-429d-9ece-7d422d3389a8 service cinder] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:34.244607 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6239a0e-54ad-429d-9ece-7d422d3389a8 service cinder] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:34.247534 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:06:34.253064 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d20f21f-7ec5-4077-b29f-0e25c6a7fd11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:34.253064 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d20f21f-7ec5-4077-b29f-0e25c6a7fd11 admin admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:34.253064 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d20f21f-7ec5-4077-b29f-0e25c6a7fd11 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:34.253064 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d20f21f-7ec5-4077-b29f-0e25c6a7fd11 admin admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:34.253570 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d20f21f-7ec5-4077-b29f-0e25c6a7fd11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:34.253766 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d20f21f-7ec5-4077-b29f-0e25c6a7fd11 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:34.268387 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1314/2658] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 18:06:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:06:34.269647 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3492e6-45a5-4d3e-bdd1-48857147ec33 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:34.281076 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3492e6-45a5-4d3e-bdd1-48857147ec33 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:34.285693 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e682aba0-6d08-4293-80bd-65e36c322e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:34.287185 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e682aba0-6d08-4293-80bd-65e36c322e04 admin admin] REQUEST_METHOD: `PUT` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:34.287515 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e682aba0-6d08-4293-80bd-65e36c322e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:34.287799 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e682aba0-6d08-4293-80bd-65e36c322e04 admin admin] PATH_INFO: `/v3/projects/ccc06b0dea6049178cf3bbfd75d4db41/users/e593534ca76e4ae7851b75e30623eac9/roles/9ee80134743f4c2b88525b04df2facba` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:34.304447 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e682aba0-6d08-4293-80bd-65e36c322e04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccc06b0dea6049178cf3bbfd75d4db41, user_id=e593534ca76e4ae7851b75e30623eac9, role_id=9ee80134743f4c2b88525b04df2facba)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:34.307111 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e682aba0-6d08-4293-80bd-65e36c322e04 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:34.398649 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1345/2659] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 18:06:34 2022] PUT /identity/v3/projects/ccc06b0dea6049178cf3bbfd75d4db41/users/e593534ca76e4ae7851b75e30623eac9/roles/9ee80134743f4c2b88525b04df2facba => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:06:34.410266 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3363ee-4a0d-4e1b-b1fa-1e609170acf6 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:34.410591 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3363ee-4a0d-4e1b-b1fa-1e609170acf6 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:34.410875 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3363ee-4a0d-4e1b-b1fa-1e609170acf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:34.437876 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-6e3363ee-4a0d-4e1b-b1fa-1e609170acf6 None None] MFA Rules not processed for user `e593534ca76e4ae7851b75e30623eac9`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:06:34.439145 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-6e3363ee-4a0d-4e1b-b1fa-1e609170acf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:34.508421 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1315/2660] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:06:34 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:06:34.513083 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e682aba0-6d08-4293-80bd-65e36c322e04 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:34.578558 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e682aba0-6d08-4293-80bd-65e36c322e04 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:34.583325 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afbc74d-f665-403f-9a7e-31ebb2e28a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:34.584041 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afbc74d-f665-403f-9a7e-31ebb2e28a30 admin admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:34.584291 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afbc74d-f665-403f-9a7e-31ebb2e28a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:34.584578 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afbc74d-f665-403f-9a7e-31ebb2e28a30 admin admin] PATH_INFO: `/v3/projects` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:34.585292 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afbc74d-f665-403f-9a7e-31ebb2e28a30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:34.587211 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afbc74d-f665-403f-9a7e-31ebb2e28a30 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:34.596529 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:06:34.704146 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:06:34.747600 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1346/2661] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 14 18:06:34 2022] POST /identity/v3/projects => generated 405 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:06:34.751793 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3363ee-4a0d-4e1b-b1fa-1e609170acf6 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:34.763744 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3363ee-4a0d-4e1b-b1fa-1e609170acf6 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:34.820235 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dace54e7-0553-490e-b306-9b1126fa4cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:34.820922 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dace54e7-0553-490e-b306-9b1126fa4cfe admin admin] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:34.821212 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dace54e7-0553-490e-b306-9b1126fa4cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:34.821496 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dace54e7-0553-490e-b306-9b1126fa4cfe admin admin] PATH_INFO: `/v3/users` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:34.822189 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dace54e7-0553-490e-b306-9b1126fa4cfe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:34.824178 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dace54e7-0553-490e-b306-9b1126fa4cfe admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:34.907821 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1316/2662] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 14 18:06:34 2022] POST /identity/v3/users => generated 309 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:06:34.914152 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afbc74d-f665-403f-9a7e-31ebb2e28a30 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:34.924620 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afbc74d-f665-403f-9a7e-31ebb2e28a30 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:34.930107 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371020e7-cbb8-4829-afa6-6123d1becdfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:34.930780 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371020e7-cbb8-4829-afa6-6123d1becdfe admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:34.931103 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371020e7-cbb8-4829-afa6-6123d1becdfe admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:34.931415 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371020e7-cbb8-4829-afa6-6123d1becdfe admin admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:34.932146 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371020e7-cbb8-4829-afa6-6123d1becdfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:34.933778 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371020e7-cbb8-4829-afa6-6123d1becdfe admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:34.944756 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1347/2663] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 18:06:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:06:34.949006 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dace54e7-0553-490e-b306-9b1126fa4cfe admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:34.959749 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dace54e7-0553-490e-b306-9b1126fa4cfe admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:34.964428 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba0a914-0f58-49f5-85fc-eb5d19fc419d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:34.965322 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba0a914-0f58-49f5-85fc-eb5d19fc419d admin admin] REQUEST_METHOD: `PUT` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:34.965607 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba0a914-0f58-49f5-85fc-eb5d19fc419d admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:34.965887 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba0a914-0f58-49f5-85fc-eb5d19fc419d admin admin] PATH_INFO: `/v3/projects/f81dfe5d14514df6a1d4ae9ebba0b81c/users/5c1d44c468ec46ad8634df3b56518c8b/roles/1348580877d04014bfdec4d866b98a74` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:34.983019 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba0a914-0f58-49f5-85fc-eb5d19fc419d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f81dfe5d14514df6a1d4ae9ebba0b81c, user_id=5c1d44c468ec46ad8634df3b56518c8b, role_id=1348580877d04014bfdec4d866b98a74)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:34.985700 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba0a914-0f58-49f5-85fc-eb5d19fc419d admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:35.088337 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1317/2664] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 18:06:34 2022] PUT /identity/v3/projects/f81dfe5d14514df6a1d4ae9ebba0b81c/users/5c1d44c468ec46ad8634df3b56518c8b/roles/1348580877d04014bfdec4d866b98a74 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:06:35.095747 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371020e7-cbb8-4829-afa6-6123d1becdfe admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:35.107329 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371020e7-cbb8-4829-afa6-6123d1becdfe admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:35.168388 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4071ae0a-2bae-489e-88f6-c3e8837f46e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:35.169078 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4071ae0a-2bae-489e-88f6-c3e8837f46e2 admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:35.169368 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4071ae0a-2bae-489e-88f6-c3e8837f46e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:35.169706 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4071ae0a-2bae-489e-88f6-c3e8837f46e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:35.170439 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4071ae0a-2bae-489e-88f6-c3e8837f46e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:35.172146 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4071ae0a-2bae-489e-88f6-c3e8837f46e2 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:35.183471 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1348/2665] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 18:06:35 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:06:35.187372 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba0a914-0f58-49f5-85fc-eb5d19fc419d admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:35.198856 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba0a914-0f58-49f5-85fc-eb5d19fc419d admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:35.204183 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c100923e-a043-4bcf-ad6e-e21d4d2e3ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:35.205089 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c100923e-a043-4bcf-ad6e-e21d4d2e3ed5 admin admin] REQUEST_METHOD: `PUT` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:35.206305 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c100923e-a043-4bcf-ad6e-e21d4d2e3ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:35.206305 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c100923e-a043-4bcf-ad6e-e21d4d2e3ed5 admin admin] PATH_INFO: `/v3/projects/f81dfe5d14514df6a1d4ae9ebba0b81c/users/5c1d44c468ec46ad8634df3b56518c8b/roles/1348580877d04014bfdec4d866b98a74` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:35.207809 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c100923e-a043-4bcf-ad6e-e21d4d2e3ed5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f81dfe5d14514df6a1d4ae9ebba0b81c, user_id=5c1d44c468ec46ad8634df3b56518c8b, role_id=1348580877d04014bfdec4d866b98a74)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:35.211104 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c100923e-a043-4bcf-ad6e-e21d4d2e3ed5 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:35.221770 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1318/2666] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 18:06:35 2022] PUT /identity/v3/projects/f81dfe5d14514df6a1d4ae9ebba0b81c/users/5c1d44c468ec46ad8634df3b56518c8b/roles/1348580877d04014bfdec4d866b98a74 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:06:35.234042 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ff65c1-c363-4efd-9603-2f5fb8371f0c None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:35.234345 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ff65c1-c363-4efd-9603-2f5fb8371f0c None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:35.234636 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ff65c1-c363-4efd-9603-2f5fb8371f0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:35.262290 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-55ff65c1-c363-4efd-9603-2f5fb8371f0c None None] MFA Rules not processed for user `5c1d44c468ec46ad8634df3b56518c8b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:06:35.263541 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-55ff65c1-c363-4efd-9603-2f5fb8371f0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:35.337459 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1349/2667] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:06:35 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:06:35.348397 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:06:35.349539 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c100923e-a043-4bcf-ad6e-e21d4d2e3ed5 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:35.419278 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c100923e-a043-4bcf-ad6e-e21d4d2e3ed5 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:35.423051 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370c077b-8809-4fed-bb45-d241b4bcd276 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17945e7d72954b8787e0ba09a9903247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:35.423735 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370c077b-8809-4fed-bb45-d241b4bcd276 service cinder] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:35.424020 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370c077b-8809-4fed-bb45-d241b4bcd276 service cinder] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:35.424299 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370c077b-8809-4fed-bb45-d241b4bcd276 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:35.434972 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370c077b-8809-4fed-bb45-d241b4bcd276 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:35.436599 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:06:35.438295 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370c077b-8809-4fed-bb45-d241b4bcd276 service cinder] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:35.449196 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1319/2668] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 18:06:35 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:06:36.040588 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ff65c1-c363-4efd-9603-2f5fb8371f0c None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:36.050480 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ff65c1-c363-4efd-9603-2f5fb8371f0c None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:36.054664 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad0e4ac-489b-4cd9-b395-97b60bd2af61 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17945e7d72954b8787e0ba09a9903247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:36.055394 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad0e4ac-489b-4cd9-b395-97b60bd2af61 service cinder] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:36.055682 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad0e4ac-489b-4cd9-b395-97b60bd2af61 service cinder] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:36.055968 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad0e4ac-489b-4cd9-b395-97b60bd2af61 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:36.117341 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad0e4ac-489b-4cd9-b395-97b60bd2af61 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:36.118863 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad0e4ac-489b-4cd9-b395-97b60bd2af61 service cinder] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:36.129734 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1350/2669] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 18:06:36 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:06:40.032469 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370c077b-8809-4fed-bb45-d241b4bcd276 service cinder] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:40.033949 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-370c077b-8809-4fed-bb45-d241b4bcd276 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:40.105434 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370c077b-8809-4fed-bb45-d241b4bcd276 service cinder] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:40.111087 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c52e5f-3a0d-4226-a673-ea3a86a598e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:40.112011 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c52e5f-3a0d-4226-a673-ea3a86a598e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:40.112295 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c52e5f-3a0d-4226-a673-ea3a86a598e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:40.112581 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c52e5f-3a0d-4226-a673-ea3a86a598e1 admin admin] PATH_INFO: `/v3/users/7e1fbce6fdcc4bfda85bf3b9dd50eae7` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:40.114012 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c52e5f-3a0d-4226-a673-ea3a86a598e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e1fbce6fdcc4bfda85bf3b9dd50eae7)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:40.116805 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c52e5f-3a0d-4226-a673-ea3a86a598e1 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:40.462485 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-91c52e5f-3a0d-4226-a673-ea3a86a598e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e1fbce6fdcc4bfda85bf3b9dd50eae7'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:40.463065 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-91c52e5f-3a0d-4226-a673-ea3a86a598e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e1fbce6fdcc4bfda85bf3b9dd50eae7'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:40.463710 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-91c52e5f-3a0d-4226-a673-ea3a86a598e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e1fbce6fdcc4bfda85bf3b9dd50eae7'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:40.494797 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad0e4ac-489b-4cd9-b395-97b60bd2af61 service cinder] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:40.506587 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad0e4ac-489b-4cd9-b395-97b60bd2af61 service cinder] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:40.511603 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085c137e-c819-43f0-9ae3-36889ef820d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:40.512593 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085c137e-c819-43f0-9ae3-36889ef820d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:40.512873 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085c137e-c819-43f0-9ae3-36889ef820d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:40.513152 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085c137e-c819-43f0-9ae3-36889ef820d9 admin admin] PATH_INFO: `/v3/users/5eb206ab0ebd4fd68630a286237d73ee` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:40.514441 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085c137e-c819-43f0-9ae3-36889ef820d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5eb206ab0ebd4fd68630a286237d73ee)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:40.516475 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085c137e-c819-43f0-9ae3-36889ef820d9 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:40.630332 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-91c52e5f-3a0d-4226-a673-ea3a86a598e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e1fbce6fdcc4bfda85bf3b9dd50eae7'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:40.639630 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-91c52e5f-3a0d-4226-a673-ea3a86a598e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e1fbce6fdcc4bfda85bf3b9dd50eae7'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:40.660661 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1320/2670] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 14 18:06:40 2022] DELETE /identity/v3/users/7e1fbce6fdcc4bfda85bf3b9dd50eae7 => generated 0 bytes in 629 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:06:40.666112 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb719753-c3d4-4407-ba42-bfc84a29646d None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:40.666683 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb719753-c3d4-4407-ba42-bfc84a29646d None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:40.666683 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb719753-c3d4-4407-ba42-bfc84a29646d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:40.684041 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-cb719753-c3d4-4407-ba42-bfc84a29646d None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:06:40.685320 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-cb719753-c3d4-4407-ba42-bfc84a29646d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:40.707384 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:06:40.746898 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1321/2671] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:06:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 18:06:40.757252 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb719753-c3d4-4407-ba42-bfc84a29646d None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:40.758710 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-cb719753-c3d4-4407-ba42-bfc84a29646d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:40.816834 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb719753-c3d4-4407-ba42-bfc84a29646d None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:40.821479 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a03ca0-d728-4c9e-b73c-cb2b0564e9ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5652329c71cd431fb579d69cef933b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:40.822165 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a03ca0-d728-4c9e-b73c-cb2b0564e9ec service neutron] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:40.822456 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a03ca0-d728-4c9e-b73c-cb2b0564e9ec service neutron] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:40.822740 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a03ca0-d728-4c9e-b73c-cb2b0564e9ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:40.832553 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a03ca0-d728-4c9e-b73c-cb2b0564e9ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:40.834654 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a03ca0-d728-4c9e-b73c-cb2b0564e9ec service neutron] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:40.846174 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1322/2672] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 18:06:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 18:06:40.846981 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-085c137e-c819-43f0-9ae3-36889ef820d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5eb206ab0ebd4fd68630a286237d73ee'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:40.847742 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-085c137e-c819-43f0-9ae3-36889ef820d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5eb206ab0ebd4fd68630a286237d73ee'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:40.848413 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-085c137e-c819-43f0-9ae3-36889ef820d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5eb206ab0ebd4fd68630a286237d73ee'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:40.984396 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-085c137e-c819-43f0-9ae3-36889ef820d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5eb206ab0ebd4fd68630a286237d73ee'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:40.992757 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-085c137e-c819-43f0-9ae3-36889ef820d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5eb206ab0ebd4fd68630a286237d73ee'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:41.010947 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1351/2673] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 14 18:06:40 2022] DELETE /identity/v3/users/5eb206ab0ebd4fd68630a286237d73ee => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 18:06:41.015708 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd586386-f0e0-4c57-a1ec-aaddd3db18a2 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:41.016135 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd586386-f0e0-4c57-a1ec-aaddd3db18a2 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:41.016537 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd586386-f0e0-4c57-a1ec-aaddd3db18a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:41.037590 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-dd586386-f0e0-4c57-a1ec-aaddd3db18a2 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:06:41.044623 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-dd586386-f0e0-4c57-a1ec-aaddd3db18a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:41.135576 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1323/2674] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:06:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:06:41.146127 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085c137e-c819-43f0-9ae3-36889ef820d9 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:41.147866 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-085c137e-c819-43f0-9ae3-36889ef820d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:41.213046 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085c137e-c819-43f0-9ae3-36889ef820d9 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:41.216916 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bf46f5-6ecd-4e7a-8355-63ffd5af9ba8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5652329c71cd431fb579d69cef933b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:41.217581 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bf46f5-6ecd-4e7a-8355-63ffd5af9ba8 service neutron] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:41.217880 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bf46f5-6ecd-4e7a-8355-63ffd5af9ba8 service neutron] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:41.218166 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bf46f5-6ecd-4e7a-8355-63ffd5af9ba8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:41.227813 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bf46f5-6ecd-4e7a-8355-63ffd5af9ba8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:41.229256 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bf46f5-6ecd-4e7a-8355-63ffd5af9ba8 service neutron] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:41.241586 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1352/2675] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 18:06:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:06:41.264796 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd586386-f0e0-4c57-a1ec-aaddd3db18a2 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:41.266151 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-dd586386-f0e0-4c57-a1ec-aaddd3db18a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:41.282208 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd586386-f0e0-4c57-a1ec-aaddd3db18a2 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:41.297466 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e462fb-7786-47ce-a6ed-9fdb3e88058f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:41.297466 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e462fb-7786-47ce-a6ed-9fdb3e88058f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:41.297466 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e462fb-7786-47ce-a6ed-9fdb3e88058f admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:41.297466 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e462fb-7786-47ce-a6ed-9fdb3e88058f admin admin] PATH_INFO: `/v3/projects/2bafbede00fa4f3f8422c4556939ac02` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:41.298142 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e462fb-7786-47ce-a6ed-9fdb3e88058f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2bafbede00fa4f3f8422c4556939ac02)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:41.298142 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e462fb-7786-47ce-a6ed-9fdb3e88058f admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:41.410751 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-38e462fb-7786-47ce-a6ed-9fdb3e88058f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bafbede00fa4f3f8422c4556939ac02', 'request_id': 'req-38e462fb-7786-47ce-a6ed-9fdb3e88058f'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:41.503912 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-38e462fb-7786-47ce-a6ed-9fdb3e88058f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bafbede00fa4f3f8422c4556939ac02', 'request_id': 'req-38e462fb-7786-47ce-a6ed-9fdb3e88058f'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:41.510929 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-38e462fb-7786-47ce-a6ed-9fdb3e88058f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bafbede00fa4f3f8422c4556939ac02', 'request_id': 'req-38e462fb-7786-47ce-a6ed-9fdb3e88058f'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:41.521458 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:06:41.527603 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-38e462fb-7786-47ce-a6ed-9fdb3e88058f admin admin] The token cache is being invalidate because project 2bafbede00fa4f3f8422c4556939ac02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:06:41.528045 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-38e462fb-7786-47ce-a6ed-9fdb3e88058f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:41.528805 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-38e462fb-7786-47ce-a6ed-9fdb3e88058f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:41.530535 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1324/2676] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 14 18:06:41 2022] DELETE /identity/v3/projects/2bafbede00fa4f3f8422c4556939ac02 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:06:41.535346 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bf21d3-2e4b-47cb-adf4-49f6f65ee466 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:41.535828 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bf21d3-2e4b-47cb-adf4-49f6f65ee466 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:41.535928 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bf21d3-2e4b-47cb-adf4-49f6f65ee466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:41.554626 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-64bf21d3-2e4b-47cb-adf4-49f6f65ee466 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:06:41.555929 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-64bf21d3-2e4b-47cb-adf4-49f6f65ee466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:41.565009 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:06:41.620262 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1353/2677] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:06:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:06:41.627350 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fc3055-e276-4c55-bced-1808e9d32661 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:41.627674 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fc3055-e276-4c55-bced-1808e9d32661 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:41.627959 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fc3055-e276-4c55-bced-1808e9d32661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:41.654655 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-d9fc3055-e276-4c55-bced-1808e9d32661 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:06:41.655915 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-d9fc3055-e276-4c55-bced-1808e9d32661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:41.664045 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1325/2678] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:06:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:06:41.668520 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bf21d3-2e4b-47cb-adf4-49f6f65ee466 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:41.678493 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bf21d3-2e4b-47cb-adf4-49f6f65ee466 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:41.683410 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f03b4b-6921-45f0-b0f8-37ea497be0f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:41.684080 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f03b4b-6921-45f0-b0f8-37ea497be0f2 admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:41.684372 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f03b4b-6921-45f0-b0f8-37ea497be0f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:41.684661 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f03b4b-6921-45f0-b0f8-37ea497be0f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:41.685452 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f03b4b-6921-45f0-b0f8-37ea497be0f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 18:06:41.685770 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f03b4b-6921-45f0-b0f8-37ea497be0f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:41.687428 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f03b4b-6921-45f0-b0f8-37ea497be0f2 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:41.700839 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1354/2679] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 14 18:06:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 18:06:41.705489 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fc3055-e276-4c55-bced-1808e9d32661 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:41.716001 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fc3055-e276-4c55-bced-1808e9d32661 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:41.721046 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e47329-9f6d-46d1-9eb8-8d208f14b69d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:41.722135 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e47329-9f6d-46d1-9eb8-8d208f14b69d admin admin] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:41.722331 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e47329-9f6d-46d1-9eb8-8d208f14b69d admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:41.722572 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e47329-9f6d-46d1-9eb8-8d208f14b69d admin admin] PATH_INFO: `/v3/projects` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:41.722691 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f03b4b-6921-45f0-b0f8-37ea497be0f2 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:41.723271 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e47329-9f6d-46d1-9eb8-8d208f14b69d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:41.725274 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e47329-9f6d-46d1-9eb8-8d208f14b69d admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:41.726924 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-63f03b4b-6921-45f0-b0f8-37ea497be0f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:41.743325 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f03b4b-6921-45f0-b0f8-37ea497be0f2 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:41.748195 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907c9e3e-be1b-4baf-9df8-b3f67b35e712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:41.749067 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907c9e3e-be1b-4baf-9df8-b3f67b35e712 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:41.749339 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907c9e3e-be1b-4baf-9df8-b3f67b35e712 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:41.749724 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907c9e3e-be1b-4baf-9df8-b3f67b35e712 admin admin] PATH_INFO: `/v3/projects/d300d229be624b94ab10275e24f38a59` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:41.750796 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907c9e3e-be1b-4baf-9df8-b3f67b35e712 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d300d229be624b94ab10275e24f38a59)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:41.752737 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907c9e3e-be1b-4baf-9df8-b3f67b35e712 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:41.860116 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1326/2680] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 14 18:06:41 2022] POST /identity/v3/projects => generated 373 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:06:41.863972 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e47329-9f6d-46d1-9eb8-8d208f14b69d admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:41.873578 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-907c9e3e-be1b-4baf-9df8-b3f67b35e712 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd300d229be624b94ab10275e24f38a59', 'request_id': 'req-907c9e3e-be1b-4baf-9df8-b3f67b35e712'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:41.943636 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e47329-9f6d-46d1-9eb8-8d208f14b69d admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:41.948469 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67904c43-8383-4532-a483-74bbc91e399e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:41.949152 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67904c43-8383-4532-a483-74bbc91e399e admin admin] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:41.949445 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67904c43-8383-4532-a483-74bbc91e399e admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:41.949734 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67904c43-8383-4532-a483-74bbc91e399e admin admin] PATH_INFO: `/v3/users` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:41.950429 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67904c43-8383-4532-a483-74bbc91e399e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:41.952397 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67904c43-8383-4532-a483-74bbc91e399e admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:42.007109 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-907c9e3e-be1b-4baf-9df8-b3f67b35e712 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd300d229be624b94ab10275e24f38a59', 'request_id': 'req-907c9e3e-be1b-4baf-9df8-b3f67b35e712'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:42.014568 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-907c9e3e-be1b-4baf-9df8-b3f67b35e712 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd300d229be624b94ab10275e24f38a59', 'request_id': 'req-907c9e3e-be1b-4baf-9df8-b3f67b35e712'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:42.026054 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-907c9e3e-be1b-4baf-9df8-b3f67b35e712 admin admin] The token cache is being invalidate because project d300d229be624b94ab10275e24f38a59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87019) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:06:42.026359 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-907c9e3e-be1b-4baf-9df8-b3f67b35e712 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:42.027041 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-907c9e3e-be1b-4baf-9df8-b3f67b35e712 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:42.028901 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1355/2681] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 14 18:06:41 2022] DELETE /identity/v3/projects/d300d229be624b94ab10275e24f38a59 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 18:06:42.032747 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907c9e3e-be1b-4baf-9df8-b3f67b35e712 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:42.034079 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-907c9e3e-be1b-4baf-9df8-b3f67b35e712 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:42.055508 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1327/2682] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 14 18:06:41 2022] POST /identity/v3/users => generated 287 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 18:06:42.060353 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67904c43-8383-4532-a483-74bbc91e399e admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:42.062670 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-67904c43-8383-4532-a483-74bbc91e399e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:42.077755 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67904c43-8383-4532-a483-74bbc91e399e admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:42.082648 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e620149-57ab-4e8b-80b2-d27ae87366ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:42.083451 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e620149-57ab-4e8b-80b2-d27ae87366ea admin admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:42.083741 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e620149-57ab-4e8b-80b2-d27ae87366ea admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:42.084117 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e620149-57ab-4e8b-80b2-d27ae87366ea admin admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:42.085032 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e620149-57ab-4e8b-80b2-d27ae87366ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:42.086668 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e620149-57ab-4e8b-80b2-d27ae87366ea admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:42.100568 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1328/2683] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 18:06:42 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 14 18:06:42.102370 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e620149-57ab-4e8b-80b2-d27ae87366ea admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:42.103749 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907c9e3e-be1b-4baf-9df8-b3f67b35e712 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:42.108649 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eb767f-9faa-46b7-91b3-c9c73ecfb892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:42.109527 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eb767f-9faa-46b7-91b3-c9c73ecfb892 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:42.109815 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eb767f-9faa-46b7-91b3-c9c73ecfb892 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:42.110099 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eb767f-9faa-46b7-91b3-c9c73ecfb892 admin admin] PATH_INFO: `/v3/users/4dca297827544443af971932982fde58` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:42.111444 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eb767f-9faa-46b7-91b3-c9c73ecfb892 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4dca297827544443af971932982fde58)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:42.112504 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e620149-57ab-4e8b-80b2-d27ae87366ea admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:42.113389 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eb767f-9faa-46b7-91b3-c9c73ecfb892 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:42.118327 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8386735b-be63-4818-bf08-77d2945f479d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:42.119094 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8386735b-be63-4818-bf08-77d2945f479d admin admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:42.120171 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8386735b-be63-4818-bf08-77d2945f479d admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:42.120171 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8386735b-be63-4818-bf08-77d2945f479d admin admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:42.120595 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8386735b-be63-4818-bf08-77d2945f479d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:42.122344 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8386735b-be63-4818-bf08-77d2945f479d admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:42.138638 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1329/2684] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 18:06:42 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 14 18:06:42.142994 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8386735b-be63-4818-bf08-77d2945f479d admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:42.158359 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8386735b-be63-4818-bf08-77d2945f479d admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:42.163523 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330eb0aa-2354-488c-ad1d-25f0db927471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:42.164440 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330eb0aa-2354-488c-ad1d-25f0db927471 admin admin] REQUEST_METHOD: `PUT` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:42.164731 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330eb0aa-2354-488c-ad1d-25f0db927471 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:42.165499 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330eb0aa-2354-488c-ad1d-25f0db927471 admin admin] PATH_INFO: `/v3/projects/bf517fa543554f77aa825598ad49ee4b/users/237a89866a9f4432854e9218f2162bbb/roles/9ee80134743f4c2b88525b04df2facba` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:42.182254 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330eb0aa-2354-488c-ad1d-25f0db927471 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf517fa543554f77aa825598ad49ee4b, user_id=237a89866a9f4432854e9218f2162bbb, role_id=9ee80134743f4c2b88525b04df2facba)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:42.185059 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330eb0aa-2354-488c-ad1d-25f0db927471 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:42.264024 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1330/2685] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 18:06:42 2022] PUT /identity/v3/projects/bf517fa543554f77aa825598ad49ee4b/users/237a89866a9f4432854e9218f2162bbb/roles/9ee80134743f4c2b88525b04df2facba => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 18:06:42.276115 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7475dcf-4a26-490e-be77-026bcb65dbe9 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:42.276575 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7475dcf-4a26-490e-be77-026bcb65dbe9 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:42.276934 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7475dcf-4a26-490e-be77-026bcb65dbe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:42.313924 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-a7475dcf-4a26-490e-be77-026bcb65dbe9 None None] MFA Rules not processed for user `237a89866a9f4432854e9218f2162bbb`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:06:42.315179 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-a7475dcf-4a26-490e-be77-026bcb65dbe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:42.376889 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:06:42.383489 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1331/2686] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:06:42 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 18:06:42.394818 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-29eb767f-9faa-46b7-91b3-c9c73ecfb892 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4dca297827544443af971932982fde58'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:42.395020 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7475dcf-4a26-490e-be77-026bcb65dbe9 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:42.396356 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-29eb767f-9faa-46b7-91b3-c9c73ecfb892 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4dca297827544443af971932982fde58'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:42.397046 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-29eb767f-9faa-46b7-91b3-c9c73ecfb892 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4dca297827544443af971932982fde58'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:42.397505 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-a7475dcf-4a26-490e-be77-026bcb65dbe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:42.455436 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7475dcf-4a26-490e-be77-026bcb65dbe9 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:42.460050 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c94dfdc-2244-4110-9e76-45f23f34f748 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17945e7d72954b8787e0ba09a9903247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:42.460710 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c94dfdc-2244-4110-9e76-45f23f34f748 service cinder] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:42.460999 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c94dfdc-2244-4110-9e76-45f23f34f748 service cinder] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:42.461286 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c94dfdc-2244-4110-9e76-45f23f34f748 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:42.463076 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-3c94dfdc-2244-4110-9e76-45f23f34f748 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:42.467177 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-29eb767f-9faa-46b7-91b3-c9c73ecfb892 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4dca297827544443af971932982fde58'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:42.475264 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c94dfdc-2244-4110-9e76-45f23f34f748 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:42.482043 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-29eb767f-9faa-46b7-91b3-c9c73ecfb892 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4dca297827544443af971932982fde58'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:42.482189 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c94dfdc-2244-4110-9e76-45f23f34f748 service cinder] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:42.486035 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1332/2687] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 18:06:42 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 18:06:42.496389 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1356/2688] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 14 18:06:42 2022] DELETE /identity/v3/users/4dca297827544443af971932982fde58 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 18:06:42.502404 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:06:42.517002 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c94dfdc-2244-4110-9e76-45f23f34f748 service cinder] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:42.518571 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-3c94dfdc-2244-4110-9e76-45f23f34f748 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:42.586889 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c94dfdc-2244-4110-9e76-45f23f34f748 service cinder] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:42.643640 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef95f5ea-4e18-49cd-a7fd-5d4b65750484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:42.644543 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef95f5ea-4e18-49cd-a7fd-5d4b65750484 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:42.644835 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef95f5ea-4e18-49cd-a7fd-5d4b65750484 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:42.645122 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef95f5ea-4e18-49cd-a7fd-5d4b65750484 admin admin] PATH_INFO: `/v3/users/237a89866a9f4432854e9218f2162bbb` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:42.648136 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef95f5ea-4e18-49cd-a7fd-5d4b65750484 admin admin] RBAC: Authorizing `identity:delete_user(user_id=237a89866a9f4432854e9218f2162bbb)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:42.650137 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef95f5ea-4e18-49cd-a7fd-5d4b65750484 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:42.877863 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-ef95f5ea-4e18-49cd-a7fd-5d4b65750484 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '237a89866a9f4432854e9218f2162bbb'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:42.878587 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-ef95f5ea-4e18-49cd-a7fd-5d4b65750484 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '237a89866a9f4432854e9218f2162bbb'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:42.879254 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-ef95f5ea-4e18-49cd-a7fd-5d4b65750484 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '237a89866a9f4432854e9218f2162bbb'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:42.882632 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:06:42.953422 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-ef95f5ea-4e18-49cd-a7fd-5d4b65750484 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '237a89866a9f4432854e9218f2162bbb'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:42.961451 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-ef95f5ea-4e18-49cd-a7fd-5d4b65750484 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '237a89866a9f4432854e9218f2162bbb'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:42.985025 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1333/2689] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 14 18:06:42 2022] DELETE /identity/v3/users/237a89866a9f4432854e9218f2162bbb => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:06:42.990253 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aa5e54-fad6-48e0-82a0-a4c9d2cef579 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:42.990813 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aa5e54-fad6-48e0-82a0-a4c9d2cef579 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:42.991485 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aa5e54-fad6-48e0-82a0-a4c9d2cef579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:43.010674 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-00aa5e54-fad6-48e0-82a0-a4c9d2cef579 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:06:43.011919 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-00aa5e54-fad6-48e0-82a0-a4c9d2cef579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:43.025130 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef95f5ea-4e18-49cd-a7fd-5d4b65750484 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:43.029499 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-ef95f5ea-4e18-49cd-a7fd-5d4b65750484 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:43.084124 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1357/2690] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:06:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:06:43.094258 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aa5e54-fad6-48e0-82a0-a4c9d2cef579 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:43.095684 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-00aa5e54-fad6-48e0-82a0-a4c9d2cef579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:43.101271 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef95f5ea-4e18-49cd-a7fd-5d4b65750484 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:43.106190 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3191fcce-12a5-4612-a148-4898618b61e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:43.107063 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3191fcce-12a5-4612-a148-4898618b61e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:43.107384 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3191fcce-12a5-4612-a148-4898618b61e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:43.107677 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3191fcce-12a5-4612-a148-4898618b61e0 admin admin] PATH_INFO: `/v3/projects/6e11e3e52ccf432ba7738c9265b480d8` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:43.108849 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3191fcce-12a5-4612-a148-4898618b61e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e11e3e52ccf432ba7738c9265b480d8)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:43.110787 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3191fcce-12a5-4612-a148-4898618b61e0 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:43.158996 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aa5e54-fad6-48e0-82a0-a4c9d2cef579 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:43.164063 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a573b400-1266-4938-8aa4-abf0e9bcb56b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5652329c71cd431fb579d69cef933b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:43.164710 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a573b400-1266-4938-8aa4-abf0e9bcb56b service neutron] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:43.165033 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a573b400-1266-4938-8aa4-abf0e9bcb56b service neutron] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:43.165311 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a573b400-1266-4938-8aa4-abf0e9bcb56b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:43.174490 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a573b400-1266-4938-8aa4-abf0e9bcb56b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:43.176010 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a573b400-1266-4938-8aa4-abf0e9bcb56b service neutron] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:43.187359 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1358/2691] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 18:06:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 18:06:43.258150 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-3191fcce-12a5-4612-a148-4898618b61e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e11e3e52ccf432ba7738c9265b480d8', 'request_id': 'req-3191fcce-12a5-4612-a148-4898618b61e0'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:43.361283 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-3191fcce-12a5-4612-a148-4898618b61e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e11e3e52ccf432ba7738c9265b480d8', 'request_id': 'req-3191fcce-12a5-4612-a148-4898618b61e0'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:43.369734 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-3191fcce-12a5-4612-a148-4898618b61e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e11e3e52ccf432ba7738c9265b480d8', 'request_id': 'req-3191fcce-12a5-4612-a148-4898618b61e0'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:43.382612 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-3191fcce-12a5-4612-a148-4898618b61e0 admin admin] The token cache is being invalidate because project 6e11e3e52ccf432ba7738c9265b480d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:06:43.383037 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-3191fcce-12a5-4612-a148-4898618b61e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:43.383833 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-3191fcce-12a5-4612-a148-4898618b61e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:43.385650 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1334/2692] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 14 18:06:43 2022] DELETE /identity/v3/projects/6e11e3e52ccf432ba7738c9265b480d8 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 18:06:43.391996 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f46d419-8017-4f4f-af7f-69fefd683848 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:43.392296 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f46d419-8017-4f4f-af7f-69fefd683848 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:43.392585 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f46d419-8017-4f4f-af7f-69fefd683848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:43.422038 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-0f46d419-8017-4f4f-af7f-69fefd683848 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:06:43.422640 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-0f46d419-8017-4f4f-af7f-69fefd683848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:43.478548 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:06:43.500811 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1359/2693] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:06:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:06:43.509181 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc38938-de87-447a-a002-7695c59cd976 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:43.509475 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc38938-de87-447a-a002-7695c59cd976 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:43.513308 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc38938-de87-447a-a002-7695c59cd976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:43.531698 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-3bc38938-de87-447a-a002-7695c59cd976 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:06:43.533032 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-3bc38938-de87-447a-a002-7695c59cd976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:43.542407 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1335/2694] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:06:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 18:06:43.547277 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f46d419-8017-4f4f-af7f-69fefd683848 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:43.558407 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f46d419-8017-4f4f-af7f-69fefd683848 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:43.563233 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080a34a7-ba65-462d-b305-a1c9b4faac3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:43.563949 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080a34a7-ba65-462d-b305-a1c9b4faac3e admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:43.564236 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080a34a7-ba65-462d-b305-a1c9b4faac3e admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:43.564519 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080a34a7-ba65-462d-b305-a1c9b4faac3e admin admin] PATH_INFO: `/v3/domains` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:43.565262 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080a34a7-ba65-462d-b305-a1c9b4faac3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 18:06:43.565578 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080a34a7-ba65-462d-b305-a1c9b4faac3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:43.567278 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080a34a7-ba65-462d-b305-a1c9b4faac3e admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:43.580832 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1360/2695] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 14 18:06:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 18:06:43.589826 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc38938-de87-447a-a002-7695c59cd976 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:43.601522 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc38938-de87-447a-a002-7695c59cd976 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:43.606538 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd2a8c1-6b20-4ef0-be70-1c6a0da0153c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:43.607231 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd2a8c1-6b20-4ef0-be70-1c6a0da0153c admin admin] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:43.607562 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd2a8c1-6b20-4ef0-be70-1c6a0da0153c admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:43.607857 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd2a8c1-6b20-4ef0-be70-1c6a0da0153c admin admin] PATH_INFO: `/v3/projects` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:43.608581 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd2a8c1-6b20-4ef0-be70-1c6a0da0153c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:43.610594 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd2a8c1-6b20-4ef0-be70-1c6a0da0153c admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:43.728995 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080a34a7-ba65-462d-b305-a1c9b4faac3e admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:43.730202 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1336/2696] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 14 18:06:43 2022] POST /identity/v3/projects => generated 361 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:06:43.730961 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-080a34a7-ba65-462d-b305-a1c9b4faac3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:43.734139 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd2a8c1-6b20-4ef0-be70-1c6a0da0153c admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:43.745468 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080a34a7-ba65-462d-b305-a1c9b4faac3e admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:43.772687 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:06:43.804658 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd2a8c1-6b20-4ef0-be70-1c6a0da0153c admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:43.809344 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6667fdb1-44d8-409b-a3b7-20d8f4f5cc8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:43.810130 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eff3d9-a728-400a-b2af-867f347518dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:43.810296 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6667fdb1-44d8-409b-a3b7-20d8f4f5cc8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:43.810542 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6667fdb1-44d8-409b-a3b7-20d8f4f5cc8e admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:43.810805 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eff3d9-a728-400a-b2af-867f347518dd admin admin] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:43.810923 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6667fdb1-44d8-409b-a3b7-20d8f4f5cc8e admin admin] PATH_INFO: `/v3/projects/bf517fa543554f77aa825598ad49ee4b` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:43.811092 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eff3d9-a728-400a-b2af-867f347518dd admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:43.811404 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eff3d9-a728-400a-b2af-867f347518dd admin admin] PATH_INFO: `/v3/users` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:43.812093 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eff3d9-a728-400a-b2af-867f347518dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:43.812230 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6667fdb1-44d8-409b-a3b7-20d8f4f5cc8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf517fa543554f77aa825598ad49ee4b)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:43.814043 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6667fdb1-44d8-409b-a3b7-20d8f4f5cc8e admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:43.814191 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eff3d9-a728-400a-b2af-867f347518dd admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:43.938145 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1337/2697] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 14 18:06:43 2022] POST /identity/v3/users => generated 281 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:06:43.942649 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eff3d9-a728-400a-b2af-867f347518dd admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:43.952907 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eff3d9-a728-400a-b2af-867f347518dd admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:43.957541 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24ca816-c777-4d4b-84e7-cf89c24a0527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:43.959077 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24ca816-c777-4d4b-84e7-cf89c24a0527 admin admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:43.959430 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24ca816-c777-4d4b-84e7-cf89c24a0527 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:43.959729 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24ca816-c777-4d4b-84e7-cf89c24a0527 admin admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:43.960818 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24ca816-c777-4d4b-84e7-cf89c24a0527 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:43.963173 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24ca816-c777-4d4b-84e7-cf89c24a0527 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:43.974736 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1338/2698] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 18:06:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 14 18:06:43.980293 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24ca816-c777-4d4b-84e7-cf89c24a0527 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:43.981267 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-6667fdb1-44d8-409b-a3b7-20d8f4f5cc8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf517fa543554f77aa825598ad49ee4b', 'request_id': 'req-6667fdb1-44d8-409b-a3b7-20d8f4f5cc8e'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:43.992413 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24ca816-c777-4d4b-84e7-cf89c24a0527 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:44.062161 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ad756d-cc0c-4558-ae4f-29838ee7946e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:44.062779 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ad756d-cc0c-4558-ae4f-29838ee7946e admin admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:44.063072 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ad756d-cc0c-4558-ae4f-29838ee7946e admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:44.063385 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ad756d-cc0c-4558-ae4f-29838ee7946e admin admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:44.063497 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-6667fdb1-44d8-409b-a3b7-20d8f4f5cc8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf517fa543554f77aa825598ad49ee4b', 'request_id': 'req-6667fdb1-44d8-409b-a3b7-20d8f4f5cc8e'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:44.064164 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ad756d-cc0c-4558-ae4f-29838ee7946e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:44.065860 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ad756d-cc0c-4558-ae4f-29838ee7946e admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:44.071363 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-6667fdb1-44d8-409b-a3b7-20d8f4f5cc8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf517fa543554f77aa825598ad49ee4b', 'request_id': 'req-6667fdb1-44d8-409b-a3b7-20d8f4f5cc8e'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:44.077973 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1339/2699] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 18:06:43 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:06:44.084323 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ad756d-cc0c-4558-ae4f-29838ee7946e admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:44.084714 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-6667fdb1-44d8-409b-a3b7-20d8f4f5cc8e admin admin] The token cache is being invalidate because project bf517fa543554f77aa825598ad49ee4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87019) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:06:44.085017 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-6667fdb1-44d8-409b-a3b7-20d8f4f5cc8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:44.085704 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-6667fdb1-44d8-409b-a3b7-20d8f4f5cc8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:44.087289 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1361/2700] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 14 18:06:43 2022] DELETE /identity/v3/projects/bf517fa543554f77aa825598ad49ee4b => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 18:06:44.092382 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496bcc5f-671d-4f2e-a0a3-11462be72bae None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:44.092725 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496bcc5f-671d-4f2e-a0a3-11462be72bae None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:44.093016 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496bcc5f-671d-4f2e-a0a3-11462be72bae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:44.095392 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ad756d-cc0c-4558-ae4f-29838ee7946e admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:44.101762 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ce3462-6326-4585-ac82-dececcc49eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:44.102772 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ce3462-6326-4585-ac82-dececcc49eb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:44.103061 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ce3462-6326-4585-ac82-dececcc49eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:44.103385 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ce3462-6326-4585-ac82-dececcc49eb8 admin admin] PATH_INFO: `/v3/projects/d2579e65896f4280b38ad714644861ec/users/62682a4260004a669cb47a7ccc27ec00/roles/9ee80134743f4c2b88525b04df2facba` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:44.111437 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-496bcc5f-671d-4f2e-a0a3-11462be72bae None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:06:44.112661 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-496bcc5f-671d-4f2e-a0a3-11462be72bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:44.120584 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ce3462-6326-4585-ac82-dececcc49eb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2579e65896f4280b38ad714644861ec, user_id=62682a4260004a669cb47a7ccc27ec00, role_id=9ee80134743f4c2b88525b04df2facba)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:44.121576 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1362/2701] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:06:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 18:06:44.123570 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ce3462-6326-4585-ac82-dececcc49eb8 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:44.129095 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397bccf3-dcfb-4129-9580-3a7905616e23 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:44.129463 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397bccf3-dcfb-4129-9580-3a7905616e23 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:44.130513 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397bccf3-dcfb-4129-9580-3a7905616e23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:44.149026 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-397bccf3-dcfb-4129-9580-3a7905616e23 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:06:44.150314 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-397bccf3-dcfb-4129-9580-3a7905616e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:44.158809 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1363/2702] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:06:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 18:06:44.163194 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397bccf3-dcfb-4129-9580-3a7905616e23 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:44.172252 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397bccf3-dcfb-4129-9580-3a7905616e23 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:44.177689 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcf4cf3-c03a-41c4-b2a1-fc04d70e3f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:44.178354 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcf4cf3-c03a-41c4-b2a1-fc04d70e3f03 admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:44.178939 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcf4cf3-c03a-41c4-b2a1-fc04d70e3f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:44.178939 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcf4cf3-c03a-41c4-b2a1-fc04d70e3f03 admin admin] PATH_INFO: `/v3/domains` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:44.179678 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcf4cf3-c03a-41c4-b2a1-fc04d70e3f03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 18:06:44.179991 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcf4cf3-c03a-41c4-b2a1-fc04d70e3f03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:44.181652 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcf4cf3-c03a-41c4-b2a1-fc04d70e3f03 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:44.194008 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1364/2703] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 14 18:06:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 18:06:44.198373 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcf4cf3-c03a-41c4-b2a1-fc04d70e3f03 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:44.207899 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1340/2704] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 18:06:44 2022] PUT /identity/v3/projects/d2579e65896f4280b38ad714644861ec/users/62682a4260004a669cb47a7ccc27ec00/roles/9ee80134743f4c2b88525b04df2facba => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 18:06:44.209507 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcf4cf3-c03a-41c4-b2a1-fc04d70e3f03 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:44.218148 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cf1383-63c0-46e0-86c8-ebbe8172c224 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:44.218449 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cf1383-63c0-46e0-86c8-ebbe8172c224 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:44.218734 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cf1383-63c0-46e0-86c8-ebbe8172c224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:44.246852 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:06:44.248676 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-a3cf1383-63c0-46e0-86c8-ebbe8172c224 None None] MFA Rules not processed for user `62682a4260004a669cb47a7ccc27ec00`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:06:44.250060 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-a3cf1383-63c0-46e0-86c8-ebbe8172c224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:44.271691 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bf7df3-11f2-4e6a-bee3-8d42487e2466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:44.272448 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bf7df3-11f2-4e6a-bee3-8d42487e2466 admin admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:44.272740 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bf7df3-11f2-4e6a-bee3-8d42487e2466 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:44.273023 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bf7df3-11f2-4e6a-bee3-8d42487e2466 admin admin] PATH_INFO: `/v3/projects` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:44.273719 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bf7df3-11f2-4e6a-bee3-8d42487e2466 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:44.275684 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bf7df3-11f2-4e6a-bee3-8d42487e2466 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:44.322327 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1341/2705] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:06:44 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 18:06:44.359374 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cf1383-63c0-46e0-86c8-ebbe8172c224 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:44.360790 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-a3cf1383-63c0-46e0-86c8-ebbe8172c224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:44.373114 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:06:44.378197 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1365/2706] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 14 18:06:44 2022] POST /identity/v3/projects => generated 375 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 18:06:44.379277 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bf7df3-11f2-4e6a-bee3-8d42487e2466 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:44.425369 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cf1383-63c0-46e0-86c8-ebbe8172c224 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:44.448187 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bf7df3-11f2-4e6a-bee3-8d42487e2466 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:44.453359 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fd435c-b1a6-4536-9dfa-f7d0b9fb536e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:44.454071 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fd435c-b1a6-4536-9dfa-f7d0b9fb536e admin admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:44.454359 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fd435c-b1a6-4536-9dfa-f7d0b9fb536e admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:44.454638 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fd435c-b1a6-4536-9dfa-f7d0b9fb536e admin admin] PATH_INFO: `/v3/users` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:44.455594 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fd435c-b1a6-4536-9dfa-f7d0b9fb536e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:44.457577 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fd435c-b1a6-4536-9dfa-f7d0b9fb536e admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:44.478554 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd79dfa-df88-4bc7-8c6d-e024a8a44d41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17945e7d72954b8787e0ba09a9903247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:44.479220 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd79dfa-df88-4bc7-8c6d-e024a8a44d41 service cinder] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:44.479534 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd79dfa-df88-4bc7-8c6d-e024a8a44d41 service cinder] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:44.479820 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd79dfa-df88-4bc7-8c6d-e024a8a44d41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:44.539362 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd79dfa-df88-4bc7-8c6d-e024a8a44d41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:44.540925 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd79dfa-df88-4bc7-8c6d-e024a8a44d41 service cinder] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:44.550500 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1342/2707] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 18:06:44 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 18:06:44.557255 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1366/2708] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 14 18:06:44 2022] POST /identity/v3/users => generated 288 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:06:44.561408 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd79dfa-df88-4bc7-8c6d-e024a8a44d41 service cinder] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:44.565714 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fd435c-b1a6-4536-9dfa-f7d0b9fb536e admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:44.568060 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-53fd435c-b1a6-4536-9dfa-f7d0b9fb536e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:44.575471 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd79dfa-df88-4bc7-8c6d-e024a8a44d41 service cinder] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:44.579674 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fd3e81-a79c-44be-badb-eaa9684d9c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:44.580369 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fd3e81-a79c-44be-badb-eaa9684d9c42 admin admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:44.580712 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fd3e81-a79c-44be-badb-eaa9684d9c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:44.581000 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fd3e81-a79c-44be-badb-eaa9684d9c42 admin admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:44.581894 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fd3e81-a79c-44be-badb-eaa9684d9c42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:44.582305 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fd435c-b1a6-4536-9dfa-f7d0b9fb536e admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:44.584234 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fd3e81-a79c-44be-badb-eaa9684d9c42 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:44.587855 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814798b4-fbcf-4ed2-88f5-8c487b79b6f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:44.588747 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814798b4-fbcf-4ed2-88f5-8c487b79b6f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:44.589034 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814798b4-fbcf-4ed2-88f5-8c487b79b6f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:44.589863 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814798b4-fbcf-4ed2-88f5-8c487b79b6f6 admin admin] PATH_INFO: `/v3/users/62682a4260004a669cb47a7ccc27ec00` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:44.590551 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814798b4-fbcf-4ed2-88f5-8c487b79b6f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62682a4260004a669cb47a7ccc27ec00)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:44.592544 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814798b4-fbcf-4ed2-88f5-8c487b79b6f6 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:44.598840 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1343/2709] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 18:06:44 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:06:44.600313 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fd3e81-a79c-44be-badb-eaa9684d9c42 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:44.610792 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fd3e81-a79c-44be-badb-eaa9684d9c42 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:44.615777 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aec79c-8ba4-4aa2-a7c8-e00430a30b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:44.616501 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aec79c-8ba4-4aa2-a7c8-e00430a30b4b admin admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:44.616841 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aec79c-8ba4-4aa2-a7c8-e00430a30b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:44.617073 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aec79c-8ba4-4aa2-a7c8-e00430a30b4b admin admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:44.617810 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18aec79c-8ba4-4aa2-a7c8-e00430a30b4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:44.619453 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18aec79c-8ba4-4aa2-a7c8-e00430a30b4b admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:44.633755 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1344/2710] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 18:06:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 14 18:06:44.642235 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aec79c-8ba4-4aa2-a7c8-e00430a30b4b admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:44.646815 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aec79c-8ba4-4aa2-a7c8-e00430a30b4b admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:44.652186 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d630ca0-31ad-434e-a6bc-a84009bec68a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:44.653336 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d630ca0-31ad-434e-a6bc-a84009bec68a admin admin] REQUEST_METHOD: `PUT` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:44.653622 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d630ca0-31ad-434e-a6bc-a84009bec68a admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:44.653899 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d630ca0-31ad-434e-a6bc-a84009bec68a admin admin] PATH_INFO: `/v3/projects/70351c3c360741b0b28dbaa5156b4d02/users/bf256adddbb945be8ee9b13eca683ece/roles/9ee80134743f4c2b88525b04df2facba` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:44.669744 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d630ca0-31ad-434e-a6bc-a84009bec68a admin admin] RBAC: Authorizing `identity:create_grant(project_id=70351c3c360741b0b28dbaa5156b4d02, user_id=bf256adddbb945be8ee9b13eca683ece, role_id=9ee80134743f4c2b88525b04df2facba)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:44.672478 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d630ca0-31ad-434e-a6bc-a84009bec68a admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:44.784535 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1345/2711] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 18:06:44 2022] PUT /identity/v3/projects/70351c3c360741b0b28dbaa5156b4d02/users/bf256adddbb945be8ee9b13eca683ece/roles/9ee80134743f4c2b88525b04df2facba => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 18:06:44.796789 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5212849b-1321-47e6-8f5f-b6c3383822b4 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:44.797089 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5212849b-1321-47e6-8f5f-b6c3383822b4 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:44.797371 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5212849b-1321-47e6-8f5f-b6c3383822b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:44.827832 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-5212849b-1321-47e6-8f5f-b6c3383822b4 None None] MFA Rules not processed for user `bf256adddbb945be8ee9b13eca683ece`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:06:44.827832 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-5212849b-1321-47e6-8f5f-b6c3383822b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:44.868102 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-814798b4-fbcf-4ed2-88f5-8c487b79b6f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62682a4260004a669cb47a7ccc27ec00'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:44.868811 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-814798b4-fbcf-4ed2-88f5-8c487b79b6f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62682a4260004a669cb47a7ccc27ec00'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:44.869418 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-814798b4-fbcf-4ed2-88f5-8c487b79b6f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62682a4260004a669cb47a7ccc27ec00'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:44.898810 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1346/2712] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:06:44 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:06:44.909687 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5212849b-1321-47e6-8f5f-b6c3383822b4 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:44.912349 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-5212849b-1321-47e6-8f5f-b6c3383822b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:44.936165 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-814798b4-fbcf-4ed2-88f5-8c487b79b6f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62682a4260004a669cb47a7ccc27ec00'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:44.945110 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-814798b4-fbcf-4ed2-88f5-8c487b79b6f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62682a4260004a669cb47a7ccc27ec00'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:44.962781 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1367/2713] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 14 18:06:44 2022] DELETE /identity/v3/users/62682a4260004a669cb47a7ccc27ec00 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 18:06:44.967238 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb315d4d-5e4d-4c1f-8323-3ed5357dae24 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:44.967556 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb315d4d-5e4d-4c1f-8323-3ed5357dae24 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:44.967848 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb315d4d-5e4d-4c1f-8323-3ed5357dae24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:44.976330 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5212849b-1321-47e6-8f5f-b6c3383822b4 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:44.985696 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-fb315d4d-5e4d-4c1f-8323-3ed5357dae24 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:06:44.986931 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-fb315d4d-5e4d-4c1f-8323-3ed5357dae24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:45.009433 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:06:45.025670 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b3f079-61bb-4c68-bf44-fa92a2a4edd1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17945e7d72954b8787e0ba09a9903247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:45.026335 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b3f079-61bb-4c68-bf44-fa92a2a4edd1 service cinder] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:45.026627 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b3f079-61bb-4c68-bf44-fa92a2a4edd1 service cinder] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:45.027138 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b3f079-61bb-4c68-bf44-fa92a2a4edd1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:45.040642 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:06:45.055801 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1368/2714] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:06:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 18:06:45.068110 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb315d4d-5e4d-4c1f-8323-3ed5357dae24 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:45.069653 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-fb315d4d-5e4d-4c1f-8323-3ed5357dae24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:45.105143 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b3f079-61bb-4c68-bf44-fa92a2a4edd1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:45.106811 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b3f079-61bb-4c68-bf44-fa92a2a4edd1 service cinder] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:45.117268 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1347/2715] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 18:06:44 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 18:06:45.137067 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb315d4d-5e4d-4c1f-8323-3ed5357dae24 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:45.141045 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec41a4e5-79b9-49d1-91be-77858989162e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5652329c71cd431fb579d69cef933b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:45.141706 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec41a4e5-79b9-49d1-91be-77858989162e service neutron] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:45.142007 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec41a4e5-79b9-49d1-91be-77858989162e service neutron] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:45.142365 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec41a4e5-79b9-49d1-91be-77858989162e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:45.158774 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec41a4e5-79b9-49d1-91be-77858989162e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:45.160283 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec41a4e5-79b9-49d1-91be-77858989162e service neutron] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:45.172819 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1369/2716] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 18:06:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:06:45.660598 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b3f079-61bb-4c68-bf44-fa92a2a4edd1 service cinder] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:45.662646 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-08b3f079-61bb-4c68-bf44-fa92a2a4edd1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:45.690000 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b3f079-61bb-4c68-bf44-fa92a2a4edd1 service cinder] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:45.696314 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0ae851-0173-4395-8f24-16396aaf6d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:45.697171 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0ae851-0173-4395-8f24-16396aaf6d9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:45.697459 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0ae851-0173-4395-8f24-16396aaf6d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:45.697745 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0ae851-0173-4395-8f24-16396aaf6d9f admin admin] PATH_INFO: `/v3/projects/d2579e65896f4280b38ad714644861ec` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:45.698970 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0ae851-0173-4395-8f24-16396aaf6d9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2579e65896f4280b38ad714644861ec)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:45.700938 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0ae851-0173-4395-8f24-16396aaf6d9f admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:45.787484 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:06:45.802818 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-3d0ae851-0173-4395-8f24-16396aaf6d9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2579e65896f4280b38ad714644861ec', 'request_id': 'req-3d0ae851-0173-4395-8f24-16396aaf6d9f'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:45.914596 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-3d0ae851-0173-4395-8f24-16396aaf6d9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2579e65896f4280b38ad714644861ec', 'request_id': 'req-3d0ae851-0173-4395-8f24-16396aaf6d9f'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:45.921205 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-3d0ae851-0173-4395-8f24-16396aaf6d9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2579e65896f4280b38ad714644861ec', 'request_id': 'req-3d0ae851-0173-4395-8f24-16396aaf6d9f'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:45.933846 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-3d0ae851-0173-4395-8f24-16396aaf6d9f admin admin] The token cache is being invalidate because project d2579e65896f4280b38ad714644861ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:06:45.934762 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-3d0ae851-0173-4395-8f24-16396aaf6d9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:45.935490 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-3d0ae851-0173-4395-8f24-16396aaf6d9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:45.937106 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1348/2717] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 14 18:06:45 2022] DELETE /identity/v3/projects/d2579e65896f4280b38ad714644861ec => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:06:46.871215 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec41a4e5-79b9-49d1-91be-77858989162e service neutron] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:46.872732 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-ec41a4e5-79b9-49d1-91be-77858989162e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:46.885950 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec41a4e5-79b9-49d1-91be-77858989162e service neutron] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:46.950295 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bf6bfb-48c6-4bb9-9044-8aa9aba95863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:46.951248 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bf6bfb-48c6-4bb9-9044-8aa9aba95863 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:46.951501 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bf6bfb-48c6-4bb9-9044-8aa9aba95863 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:46.951788 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bf6bfb-48c6-4bb9-9044-8aa9aba95863 admin admin] PATH_INFO: `/v3/users/878893f3008045f8b2100d71c549db17` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:46.952988 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bf6bfb-48c6-4bb9-9044-8aa9aba95863 admin admin] RBAC: Authorizing `identity:delete_user(user_id=878893f3008045f8b2100d71c549db17)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:46.954903 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bf6bfb-48c6-4bb9-9044-8aa9aba95863 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:47.118575 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-18bf6bfb-48c6-4bb9-9044-8aa9aba95863 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '878893f3008045f8b2100d71c549db17'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:47.119500 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-18bf6bfb-48c6-4bb9-9044-8aa9aba95863 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '878893f3008045f8b2100d71c549db17'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:47.120121 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-18bf6bfb-48c6-4bb9-9044-8aa9aba95863 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '878893f3008045f8b2100d71c549db17'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:47.178363 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-18bf6bfb-48c6-4bb9-9044-8aa9aba95863 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '878893f3008045f8b2100d71c549db17'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:47.188716 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-18bf6bfb-48c6-4bb9-9044-8aa9aba95863 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '878893f3008045f8b2100d71c549db17'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:47.195602 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:06:47.208811 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1370/2718] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 14 18:06:46 2022] DELETE /identity/v3/users/878893f3008045f8b2100d71c549db17 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:06:47.214538 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c241e8df-c2ef-4d35-91ee-01f8537d6316 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:47.215033 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c241e8df-c2ef-4d35-91ee-01f8537d6316 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:47.223074 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c241e8df-c2ef-4d35-91ee-01f8537d6316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:47.237064 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-c241e8df-c2ef-4d35-91ee-01f8537d6316 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:06:47.240218 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-c241e8df-c2ef-4d35-91ee-01f8537d6316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:47.310074 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1349/2719] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:06:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:06:47.321073 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bf6bfb-48c6-4bb9-9044-8aa9aba95863 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:47.322485 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-18bf6bfb-48c6-4bb9-9044-8aa9aba95863 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:47.390010 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bf6bfb-48c6-4bb9-9044-8aa9aba95863 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:47.394159 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb35d60-b5fe-459f-89ad-2a1d7fd4edc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5652329c71cd431fb579d69cef933b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:47.394823 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb35d60-b5fe-459f-89ad-2a1d7fd4edc4 service neutron] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:47.395114 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb35d60-b5fe-459f-89ad-2a1d7fd4edc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:47.395472 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb35d60-b5fe-459f-89ad-2a1d7fd4edc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:47.405984 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb35d60-b5fe-459f-89ad-2a1d7fd4edc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:47.407439 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb35d60-b5fe-459f-89ad-2a1d7fd4edc4 service neutron] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:47.417648 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1371/2720] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 18:06:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:06:47.905772 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c241e8df-c2ef-4d35-91ee-01f8537d6316 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:47.907364 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-c241e8df-c2ef-4d35-91ee-01f8537d6316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:47.922157 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c241e8df-c2ef-4d35-91ee-01f8537d6316 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:47.927655 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a9e874-0bc9-44d1-a57e-0029bbf9c4c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:47.928756 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a9e874-0bc9-44d1-a57e-0029bbf9c4c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:47.929051 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a9e874-0bc9-44d1-a57e-0029bbf9c4c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:47.929330 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a9e874-0bc9-44d1-a57e-0029bbf9c4c4 admin admin] PATH_INFO: `/v3/projects/acb9e08baf7146329f9cd685d8150237` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:47.930835 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a9e874-0bc9-44d1-a57e-0029bbf9c4c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=acb9e08baf7146329f9cd685d8150237)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:47.933292 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a9e874-0bc9-44d1-a57e-0029bbf9c4c4 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:48.049526 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-72a9e874-0bc9-44d1-a57e-0029bbf9c4c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acb9e08baf7146329f9cd685d8150237', 'request_id': 'req-72a9e874-0bc9-44d1-a57e-0029bbf9c4c4'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:48.125943 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-72a9e874-0bc9-44d1-a57e-0029bbf9c4c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acb9e08baf7146329f9cd685d8150237', 'request_id': 'req-72a9e874-0bc9-44d1-a57e-0029bbf9c4c4'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:48.132709 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-72a9e874-0bc9-44d1-a57e-0029bbf9c4c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acb9e08baf7146329f9cd685d8150237', 'request_id': 'req-72a9e874-0bc9-44d1-a57e-0029bbf9c4c4'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:48.144406 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-72a9e874-0bc9-44d1-a57e-0029bbf9c4c4 admin admin] The token cache is being invalidate because project acb9e08baf7146329f9cd685d8150237 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:06:48.144698 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-72a9e874-0bc9-44d1-a57e-0029bbf9c4c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:48.145361 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-72a9e874-0bc9-44d1-a57e-0029bbf9c4c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:48.147725 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1350/2721] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 14 18:06:47 2022] DELETE /identity/v3/projects/acb9e08baf7146329f9cd685d8150237 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:06:48.152942 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e83d329-c5b8-448d-a25a-e16026839f19 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:48.153413 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e83d329-c5b8-448d-a25a-e16026839f19 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:48.153511 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e83d329-c5b8-448d-a25a-e16026839f19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:48.172074 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-6e83d329-c5b8-448d-a25a-e16026839f19 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:06:48.173279 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-6e83d329-c5b8-448d-a25a-e16026839f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:48.232725 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1372/2722] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:06:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:06:48.240737 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e9f938-483d-4633-a0c3-d1a1b66953e3 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:48.241364 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e9f938-483d-4633-a0c3-d1a1b66953e3 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:48.241364 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e9f938-483d-4633-a0c3-d1a1b66953e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:48.261463 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-76e9f938-483d-4633-a0c3-d1a1b66953e3 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:06:48.262699 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-76e9f938-483d-4633-a0c3-d1a1b66953e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:48.271074 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1351/2723] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:06:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:06:48.277577 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e83d329-c5b8-448d-a25a-e16026839f19 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:48.287553 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e83d329-c5b8-448d-a25a-e16026839f19 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:48.292331 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc008d5-9cfd-4817-acdc-f80fc2dc2097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:48.293005 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc008d5-9cfd-4817-acdc-f80fc2dc2097 admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:48.293297 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc008d5-9cfd-4817-acdc-f80fc2dc2097 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:48.293585 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc008d5-9cfd-4817-acdc-f80fc2dc2097 admin admin] PATH_INFO: `/v3/domains` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:48.294327 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc008d5-9cfd-4817-acdc-f80fc2dc2097 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 18:06:48.294688 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc008d5-9cfd-4817-acdc-f80fc2dc2097 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:48.296361 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc008d5-9cfd-4817-acdc-f80fc2dc2097 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:48.308889 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1373/2724] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 14 18:06:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 18:06:48.313241 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e9f938-483d-4633-a0c3-d1a1b66953e3 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:48.323743 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e9f938-483d-4633-a0c3-d1a1b66953e3 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:48.328486 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2229af-8773-4c4a-a4eb-57ab47fa74ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:48.329156 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2229af-8773-4c4a-a4eb-57ab47fa74ff admin admin] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:48.330685 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2229af-8773-4c4a-a4eb-57ab47fa74ff admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:48.330974 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2229af-8773-4c4a-a4eb-57ab47fa74ff admin admin] PATH_INFO: `/v3/projects` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:48.331735 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2229af-8773-4c4a-a4eb-57ab47fa74ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:48.333641 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2229af-8773-4c4a-a4eb-57ab47fa74ff admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:48.437245 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1352/2725] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 14 18:06:48 2022] POST /identity/v3/projects => generated 381 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 18:06:48.441337 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc008d5-9cfd-4817-acdc-f80fc2dc2097 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:48.452222 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc008d5-9cfd-4817-acdc-f80fc2dc2097 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:48.515823 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb98fece-f066-4f5f-932c-ccdc1f019656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:48.516514 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb98fece-f066-4f5f-932c-ccdc1f019656 admin admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:48.516810 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb98fece-f066-4f5f-932c-ccdc1f019656 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:48.517094 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb98fece-f066-4f5f-932c-ccdc1f019656 admin admin] PATH_INFO: `/v3/users` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:48.517952 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb98fece-f066-4f5f-932c-ccdc1f019656 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:48.519925 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb98fece-f066-4f5f-932c-ccdc1f019656 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:48.613970 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1374/2726] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 14 18:06:48 2022] POST /identity/v3/users => generated 291 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:06:48.616229 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2229af-8773-4c4a-a4eb-57ab47fa74ff admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:48.628850 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2229af-8773-4c4a-a4eb-57ab47fa74ff admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:48.634989 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af541f0-70e8-4fc1-8e99-6c415563a938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:48.637350 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af541f0-70e8-4fc1-8e99-6c415563a938 admin admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:48.637350 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af541f0-70e8-4fc1-8e99-6c415563a938 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:48.637350 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af541f0-70e8-4fc1-8e99-6c415563a938 admin admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:48.637350 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af541f0-70e8-4fc1-8e99-6c415563a938 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:48.638772 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af541f0-70e8-4fc1-8e99-6c415563a938 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:48.644828 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:06:48.651332 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1353/2727] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 18:06:48 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:06:48.655630 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb98fece-f066-4f5f-932c-ccdc1f019656 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:48.667411 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb98fece-f066-4f5f-932c-ccdc1f019656 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:48.672118 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc959191-e38f-452a-b5a4-e386d73d84d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:48.672789 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc959191-e38f-452a-b5a4-e386d73d84d0 admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:48.673127 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc959191-e38f-452a-b5a4-e386d73d84d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:48.673414 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc959191-e38f-452a-b5a4-e386d73d84d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:48.674145 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc959191-e38f-452a-b5a4-e386d73d84d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:48.675817 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc959191-e38f-452a-b5a4-e386d73d84d0 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:48.677206 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:06:48.691071 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1375/2728] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 18:06:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:06:48.692243 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af541f0-70e8-4fc1-8e99-6c415563a938 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:48.703287 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af541f0-70e8-4fc1-8e99-6c415563a938 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:48.708502 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541dfe37-7944-486e-8d38-115c0ec05cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:48.711245 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541dfe37-7944-486e-8d38-115c0ec05cc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:48.712402 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541dfe37-7944-486e-8d38-115c0ec05cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:48.712402 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541dfe37-7944-486e-8d38-115c0ec05cc7 admin admin] PATH_INFO: `/v3/projects/affad12a6f0c4c8283d108560731de77/users/913f7f379d9849fc99b1e3054ec7c4b1/roles/9ee80134743f4c2b88525b04df2facba` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:48.727226 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541dfe37-7944-486e-8d38-115c0ec05cc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=affad12a6f0c4c8283d108560731de77, user_id=913f7f379d9849fc99b1e3054ec7c4b1, role_id=9ee80134743f4c2b88525b04df2facba)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:48.729931 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541dfe37-7944-486e-8d38-115c0ec05cc7 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:48.812441 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1354/2729] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 18:06:48 2022] PUT /identity/v3/projects/affad12a6f0c4c8283d108560731de77/users/913f7f379d9849fc99b1e3054ec7c4b1/roles/9ee80134743f4c2b88525b04df2facba => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:06:48.823998 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4a47ec-583f-4676-9d11-3362c63cf457 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:48.824439 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4a47ec-583f-4676-9d11-3362c63cf457 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:48.824801 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4a47ec-583f-4676-9d11-3362c63cf457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:48.854951 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-df4a47ec-583f-4676-9d11-3362c63cf457 None None] MFA Rules not processed for user `913f7f379d9849fc99b1e3054ec7c4b1`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:06:48.856574 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-df4a47ec-583f-4676-9d11-3362c63cf457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:48.925929 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1376/2730] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:06:48 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:06:48.931263 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541dfe37-7944-486e-8d38-115c0ec05cc7 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:48.997829 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541dfe37-7944-486e-8d38-115c0ec05cc7 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:49.003115 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfe2b83-2ef6-41ec-a116-bf32f6a7b015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:49.003833 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfe2b83-2ef6-41ec-a116-bf32f6a7b015 admin admin] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:49.004122 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfe2b83-2ef6-41ec-a116-bf32f6a7b015 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:49.004407 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfe2b83-2ef6-41ec-a116-bf32f6a7b015 admin admin] PATH_INFO: `/v3/projects` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:49.005283 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfe2b83-2ef6-41ec-a116-bf32f6a7b015 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:49.007381 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfe2b83-2ef6-41ec-a116-bf32f6a7b015 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:49.147236 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1355/2731] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 14 18:06:48 2022] POST /identity/v3/projects => generated 383 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:06:49.151022 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4a47ec-583f-4676-9d11-3362c63cf457 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:49.163114 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4a47ec-583f-4676-9d11-3362c63cf457 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:49.200733 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfe2b83-2ef6-41ec-a116-bf32f6a7b015 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:49.202829 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-7cfe2b83-2ef6-41ec-a116-bf32f6a7b015 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:49.228210 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9d5e74-c790-4916-9705-76fdcfdd1b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:49.228999 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9d5e74-c790-4916-9705-76fdcfdd1b53 admin admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:49.228999 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9d5e74-c790-4916-9705-76fdcfdd1b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:49.229421 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9d5e74-c790-4916-9705-76fdcfdd1b53 admin admin] PATH_INFO: `/v3/users` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:49.230123 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9d5e74-c790-4916-9705-76fdcfdd1b53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:49.243386 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9d5e74-c790-4916-9705-76fdcfdd1b53 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:49.299143 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfe2b83-2ef6-41ec-a116-bf32f6a7b015 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:49.306160 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e92f11-4891-44a6-988a-8b05930e4eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:49.307059 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e92f11-4891-44a6-988a-8b05930e4eec admin admin] REQUEST_METHOD: `DELETE` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:49.307382 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e92f11-4891-44a6-988a-8b05930e4eec admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:49.310749 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e92f11-4891-44a6-988a-8b05930e4eec admin admin] PATH_INFO: `/v3/users/e593534ca76e4ae7851b75e30623eac9` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:49.310749 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e92f11-4891-44a6-988a-8b05930e4eec admin admin] RBAC: Authorizing `identity:delete_user(user_id=e593534ca76e4ae7851b75e30623eac9)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:49.311291 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e92f11-4891-44a6-988a-8b05930e4eec admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:49.337399 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1377/2732] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 14 18:06:49 2022] POST /identity/v3/users => generated 292 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:06:49.341342 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9d5e74-c790-4916-9705-76fdcfdd1b53 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:49.352235 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9d5e74-c790-4916-9705-76fdcfdd1b53 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:49.357242 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc316c9-1f2e-4f55-b0e4-0145faffb443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:49.357913 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc316c9-1f2e-4f55-b0e4-0145faffb443 admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:49.358187 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc316c9-1f2e-4f55-b0e4-0145faffb443 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:49.358470 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc316c9-1f2e-4f55-b0e4-0145faffb443 admin admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:49.359218 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc316c9-1f2e-4f55-b0e4-0145faffb443 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:49.360848 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc316c9-1f2e-4f55-b0e4-0145faffb443 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:49.372156 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1378/2733] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 18:06:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:06:49.376462 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc316c9-1f2e-4f55-b0e4-0145faffb443 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:49.386666 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc316c9-1f2e-4f55-b0e4-0145faffb443 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:49.393426 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7afdac9-6545-48a2-8409-52c044668cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:49.394547 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7afdac9-6545-48a2-8409-52c044668cc4 admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:49.395056 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7afdac9-6545-48a2-8409-52c044668cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:49.395616 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7afdac9-6545-48a2-8409-52c044668cc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:49.396573 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7afdac9-6545-48a2-8409-52c044668cc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:49.398890 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7afdac9-6545-48a2-8409-52c044668cc4 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:49.410166 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1379/2734] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 18:06:49 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 14 18:06:49.415187 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7afdac9-6545-48a2-8409-52c044668cc4 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:49.425958 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7afdac9-6545-48a2-8409-52c044668cc4 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:49.432399 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe18ee4-7eb6-4cd6-acde-bf0e7af3ea37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:49.439524 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe18ee4-7eb6-4cd6-acde-bf0e7af3ea37 admin admin] REQUEST_METHOD: `PUT` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:49.439524 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe18ee4-7eb6-4cd6-acde-bf0e7af3ea37 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:49.439524 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe18ee4-7eb6-4cd6-acde-bf0e7af3ea37 admin admin] PATH_INFO: `/v3/projects/ecc7a9136d3c480287267725c3cff354/users/8c8c2e4efb484366b992a794cef081ba/roles/9ee80134743f4c2b88525b04df2facba` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:49.454795 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe18ee4-7eb6-4cd6-acde-bf0e7af3ea37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecc7a9136d3c480287267725c3cff354, user_id=8c8c2e4efb484366b992a794cef081ba, role_id=9ee80134743f4c2b88525b04df2facba)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:49.457644 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe18ee4-7eb6-4cd6-acde-bf0e7af3ea37 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:49.605933 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-f4e92f11-4891-44a6-988a-8b05930e4eec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e593534ca76e4ae7851b75e30623eac9'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:49.606526 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-f4e92f11-4891-44a6-988a-8b05930e4eec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e593534ca76e4ae7851b75e30623eac9'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:49.607192 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-f4e92f11-4891-44a6-988a-8b05930e4eec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e593534ca76e4ae7851b75e30623eac9'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:49.629759 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1380/2735] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 18:06:49 2022] PUT /identity/v3/projects/ecc7a9136d3c480287267725c3cff354/users/8c8c2e4efb484366b992a794cef081ba/roles/9ee80134743f4c2b88525b04df2facba => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 18:06:49.641278 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320c40d0-2552-4788-b3fa-380e347bb5db None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:49.641569 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320c40d0-2552-4788-b3fa-380e347bb5db None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:49.641850 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320c40d0-2552-4788-b3fa-380e347bb5db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:49.673309 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-320c40d0-2552-4788-b3fa-380e347bb5db None None] MFA Rules not processed for user `8c8c2e4efb484366b992a794cef081ba`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:06:49.674543 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-320c40d0-2552-4788-b3fa-380e347bb5db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:49.691718 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:06:49.703376 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-f4e92f11-4891-44a6-988a-8b05930e4eec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e593534ca76e4ae7851b75e30623eac9'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:49.711966 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-f4e92f11-4891-44a6-988a-8b05930e4eec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e593534ca76e4ae7851b75e30623eac9'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:49.713563 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:06:49.731735 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1356/2736] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 14 18:06:49 2022] DELETE /identity/v3/users/e593534ca76e4ae7851b75e30623eac9 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 18:06:49.736555 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc67e0f-7569-4fee-815c-83ff49fb20d4 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:49.736936 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc67e0f-7569-4fee-815c-83ff49fb20d4 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:49.737233 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc67e0f-7569-4fee-815c-83ff49fb20d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:49.748049 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1381/2737] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:06:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 18:06:49.753337 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320c40d0-2552-4788-b3fa-380e347bb5db None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:49.759165 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-320c40d0-2552-4788-b3fa-380e347bb5db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:49.759347 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-7cc67e0f-7569-4fee-815c-83ff49fb20d4 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:06:49.759777 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-7cc67e0f-7569-4fee-815c-83ff49fb20d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:49.829924 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320c40d0-2552-4788-b3fa-380e347bb5db None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:49.832582 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1357/2738] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:06:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:06:49.835754 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8471b3a2-ffe0-4db6-9c78-cf3a29c42c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:49.836424 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8471b3a2-ffe0-4db6-9c78-cf3a29c42c9c admin admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:49.836714 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8471b3a2-ffe0-4db6-9c78-cf3a29c42c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:49.837191 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8471b3a2-ffe0-4db6-9c78-cf3a29c42c9c admin admin] PATH_INFO: `/v3/projects` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:49.838003 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8471b3a2-ffe0-4db6-9c78-cf3a29c42c9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:49.839982 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8471b3a2-ffe0-4db6-9c78-cf3a29c42c9c admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:49.843367 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc67e0f-7569-4fee-815c-83ff49fb20d4 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:49.844732 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-7cc67e0f-7569-4fee-815c-83ff49fb20d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:49.904290 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc67e0f-7569-4fee-815c-83ff49fb20d4 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:49.910330 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241705f5-53de-4ed3-83f9-0e5f2e49dcc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5652329c71cd431fb579d69cef933b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:49.910330 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241705f5-53de-4ed3-83f9-0e5f2e49dcc7 service neutron] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:49.910330 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241705f5-53de-4ed3-83f9-0e5f2e49dcc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:49.910330 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241705f5-53de-4ed3-83f9-0e5f2e49dcc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:49.919268 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241705f5-53de-4ed3-83f9-0e5f2e49dcc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:49.920761 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241705f5-53de-4ed3-83f9-0e5f2e49dcc7 service neutron] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:49.930418 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1358/2739] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 18:06:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 18:06:49.937772 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1382/2740] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 14 18:06:49 2022] POST /identity/v3/projects => generated 385 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 18:06:49.941849 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241705f5-53de-4ed3-83f9-0e5f2e49dcc7 service neutron] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:49.952022 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241705f5-53de-4ed3-83f9-0e5f2e49dcc7 service neutron] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:50.016466 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7520fd-a742-4240-9eed-a9803011972a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:50.017152 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7520fd-a742-4240-9eed-a9803011972a admin admin] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:50.017440 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7520fd-a742-4240-9eed-a9803011972a admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:50.017738 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7520fd-a742-4240-9eed-a9803011972a admin admin] PATH_INFO: `/v3/users` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:50.018421 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7520fd-a742-4240-9eed-a9803011972a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:50.020405 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7520fd-a742-4240-9eed-a9803011972a admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:50.080809 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1359/2741] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 14 18:06:49 2022] POST /identity/v3/users => generated 299 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:06:50.086133 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8471b3a2-ffe0-4db6-9c78-cf3a29c42c9c admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:50.097853 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8471b3a2-ffe0-4db6-9c78-cf3a29c42c9c admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:50.103796 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e864d5-5065-4f73-aa79-0c8e15ff0216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:50.104759 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e864d5-5065-4f73-aa79-0c8e15ff0216 admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:50.105102 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e864d5-5065-4f73-aa79-0c8e15ff0216 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:50.105383 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e864d5-5065-4f73-aa79-0c8e15ff0216 admin admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:50.106127 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e864d5-5065-4f73-aa79-0c8e15ff0216 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:50.107761 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e864d5-5065-4f73-aa79-0c8e15ff0216 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:50.120725 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1383/2742] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 18:06:50 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:06:50.126992 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7520fd-a742-4240-9eed-a9803011972a admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:50.142356 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7520fd-a742-4240-9eed-a9803011972a admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:50.149204 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374fc1ad-82cc-44f5-8ec7-73f8e995646a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:50.150162 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374fc1ad-82cc-44f5-8ec7-73f8e995646a admin admin] REQUEST_METHOD: `PUT` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:50.150506 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374fc1ad-82cc-44f5-8ec7-73f8e995646a admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:50.150797 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374fc1ad-82cc-44f5-8ec7-73f8e995646a admin admin] PATH_INFO: `/v3/projects/912e6bca0039446c8dbaad6dc521b62e/users/448a3e9e9a7b4f5a9f045f9f185a9865/roles/1348580877d04014bfdec4d866b98a74` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:50.166622 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:06:50.171050 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374fc1ad-82cc-44f5-8ec7-73f8e995646a admin admin] RBAC: Authorizing `identity:create_grant(project_id=912e6bca0039446c8dbaad6dc521b62e, user_id=448a3e9e9a7b4f5a9f045f9f185a9865, role_id=1348580877d04014bfdec4d866b98a74)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:50.173783 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374fc1ad-82cc-44f5-8ec7-73f8e995646a admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:50.258970 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1360/2743] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 18:06:50 2022] PUT /identity/v3/projects/912e6bca0039446c8dbaad6dc521b62e/users/448a3e9e9a7b4f5a9f045f9f185a9865/roles/1348580877d04014bfdec4d866b98a74 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:06:50.263152 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e864d5-5065-4f73-aa79-0c8e15ff0216 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:50.274345 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e864d5-5065-4f73-aa79-0c8e15ff0216 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:50.336989 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b93fd7-20da-4063-b017-e43d2528045b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:50.337704 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b93fd7-20da-4063-b017-e43d2528045b admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:50.337997 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b93fd7-20da-4063-b017-e43d2528045b admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:50.338283 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b93fd7-20da-4063-b017-e43d2528045b admin admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:50.339023 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b93fd7-20da-4063-b017-e43d2528045b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:50.340698 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b93fd7-20da-4063-b017-e43d2528045b admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:50.354506 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1384/2744] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 18:06:50 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:06:50.355750 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374fc1ad-82cc-44f5-8ec7-73f8e995646a admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:50.369166 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374fc1ad-82cc-44f5-8ec7-73f8e995646a admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:50.370571 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b93fd7-20da-4063-b017-e43d2528045b admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:50.372638 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-a8b93fd7-20da-4063-b017-e43d2528045b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:50.380068 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bbfb15-ba48-4df5-9e76-3bfef9a45e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:50.381019 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bbfb15-ba48-4df5-9e76-3bfef9a45e75 admin admin] REQUEST_METHOD: `PUT` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:50.384122 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bbfb15-ba48-4df5-9e76-3bfef9a45e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:50.384122 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bbfb15-ba48-4df5-9e76-3bfef9a45e75 admin admin] PATH_INFO: `/v3/projects/912e6bca0039446c8dbaad6dc521b62e/users/448a3e9e9a7b4f5a9f045f9f185a9865/roles/1348580877d04014bfdec4d866b98a74` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:50.387125 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bbfb15-ba48-4df5-9e76-3bfef9a45e75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=912e6bca0039446c8dbaad6dc521b62e, user_id=448a3e9e9a7b4f5a9f045f9f185a9865, role_id=1348580877d04014bfdec4d866b98a74)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:50.387527 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b93fd7-20da-4063-b017-e43d2528045b admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:50.390231 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bbfb15-ba48-4df5-9e76-3bfef9a45e75 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:50.393240 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c6ca77-cb25-4aa3-81ad-88c491e444a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:50.394836 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c6ca77-cb25-4aa3-81ad-88c491e444a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:50.395137 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c6ca77-cb25-4aa3-81ad-88c491e444a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:50.395595 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c6ca77-cb25-4aa3-81ad-88c491e444a8 admin admin] PATH_INFO: `/v3/projects/ccc06b0dea6049178cf3bbfd75d4db41` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:50.397426 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c6ca77-cb25-4aa3-81ad-88c491e444a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccc06b0dea6049178cf3bbfd75d4db41)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:50.400276 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c6ca77-cb25-4aa3-81ad-88c491e444a8 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:50.403509 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1361/2745] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 18:06:50 2022] PUT /identity/v3/projects/912e6bca0039446c8dbaad6dc521b62e/users/448a3e9e9a7b4f5a9f045f9f185a9865/roles/1348580877d04014bfdec4d866b98a74 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:06:50.414790 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51a977-24a1-47aa-8439-03dd96e9a603 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:50.415181 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51a977-24a1-47aa-8439-03dd96e9a603 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:50.415560 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51a977-24a1-47aa-8439-03dd96e9a603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:50.437586 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:06:50.448453 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-7e51a977-24a1-47aa-8439-03dd96e9a603 None None] MFA Rules not processed for user `448a3e9e9a7b4f5a9f045f9f185a9865`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:06:50.449718 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-7e51a977-24a1-47aa-8439-03dd96e9a603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:50.522840 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1362/2746] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:06:50 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:06:50.534848 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e51a977-24a1-47aa-8439-03dd96e9a603 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:50.536355 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-7e51a977-24a1-47aa-8439-03dd96e9a603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:50.600932 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e51a977-24a1-47aa-8439-03dd96e9a603 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:50.604860 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56614305-6b1c-49fb-9646-ee989e343b2c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17945e7d72954b8787e0ba09a9903247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:50.605519 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56614305-6b1c-49fb-9646-ee989e343b2c service cinder] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:50.605806 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56614305-6b1c-49fb-9646-ee989e343b2c service cinder] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:50.606086 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56614305-6b1c-49fb-9646-ee989e343b2c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:50.607944 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-56614305-6b1c-49fb-9646-ee989e343b2c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:50.631489 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-45c6ca77-cb25-4aa3-81ad-88c491e444a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccc06b0dea6049178cf3bbfd75d4db41', 'request_id': 'req-45c6ca77-cb25-4aa3-81ad-88c491e444a8'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:50.674087 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56614305-6b1c-49fb-9646-ee989e343b2c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:50.675313 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56614305-6b1c-49fb-9646-ee989e343b2c service cinder] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:50.686489 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1363/2747] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 18:06:50 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 18:06:50.730280 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-45c6ca77-cb25-4aa3-81ad-88c491e444a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccc06b0dea6049178cf3bbfd75d4db41', 'request_id': 'req-45c6ca77-cb25-4aa3-81ad-88c491e444a8'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:50.738632 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-45c6ca77-cb25-4aa3-81ad-88c491e444a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccc06b0dea6049178cf3bbfd75d4db41', 'request_id': 'req-45c6ca77-cb25-4aa3-81ad-88c491e444a8'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:50.755582 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-45c6ca77-cb25-4aa3-81ad-88c491e444a8 admin admin] The token cache is being invalidate because project ccc06b0dea6049178cf3bbfd75d4db41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87019) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:06:50.756016 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-45c6ca77-cb25-4aa3-81ad-88c491e444a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:50.757065 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-45c6ca77-cb25-4aa3-81ad-88c491e444a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:50.759778 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1385/2748] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 14 18:06:50 2022] DELETE /identity/v3/projects/ccc06b0dea6049178cf3bbfd75d4db41 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:06:50.763905 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56614305-6b1c-49fb-9646-ee989e343b2c service cinder] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:50.791163 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:06:50.850808 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56614305-6b1c-49fb-9646-ee989e343b2c service cinder] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:50.938054 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8e9753-2bf5-4aeb-a093-8926178d94d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:50.939438 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8e9753-2bf5-4aeb-a093-8926178d94d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:50.940004 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8e9753-2bf5-4aeb-a093-8926178d94d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:50.940501 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8e9753-2bf5-4aeb-a093-8926178d94d6 admin admin] PATH_INFO: `/v3/users/5c1d44c468ec46ad8634df3b56518c8b` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:50.944102 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8e9753-2bf5-4aeb-a093-8926178d94d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c1d44c468ec46ad8634df3b56518c8b)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:50.946217 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8e9753-2bf5-4aeb-a093-8926178d94d6 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:51.183079 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-ed8e9753-2bf5-4aeb-a093-8926178d94d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c1d44c468ec46ad8634df3b56518c8b'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:51.183680 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-ed8e9753-2bf5-4aeb-a093-8926178d94d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c1d44c468ec46ad8634df3b56518c8b'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:51.184287 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-ed8e9753-2bf5-4aeb-a093-8926178d94d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c1d44c468ec46ad8634df3b56518c8b'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:51.246371 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-ed8e9753-2bf5-4aeb-a093-8926178d94d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c1d44c468ec46ad8634df3b56518c8b'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:51.257245 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-ed8e9753-2bf5-4aeb-a093-8926178d94d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c1d44c468ec46ad8634df3b56518c8b'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:51.275827 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1364/2749] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 14 18:06:50 2022] DELETE /identity/v3/users/5c1d44c468ec46ad8634df3b56518c8b => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:06:51.808195 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c6ca77-cb25-4aa3-81ad-88c491e444a8 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:51.810753 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-45c6ca77-cb25-4aa3-81ad-88c491e444a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:51.842161 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c6ca77-cb25-4aa3-81ad-88c491e444a8 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:51.929913 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a7798a-9473-468d-b7af-49fa034b9f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:51.930792 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a7798a-9473-468d-b7af-49fa034b9f3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:51.931101 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a7798a-9473-468d-b7af-49fa034b9f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:51.931407 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a7798a-9473-468d-b7af-49fa034b9f3b admin admin] PATH_INFO: `/v3/projects/f81dfe5d14514df6a1d4ae9ebba0b81c` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:51.933202 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a7798a-9473-468d-b7af-49fa034b9f3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f81dfe5d14514df6a1d4ae9ebba0b81c)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:51.937234 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a7798a-9473-468d-b7af-49fa034b9f3b admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:52.094300 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-08a7798a-9473-468d-b7af-49fa034b9f3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f81dfe5d14514df6a1d4ae9ebba0b81c', 'request_id': 'req-08a7798a-9473-468d-b7af-49fa034b9f3b'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:52.217781 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-08a7798a-9473-468d-b7af-49fa034b9f3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f81dfe5d14514df6a1d4ae9ebba0b81c', 'request_id': 'req-08a7798a-9473-468d-b7af-49fa034b9f3b'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:52.226740 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-08a7798a-9473-468d-b7af-49fa034b9f3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f81dfe5d14514df6a1d4ae9ebba0b81c', 'request_id': 'req-08a7798a-9473-468d-b7af-49fa034b9f3b'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:52.238481 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-08a7798a-9473-468d-b7af-49fa034b9f3b admin admin] The token cache is being invalidate because project f81dfe5d14514df6a1d4ae9ebba0b81c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87019) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:06:52.238779 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-08a7798a-9473-468d-b7af-49fa034b9f3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:52.239494 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-08a7798a-9473-468d-b7af-49fa034b9f3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:52.241860 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1386/2750] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 14 18:06:51 2022] DELETE /identity/v3/projects/f81dfe5d14514df6a1d4ae9ebba0b81c => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:06:52.247131 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dc1450-2efb-416c-ad82-660ef29e19c4 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:52.247685 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dc1450-2efb-416c-ad82-660ef29e19c4 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:52.247788 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dc1450-2efb-416c-ad82-660ef29e19c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:52.268190 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-74dc1450-2efb-416c-ad82-660ef29e19c4 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:06:52.269525 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-74dc1450-2efb-416c-ad82-660ef29e19c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:52.325114 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:06:52.350583 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1365/2751] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:06:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 18:06:52.359059 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6237f21-2989-4bc4-8ac6-5b668bfe11ac None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:52.359423 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6237f21-2989-4bc4-8ac6-5b668bfe11ac None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:52.359803 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6237f21-2989-4bc4-8ac6-5b668bfe11ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:52.381050 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-e6237f21-2989-4bc4-8ac6-5b668bfe11ac None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:06:52.383063 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-e6237f21-2989-4bc4-8ac6-5b668bfe11ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:52.392123 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1387/2752] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:06:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 18:06:52.397270 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dc1450-2efb-416c-ad82-660ef29e19c4 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:52.408148 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dc1450-2efb-416c-ad82-660ef29e19c4 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:52.414314 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5d093c-61f0-4533-867f-58b78f3b80d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:52.415000 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d093c-61f0-4533-867f-58b78f3b80d8 admin admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:52.415282 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d093c-61f0-4533-867f-58b78f3b80d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:52.415597 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d093c-61f0-4533-867f-58b78f3b80d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:52.416393 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5d093c-61f0-4533-867f-58b78f3b80d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 18:06:52.416706 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5d093c-61f0-4533-867f-58b78f3b80d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:52.418316 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5d093c-61f0-4533-867f-58b78f3b80d8 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:52.433599 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1366/2753] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 14 18:06:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 18:06:52.437586 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6237f21-2989-4bc4-8ac6-5b668bfe11ac None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:52.452356 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6237f21-2989-4bc4-8ac6-5b668bfe11ac None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:52.457924 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cb347d-4228-497c-a272-9b43013950fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:52.458610 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cb347d-4228-497c-a272-9b43013950fd admin admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:52.458893 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cb347d-4228-497c-a272-9b43013950fd admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:52.460248 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cb347d-4228-497c-a272-9b43013950fd admin admin] PATH_INFO: `/v3/projects` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:52.460717 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cb347d-4228-497c-a272-9b43013950fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:52.462916 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cb347d-4228-497c-a272-9b43013950fd admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:52.551908 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1388/2754] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 14 18:06:52 2022] POST /identity/v3/projects => generated 385 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:06:52.565670 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5d093c-61f0-4533-867f-58b78f3b80d8 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:52.577812 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5d093c-61f0-4533-867f-58b78f3b80d8 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:52.651872 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dbdb51-d397-42b6-b813-f677250f332d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:52.653015 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dbdb51-d397-42b6-b813-f677250f332d admin admin] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:52.653395 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dbdb51-d397-42b6-b813-f677250f332d admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:52.653856 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dbdb51-d397-42b6-b813-f677250f332d admin admin] PATH_INFO: `/v3/users` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:52.654730 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dbdb51-d397-42b6-b813-f677250f332d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:52.658626 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dbdb51-d397-42b6-b813-f677250f332d admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:52.756887 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1367/2755] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 14 18:06:52 2022] POST /identity/v3/users => generated 293 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:06:52.760938 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cb347d-4228-497c-a272-9b43013950fd admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:52.773347 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cb347d-4228-497c-a272-9b43013950fd admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:52.779523 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2916c88e-9a73-4b4e-8d0a-6a1a70893fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:52.780130 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2916c88e-9a73-4b4e-8d0a-6a1a70893fc9 admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:52.783006 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2916c88e-9a73-4b4e-8d0a-6a1a70893fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:52.783006 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2916c88e-9a73-4b4e-8d0a-6a1a70893fc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:52.783006 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2916c88e-9a73-4b4e-8d0a-6a1a70893fc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:52.783328 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2916c88e-9a73-4b4e-8d0a-6a1a70893fc9 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:52.800805 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1389/2756] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 18:06:52 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:06:52.801301 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dbdb51-d397-42b6-b813-f677250f332d admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:52.814815 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dbdb51-d397-42b6-b813-f677250f332d admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:52.831134 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176d4a69-37e8-4aeb-b7c7-4ac997574ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:52.831134 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176d4a69-37e8-4aeb-b7c7-4ac997574ebc admin admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:52.831134 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176d4a69-37e8-4aeb-b7c7-4ac997574ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:52.831134 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176d4a69-37e8-4aeb-b7c7-4ac997574ebc admin admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:52.831570 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176d4a69-37e8-4aeb-b7c7-4ac997574ebc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:52.831570 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176d4a69-37e8-4aeb-b7c7-4ac997574ebc admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:52.839430 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1368/2757] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 18:06:52 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:06:52.844105 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2916c88e-9a73-4b4e-8d0a-6a1a70893fc9 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:52.846813 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176d4a69-37e8-4aeb-b7c7-4ac997574ebc admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:52.848807 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-176d4a69-37e8-4aeb-b7c7-4ac997574ebc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:52.849285 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:06:52.859819 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2916c88e-9a73-4b4e-8d0a-6a1a70893fc9 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:52.868562 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a940519f-964c-49b3-b158-23aa9f3939c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:52.870131 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a940519f-964c-49b3-b158-23aa9f3939c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:52.870610 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a940519f-964c-49b3-b158-23aa9f3939c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:52.871086 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a940519f-964c-49b3-b158-23aa9f3939c5 admin admin] PATH_INFO: `/v3/projects/7986e882863f435bbdfb8228ab319694/users/2d47a79db07445a5bc7f3c4041148c4e/roles/9ee80134743f4c2b88525b04df2facba` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:52.917460 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a940519f-964c-49b3-b158-23aa9f3939c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7986e882863f435bbdfb8228ab319694, user_id=2d47a79db07445a5bc7f3c4041148c4e, role_id=9ee80134743f4c2b88525b04df2facba)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:52.922814 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a940519f-964c-49b3-b158-23aa9f3939c5 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:52.923853 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176d4a69-37e8-4aeb-b7c7-4ac997574ebc admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:52.929418 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb978abf-9ec0-4193-9c1f-8720d5ec801b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17945e7d72954b8787e0ba09a9903247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:52.930325 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb978abf-9ec0-4193-9c1f-8720d5ec801b service cinder] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:52.930534 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb978abf-9ec0-4193-9c1f-8720d5ec801b service cinder] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:52.930742 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb978abf-9ec0-4193-9c1f-8720d5ec801b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:52.932947 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-fb978abf-9ec0-4193-9c1f-8720d5ec801b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:53.008620 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb978abf-9ec0-4193-9c1f-8720d5ec801b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:53.010134 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb978abf-9ec0-4193-9c1f-8720d5ec801b service cinder] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:53.020443 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1369/2758] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 18:06:52 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:06:53.035027 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1390/2759] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 18:06:52 2022] PUT /identity/v3/projects/7986e882863f435bbdfb8228ab319694/users/2d47a79db07445a5bc7f3c4041148c4e/roles/9ee80134743f4c2b88525b04df2facba => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 18:06:53.047061 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8d0d68-c24c-4531-a012-201a60a5b783 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:53.047061 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8d0d68-c24c-4531-a012-201a60a5b783 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:53.047438 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8d0d68-c24c-4531-a012-201a60a5b783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:53.054664 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:06:53.077583 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-1c8d0d68-c24c-4531-a012-201a60a5b783 None None] MFA Rules not processed for user `2d47a79db07445a5bc7f3c4041148c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:06:53.078886 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-1c8d0d68-c24c-4531-a012-201a60a5b783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:53.165068 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1370/2760] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:06:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:06:53.170202 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a940519f-964c-49b3-b158-23aa9f3939c5 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:53.268794 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a940519f-964c-49b3-b158-23aa9f3939c5 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:53.274398 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d8a7d4-ffb2-4146-b52d-069470b3ba11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:53.275122 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d8a7d4-ffb2-4146-b52d-069470b3ba11 admin admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:53.275479 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d8a7d4-ffb2-4146-b52d-069470b3ba11 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:53.275796 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d8a7d4-ffb2-4146-b52d-069470b3ba11 admin admin] PATH_INFO: `/v3/projects` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:53.277034 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d8a7d4-ffb2-4146-b52d-069470b3ba11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:53.279725 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d8a7d4-ffb2-4146-b52d-069470b3ba11 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:53.419382 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1391/2761] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 14 18:06:53 2022] POST /identity/v3/projects => generated 385 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:06:53.423868 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8d0d68-c24c-4531-a012-201a60a5b783 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:53.436157 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8d0d68-c24c-4531-a012-201a60a5b783 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:53.499855 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2031684e-018c-479d-9620-2710b59102de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:53.500540 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2031684e-018c-479d-9620-2710b59102de admin admin] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:53.500829 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2031684e-018c-479d-9620-2710b59102de admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:53.501114 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2031684e-018c-479d-9620-2710b59102de admin admin] PATH_INFO: `/v3/users` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:53.501811 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2031684e-018c-479d-9620-2710b59102de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:53.503793 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2031684e-018c-479d-9620-2710b59102de admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:53.669883 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1371/2762] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 14 18:06:53 2022] POST /identity/v3/users => generated 299 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:06:53.674287 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d8a7d4-ffb2-4146-b52d-069470b3ba11 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:53.685722 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d8a7d4-ffb2-4146-b52d-069470b3ba11 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:53.690364 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a7ff6e-78c4-4c80-a717-22d6ea809eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:53.691031 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a7ff6e-78c4-4c80-a717-22d6ea809eca admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:53.691340 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a7ff6e-78c4-4c80-a717-22d6ea809eca admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:53.691623 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a7ff6e-78c4-4c80-a717-22d6ea809eca admin admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:53.692378 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a7ff6e-78c4-4c80-a717-22d6ea809eca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:53.694007 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a7ff6e-78c4-4c80-a717-22d6ea809eca admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:53.705300 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1392/2763] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 18:06:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:06:53.709747 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2031684e-018c-479d-9620-2710b59102de admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:53.720203 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2031684e-018c-479d-9620-2710b59102de admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:53.725794 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c00dd2-26b9-4c48-bb09-98afdc559e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:53.726800 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c00dd2-26b9-4c48-bb09-98afdc559e38 admin admin] REQUEST_METHOD: `PUT` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:53.731513 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c00dd2-26b9-4c48-bb09-98afdc559e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:53.731513 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c00dd2-26b9-4c48-bb09-98afdc559e38 admin admin] PATH_INFO: `/v3/projects/a57abf3392094d85a5c4a06fc99c414a/users/02ef595ea9c447cdbdec6014fbc1b3a7/roles/1348580877d04014bfdec4d866b98a74` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:53.745602 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c00dd2-26b9-4c48-bb09-98afdc559e38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a57abf3392094d85a5c4a06fc99c414a, user_id=02ef595ea9c447cdbdec6014fbc1b3a7, role_id=1348580877d04014bfdec4d866b98a74)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:53.748783 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c00dd2-26b9-4c48-bb09-98afdc559e38 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:53.843551 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1372/2764] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 18:06:53 2022] PUT /identity/v3/projects/a57abf3392094d85a5c4a06fc99c414a/users/02ef595ea9c447cdbdec6014fbc1b3a7/roles/1348580877d04014bfdec4d866b98a74 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:06:53.847744 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a7ff6e-78c4-4c80-a717-22d6ea809eca admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:53.858792 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a7ff6e-78c4-4c80-a717-22d6ea809eca admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:53.922667 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff6dd1f-cc9f-4872-8487-2d21fd3861c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:53.923254 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff6dd1f-cc9f-4872-8487-2d21fd3861c0 admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:53.923583 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff6dd1f-cc9f-4872-8487-2d21fd3861c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:53.932164 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff6dd1f-cc9f-4872-8487-2d21fd3861c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:53.932164 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff6dd1f-cc9f-4872-8487-2d21fd3861c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:53.932164 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff6dd1f-cc9f-4872-8487-2d21fd3861c0 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:53.937666 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1393/2765] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 18:06:53 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 14 18:06:53.942516 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c00dd2-26b9-4c48-bb09-98afdc559e38 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:53.953883 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c00dd2-26b9-4c48-bb09-98afdc559e38 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:53.958702 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e746be18-eac6-4205-9c4d-f036c1756bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:53.960314 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e746be18-eac6-4205-9c4d-f036c1756bf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:53.960314 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e746be18-eac6-4205-9c4d-f036c1756bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:53.960314 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e746be18-eac6-4205-9c4d-f036c1756bf8 admin admin] PATH_INFO: `/v3/projects/a57abf3392094d85a5c4a06fc99c414a/users/02ef595ea9c447cdbdec6014fbc1b3a7/roles/1348580877d04014bfdec4d866b98a74` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:53.963012 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e746be18-eac6-4205-9c4d-f036c1756bf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a57abf3392094d85a5c4a06fc99c414a, user_id=02ef595ea9c447cdbdec6014fbc1b3a7, role_id=1348580877d04014bfdec4d866b98a74)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:53.965895 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e746be18-eac6-4205-9c4d-f036c1756bf8 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:53.977878 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1373/2766] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 18:06:53 2022] PUT /identity/v3/projects/a57abf3392094d85a5c4a06fc99c414a/users/02ef595ea9c447cdbdec6014fbc1b3a7/roles/1348580877d04014bfdec4d866b98a74 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:06:53.988448 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37cf696-ab49-4c61-8b41-a40eb74a46bb None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:53.988764 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37cf696-ab49-4c61-8b41-a40eb74a46bb None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:53.989017 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37cf696-ab49-4c61-8b41-a40eb74a46bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:54.025403 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-c37cf696-ab49-4c61-8b41-a40eb74a46bb None None] MFA Rules not processed for user `02ef595ea9c447cdbdec6014fbc1b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:06:54.026628 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-c37cf696-ab49-4c61-8b41-a40eb74a46bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:54.071424 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:06:54.102176 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1394/2767] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:06:53 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:06:54.113405 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e746be18-eac6-4205-9c4d-f036c1756bf8 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:54.115142 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-e746be18-eac6-4205-9c4d-f036c1756bf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:54.166902 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:06:54.178893 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e746be18-eac6-4205-9c4d-f036c1756bf8 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:54.182714 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4824777c-b39d-4cb0-ac8e-b3fe9ec0cb32 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17945e7d72954b8787e0ba09a9903247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:54.187745 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4824777c-b39d-4cb0-ac8e-b3fe9ec0cb32 service cinder] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:54.187745 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4824777c-b39d-4cb0-ac8e-b3fe9ec0cb32 service cinder] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:54.187745 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4824777c-b39d-4cb0-ac8e-b3fe9ec0cb32 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:54.194994 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4824777c-b39d-4cb0-ac8e-b3fe9ec0cb32 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:54.196491 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4824777c-b39d-4cb0-ac8e-b3fe9ec0cb32 service cinder] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:54.206925 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1374/2768] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 18:06:54 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:06:54.844189 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37cf696-ab49-4c61-8b41-a40eb74a46bb None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:54.856273 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37cf696-ab49-4c61-8b41-a40eb74a46bb None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:54.860193 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d07790-793f-4086-a9b6-2c17162df8a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17945e7d72954b8787e0ba09a9903247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:54.860843 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d07790-793f-4086-a9b6-2c17162df8a8 service cinder] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:54.861131 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d07790-793f-4086-a9b6-2c17162df8a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:54.861411 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d07790-793f-4086-a9b6-2c17162df8a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:54.863290 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-53d07790-793f-4086-a9b6-2c17162df8a8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:54.939149 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d07790-793f-4086-a9b6-2c17162df8a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:54.940637 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d07790-793f-4086-a9b6-2c17162df8a8 service cinder] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:54.952152 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1395/2769] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 18:06:54 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:06:55.863247 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4824777c-b39d-4cb0-ac8e-b3fe9ec0cb32 service cinder] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:55.934634 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4824777c-b39d-4cb0-ac8e-b3fe9ec0cb32 service cinder] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:55.939322 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019ae177-b3ed-482a-9d0d-a1218e4c1c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:55.940228 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019ae177-b3ed-482a-9d0d-a1218e4c1c19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:55.940516 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019ae177-b3ed-482a-9d0d-a1218e4c1c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:55.940796 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019ae177-b3ed-482a-9d0d-a1218e4c1c19 admin admin] PATH_INFO: `/v3/users/2d47a79db07445a5bc7f3c4041148c4e` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:55.942093 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019ae177-b3ed-482a-9d0d-a1218e4c1c19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d47a79db07445a5bc7f3c4041148c4e)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:55.944102 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019ae177-b3ed-482a-9d0d-a1218e4c1c19 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:56.156469 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-019ae177-b3ed-482a-9d0d-a1218e4c1c19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d47a79db07445a5bc7f3c4041148c4e'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:56.157156 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-019ae177-b3ed-482a-9d0d-a1218e4c1c19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d47a79db07445a5bc7f3c4041148c4e'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:56.157774 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-019ae177-b3ed-482a-9d0d-a1218e4c1c19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d47a79db07445a5bc7f3c4041148c4e'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:56.246332 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-019ae177-b3ed-482a-9d0d-a1218e4c1c19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d47a79db07445a5bc7f3c4041148c4e'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:56.254016 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-019ae177-b3ed-482a-9d0d-a1218e4c1c19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d47a79db07445a5bc7f3c4041148c4e'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:56.276091 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1375/2770] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 14 18:06:55 2022] DELETE /identity/v3/users/2d47a79db07445a5bc7f3c4041148c4e => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:06:56.281458 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7610166-83c2-4d14-a413-457fe0e45774 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:56.282020 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7610166-83c2-4d14-a413-457fe0e45774 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:56.282288 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7610166-83c2-4d14-a413-457fe0e45774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:56.306381 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-d7610166-83c2-4d14-a413-457fe0e45774 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:06:56.307984 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-d7610166-83c2-4d14-a413-457fe0e45774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:56.376289 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1396/2771] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:06:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:06:56.388095 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019ae177-b3ed-482a-9d0d-a1218e4c1c19 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:56.389477 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-019ae177-b3ed-482a-9d0d-a1218e4c1c19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:56.450740 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019ae177-b3ed-482a-9d0d-a1218e4c1c19 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:56.454417 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66045e1b-ba45-4ea1-9a2d-9a238a291a0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5652329c71cd431fb579d69cef933b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:56.455073 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66045e1b-ba45-4ea1-9a2d-9a238a291a0c service neutron] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:56.455391 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66045e1b-ba45-4ea1-9a2d-9a238a291a0c service neutron] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:56.455727 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66045e1b-ba45-4ea1-9a2d-9a238a291a0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:56.465462 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66045e1b-ba45-4ea1-9a2d-9a238a291a0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:56.466932 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66045e1b-ba45-4ea1-9a2d-9a238a291a0c service neutron] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:56.477658 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1376/2772] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 18:06:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:06:56.956839 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7610166-83c2-4d14-a413-457fe0e45774 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:56.957616 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-d7610166-83c2-4d14-a413-457fe0e45774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:56.971227 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7610166-83c2-4d14-a413-457fe0e45774 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:56.976165 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555b9822-8331-43ce-92dd-6e9dd29d5761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:56.977174 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555b9822-8331-43ce-92dd-6e9dd29d5761 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:56.977589 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555b9822-8331-43ce-92dd-6e9dd29d5761 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:56.977967 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555b9822-8331-43ce-92dd-6e9dd29d5761 admin admin] PATH_INFO: `/v3/projects/7986e882863f435bbdfb8228ab319694` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:56.986296 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555b9822-8331-43ce-92dd-6e9dd29d5761 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7986e882863f435bbdfb8228ab319694)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:56.986296 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555b9822-8331-43ce-92dd-6e9dd29d5761 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:57.099509 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-555b9822-8331-43ce-92dd-6e9dd29d5761 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7986e882863f435bbdfb8228ab319694', 'request_id': 'req-555b9822-8331-43ce-92dd-6e9dd29d5761'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:57.167790 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66045e1b-ba45-4ea1-9a2d-9a238a291a0c service neutron] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:57.168557 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-555b9822-8331-43ce-92dd-6e9dd29d5761 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7986e882863f435bbdfb8228ab319694', 'request_id': 'req-555b9822-8331-43ce-92dd-6e9dd29d5761'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:57.170102 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-66045e1b-ba45-4ea1-9a2d-9a238a291a0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:57.176080 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-555b9822-8331-43ce-92dd-6e9dd29d5761 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7986e882863f435bbdfb8228ab319694', 'request_id': 'req-555b9822-8331-43ce-92dd-6e9dd29d5761'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:57.178569 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:06:57.184642 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66045e1b-ba45-4ea1-9a2d-9a238a291a0c service neutron] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:57.188170 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-555b9822-8331-43ce-92dd-6e9dd29d5761 admin admin] The token cache is being invalidate because project 7986e882863f435bbdfb8228ab319694 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87019) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:06:57.188480 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-555b9822-8331-43ce-92dd-6e9dd29d5761 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:57.189195 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-555b9822-8331-43ce-92dd-6e9dd29d5761 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:57.189993 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:06:57.190741 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1397/2773] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 14 18:06:56 2022] DELETE /identity/v3/projects/7986e882863f435bbdfb8228ab319694 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 18:06:57.195216 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555b9822-8331-43ce-92dd-6e9dd29d5761 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:57.196651 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-555b9822-8331-43ce-92dd-6e9dd29d5761 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:57.264416 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1837aed-4502-4d5f-be76-c62e40a14d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:57.265309 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1837aed-4502-4d5f-be76-c62e40a14d1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:57.265593 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1837aed-4502-4d5f-be76-c62e40a14d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:57.265871 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1837aed-4502-4d5f-be76-c62e40a14d1c admin admin] PATH_INFO: `/v3/users/bf256adddbb945be8ee9b13eca683ece` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:57.267182 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1837aed-4502-4d5f-be76-c62e40a14d1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf256adddbb945be8ee9b13eca683ece)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:57.269218 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1837aed-4502-4d5f-be76-c62e40a14d1c admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:57.271374 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555b9822-8331-43ce-92dd-6e9dd29d5761 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:57.276784 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca86d888-e6d5-4e38-a6f3-cc6cf0767e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:57.278050 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca86d888-e6d5-4e38-a6f3-cc6cf0767e39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:57.278412 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca86d888-e6d5-4e38-a6f3-cc6cf0767e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:57.278796 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca86d888-e6d5-4e38-a6f3-cc6cf0767e39 admin admin] PATH_INFO: `/v3/users/02ef595ea9c447cdbdec6014fbc1b3a7` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:57.280169 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca86d888-e6d5-4e38-a6f3-cc6cf0767e39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02ef595ea9c447cdbdec6014fbc1b3a7)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:57.282285 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca86d888-e6d5-4e38-a6f3-cc6cf0767e39 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:57.551093 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-e1837aed-4502-4d5f-be76-c62e40a14d1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf256adddbb945be8ee9b13eca683ece'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:57.551803 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-e1837aed-4502-4d5f-be76-c62e40a14d1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf256adddbb945be8ee9b13eca683ece'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:57.552410 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-e1837aed-4502-4d5f-be76-c62e40a14d1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf256adddbb945be8ee9b13eca683ece'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:57.591982 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-ca86d888-e6d5-4e38-a6f3-cc6cf0767e39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02ef595ea9c447cdbdec6014fbc1b3a7'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:57.592730 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-ca86d888-e6d5-4e38-a6f3-cc6cf0767e39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02ef595ea9c447cdbdec6014fbc1b3a7'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:57.593368 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-ca86d888-e6d5-4e38-a6f3-cc6cf0767e39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02ef595ea9c447cdbdec6014fbc1b3a7'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:57.726294 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-e1837aed-4502-4d5f-be76-c62e40a14d1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf256adddbb945be8ee9b13eca683ece'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:57.734813 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-e1837aed-4502-4d5f-be76-c62e40a14d1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf256adddbb945be8ee9b13eca683ece'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:57.753562 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1377/2774] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 14 18:06:57 2022] DELETE /identity/v3/users/bf256adddbb945be8ee9b13eca683ece => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 18:06:57.761069 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7223f6-4825-453a-b805-c636db2179de None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:57.761069 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7223f6-4825-453a-b805-c636db2179de None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:57.761069 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7223f6-4825-453a-b805-c636db2179de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:57.777239 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-fc7223f6-4825-453a-b805-c636db2179de None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:06:57.778719 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-fc7223f6-4825-453a-b805-c636db2179de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:57.821832 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-ca86d888-e6d5-4e38-a6f3-cc6cf0767e39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02ef595ea9c447cdbdec6014fbc1b3a7'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:57.829834 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-ca86d888-e6d5-4e38-a6f3-cc6cf0767e39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02ef595ea9c447cdbdec6014fbc1b3a7'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:57.842427 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1378/2775] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:06:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 18:06:57.855034 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7223f6-4825-453a-b805-c636db2179de None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:57.857262 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-fc7223f6-4825-453a-b805-c636db2179de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:57.859686 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1398/2776] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 14 18:06:57 2022] DELETE /identity/v3/users/02ef595ea9c447cdbdec6014fbc1b3a7 => generated 0 bytes in 665 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 18:06:57.908980 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:06:57.945734 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7223f6-4825-453a-b805-c636db2179de None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:58.003615 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce584e2-7033-4b09-a866-53d3af34ca6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5652329c71cd431fb579d69cef933b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:58.004280 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce584e2-7033-4b09-a866-53d3af34ca6e service neutron] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:58.004564 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce584e2-7033-4b09-a866-53d3af34ca6e service neutron] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:58.004883 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce584e2-7033-4b09-a866-53d3af34ca6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:58.071280 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce584e2-7033-4b09-a866-53d3af34ca6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:58.073527 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce584e2-7033-4b09-a866-53d3af34ca6e service neutron] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:58.084684 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1379/2777] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 18:06:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:06:58.484335 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca86d888-e6d5-4e38-a6f3-cc6cf0767e39 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:58.489050 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-ca86d888-e6d5-4e38-a6f3-cc6cf0767e39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:58.514533 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca86d888-e6d5-4e38-a6f3-cc6cf0767e39 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:58.520696 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede7d745-237c-4a3a-ad28-aa7a1a02d5c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:58.521595 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede7d745-237c-4a3a-ad28-aa7a1a02d5c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:58.521880 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede7d745-237c-4a3a-ad28-aa7a1a02d5c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:58.522195 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede7d745-237c-4a3a-ad28-aa7a1a02d5c6 admin admin] PATH_INFO: `/v3/projects/a57abf3392094d85a5c4a06fc99c414a` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:58.523521 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede7d745-237c-4a3a-ad28-aa7a1a02d5c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a57abf3392094d85a5c4a06fc99c414a)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:58.531130 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede7d745-237c-4a3a-ad28-aa7a1a02d5c6 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:58.659668 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-ede7d745-237c-4a3a-ad28-aa7a1a02d5c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a57abf3392094d85a5c4a06fc99c414a', 'request_id': 'req-ede7d745-237c-4a3a-ad28-aa7a1a02d5c6'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:58.690344 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce584e2-7033-4b09-a866-53d3af34ca6e service neutron] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:58.690344 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-0ce584e2-7033-4b09-a866-53d3af34ca6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:58.707539 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce584e2-7033-4b09-a866-53d3af34ca6e service neutron] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:58.743542 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-ede7d745-237c-4a3a-ad28-aa7a1a02d5c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a57abf3392094d85a5c4a06fc99c414a', 'request_id': 'req-ede7d745-237c-4a3a-ad28-aa7a1a02d5c6'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:58.753435 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-ede7d745-237c-4a3a-ad28-aa7a1a02d5c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a57abf3392094d85a5c4a06fc99c414a', 'request_id': 'req-ede7d745-237c-4a3a-ad28-aa7a1a02d5c6'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:58.759248 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:06:58.767324 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-ede7d745-237c-4a3a-ad28-aa7a1a02d5c6 admin admin] The token cache is being invalidate because project a57abf3392094d85a5c4a06fc99c414a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87019) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:06:58.767657 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-ede7d745-237c-4a3a-ad28-aa7a1a02d5c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:58.768623 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-ede7d745-237c-4a3a-ad28-aa7a1a02d5c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:58.770410 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1399/2778] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 14 18:06:58 2022] DELETE /identity/v3/projects/a57abf3392094d85a5c4a06fc99c414a => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:06:58.777305 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e11686-ffa1-4003-99eb-263a78a9de2b None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:58.777877 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e11686-ffa1-4003-99eb-263a78a9de2b None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:58.778230 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e11686-ffa1-4003-99eb-263a78a9de2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:58.781578 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e241047e-9112-4814-961f-a89bb1349ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:58.782467 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e241047e-9112-4814-961f-a89bb1349ff1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:58.782846 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e241047e-9112-4814-961f-a89bb1349ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:58.783620 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e241047e-9112-4814-961f-a89bb1349ff1 admin admin] PATH_INFO: `/v3/projects/70351c3c360741b0b28dbaa5156b4d02` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:58.784578 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e241047e-9112-4814-961f-a89bb1349ff1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70351c3c360741b0b28dbaa5156b4d02)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:58.787761 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e241047e-9112-4814-961f-a89bb1349ff1 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:58.804266 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-69e11686-ffa1-4003-99eb-263a78a9de2b None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:06:58.805618 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-69e11686-ffa1-4003-99eb-263a78a9de2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:58.816449 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1400/2779] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:06:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 18:06:58.825242 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad991ff2-ceb2-4377-8562-bf8bcdd0bc0f None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:58.825242 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad991ff2-ceb2-4377-8562-bf8bcdd0bc0f None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:58.825735 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad991ff2-ceb2-4377-8562-bf8bcdd0bc0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:58.846831 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-ad991ff2-ceb2-4377-8562-bf8bcdd0bc0f None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:06:58.848559 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-ad991ff2-ceb2-4377-8562-bf8bcdd0bc0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:58.867622 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1401/2780] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:06:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 18:06:58.873099 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad991ff2-ceb2-4377-8562-bf8bcdd0bc0f None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:58.890377 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad991ff2-ceb2-4377-8562-bf8bcdd0bc0f None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:58.896254 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a046293-fbfd-452f-8238-1a27fe6d3f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:58.896905 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a046293-fbfd-452f-8238-1a27fe6d3f79 admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:58.897194 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a046293-fbfd-452f-8238-1a27fe6d3f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:58.897476 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a046293-fbfd-452f-8238-1a27fe6d3f79 admin admin] PATH_INFO: `/v3/domains` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:58.898212 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a046293-fbfd-452f-8238-1a27fe6d3f79 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 18:06:58.898539 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a046293-fbfd-452f-8238-1a27fe6d3f79 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:58.900665 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a046293-fbfd-452f-8238-1a27fe6d3f79 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:58.914234 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1402/2781] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 14 18:06:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 18:06:58.919870 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a046293-fbfd-452f-8238-1a27fe6d3f79 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:58.930552 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a046293-fbfd-452f-8238-1a27fe6d3f79 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:58.937990 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:06:58.946747 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-e241047e-9112-4814-961f-a89bb1349ff1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70351c3c360741b0b28dbaa5156b4d02', 'request_id': 'req-e241047e-9112-4814-961f-a89bb1349ff1'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:58.992135 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1656ea-b1d1-42d2-92bc-9760a81dbd5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:58.992811 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1656ea-b1d1-42d2-92bc-9760a81dbd5a admin admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:58.993101 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1656ea-b1d1-42d2-92bc-9760a81dbd5a admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:58.993385 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1656ea-b1d1-42d2-92bc-9760a81dbd5a admin admin] PATH_INFO: `/v3/projects` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:58.994634 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1656ea-b1d1-42d2-92bc-9760a81dbd5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:58.996610 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1656ea-b1d1-42d2-92bc-9760a81dbd5a admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:59.033470 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-e241047e-9112-4814-961f-a89bb1349ff1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70351c3c360741b0b28dbaa5156b4d02', 'request_id': 'req-e241047e-9112-4814-961f-a89bb1349ff1'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:59.040418 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-e241047e-9112-4814-961f-a89bb1349ff1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70351c3c360741b0b28dbaa5156b4d02', 'request_id': 'req-e241047e-9112-4814-961f-a89bb1349ff1'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:59.053880 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-e241047e-9112-4814-961f-a89bb1349ff1 admin admin] The token cache is being invalidate because project 70351c3c360741b0b28dbaa5156b4d02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:06:59.054176 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-e241047e-9112-4814-961f-a89bb1349ff1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:59.054843 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-e241047e-9112-4814-961f-a89bb1349ff1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:59.056640 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1380/2782] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 14 18:06:58 2022] DELETE /identity/v3/projects/70351c3c360741b0b28dbaa5156b4d02 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 18:06:59.061660 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56c189f-86ea-4a77-9ab7-5b075293e6d1 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:59.061861 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56c189f-86ea-4a77-9ab7-5b075293e6d1 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:59.062146 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56c189f-86ea-4a77-9ab7-5b075293e6d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:59.080618 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-d56c189f-86ea-4a77-9ab7-5b075293e6d1 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:06:59.081850 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-d56c189f-86ea-4a77-9ab7-5b075293e6d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:59.090647 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1381/2783] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:06:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 18:06:59.098726 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5ef33b-88ce-4284-8177-055ca8882eaa None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:59.099022 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5ef33b-88ce-4284-8177-055ca8882eaa None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:59.099418 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5ef33b-88ce-4284-8177-055ca8882eaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:59.119735 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-0c5ef33b-88ce-4284-8177-055ca8882eaa None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:06:59.121050 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-0c5ef33b-88ce-4284-8177-055ca8882eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:59.129388 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1382/2784] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:06:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 18:06:59.136885 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1403/2785] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 14 18:06:58 2022] POST /identity/v3/projects => generated 375 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 18:06:59.137108 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5ef33b-88ce-4284-8177-055ca8882eaa None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:59.137945 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1656ea-b1d1-42d2-92bc-9760a81dbd5a admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:59.139776 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-8d1656ea-b1d1-42d2-92bc-9760a81dbd5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:59.144827 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5ef33b-88ce-4284-8177-055ca8882eaa None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:59.215279 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b10825d-beff-40d7-8530-e8addcc7d5b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:59.216334 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b10825d-beff-40d7-8530-e8addcc7d5b9 admin admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:59.216618 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b10825d-beff-40d7-8530-e8addcc7d5b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:59.216846 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b10825d-beff-40d7-8530-e8addcc7d5b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:59.217574 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b10825d-beff-40d7-8530-e8addcc7d5b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 18:06:59.217886 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b10825d-beff-40d7-8530-e8addcc7d5b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:59.219534 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b10825d-beff-40d7-8530-e8addcc7d5b9 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:59.226633 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1656ea-b1d1-42d2-92bc-9760a81dbd5a admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:59.226633 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb85ccc-128d-48a0-ba9d-dc66f8a7c06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:59.226633 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb85ccc-128d-48a0-ba9d-dc66f8a7c06f admin admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:59.226633 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb85ccc-128d-48a0-ba9d-dc66f8a7c06f admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:59.227138 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb85ccc-128d-48a0-ba9d-dc66f8a7c06f admin admin] PATH_INFO: `/v3/users` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:59.227138 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb85ccc-128d-48a0-ba9d-dc66f8a7c06f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:59.229635 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb85ccc-128d-48a0-ba9d-dc66f8a7c06f admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:59.234555 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1383/2786] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 14 18:06:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 18:06:59.240773 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b10825d-beff-40d7-8530-e8addcc7d5b9 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:59.252197 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b10825d-beff-40d7-8530-e8addcc7d5b9 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:59.257047 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb3364d-6c1f-4bf2-8b67-01c871da0976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:59.257710 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb3364d-6c1f-4bf2-8b67-01c871da0976 admin admin] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:59.258728 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb3364d-6c1f-4bf2-8b67-01c871da0976 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:59.259006 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb3364d-6c1f-4bf2-8b67-01c871da0976 admin admin] PATH_INFO: `/v3/projects` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:59.259878 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb3364d-6c1f-4bf2-8b67-01c871da0976 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:59.262346 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb3364d-6c1f-4bf2-8b67-01c871da0976 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:59.315642 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1404/2787] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 14 18:06:59 2022] POST /identity/v3/users => generated 288 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 18:06:59.319779 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb85ccc-128d-48a0-ba9d-dc66f8a7c06f admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:59.330478 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb85ccc-128d-48a0-ba9d-dc66f8a7c06f admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:59.335553 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7144718-1e21-409c-8967-537350e48848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:59.336257 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7144718-1e21-409c-8967-537350e48848 admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:59.336547 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7144718-1e21-409c-8967-537350e48848 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:59.336833 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7144718-1e21-409c-8967-537350e48848 admin admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:59.337570 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7144718-1e21-409c-8967-537350e48848 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:59.339809 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7144718-1e21-409c-8967-537350e48848 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:59.354361 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1384/2788] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 14 18:06:59 2022] POST /identity/v3/projects => generated 371 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 18:06:59.354666 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1405/2789] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 18:06:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:06:59.356534 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7144718-1e21-409c-8967-537350e48848 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:59.356955 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb3364d-6c1f-4bf2-8b67-01c871da0976 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:59.367735 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7144718-1e21-409c-8967-537350e48848 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:59.433599 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9c2b1b-1d80-4b72-b1ef-56fc4cbd6393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:59.434582 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9c2b1b-1d80-4b72-b1ef-56fc4cbd6393 admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:59.434871 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9c2b1b-1d80-4b72-b1ef-56fc4cbd6393 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:59.435153 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9c2b1b-1d80-4b72-b1ef-56fc4cbd6393 admin admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:59.436087 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9c2b1b-1d80-4b72-b1ef-56fc4cbd6393 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:59.437896 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9c2b1b-1d80-4b72-b1ef-56fc4cbd6393 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:59.438115 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb3364d-6c1f-4bf2-8b67-01c871da0976 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:59.442952 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbc0875-3d88-4cfb-8868-735ca847c15a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:59.443732 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc0875-3d88-4cfb-8868-735ca847c15a admin admin] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:59.444046 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc0875-3d88-4cfb-8868-735ca847c15a admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:59.444325 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc0875-3d88-4cfb-8868-735ca847c15a admin admin] PATH_INFO: `/v3/users` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:59.445042 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbc0875-3d88-4cfb-8868-735ca847c15a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:59.446968 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbc0875-3d88-4cfb-8868-735ca847c15a admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:59.450241 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1406/2790] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 18:06:59 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:06:59.454561 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9c2b1b-1d80-4b72-b1ef-56fc4cbd6393 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:59.466170 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9c2b1b-1d80-4b72-b1ef-56fc4cbd6393 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:59.471076 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698f3e6d-6cb1-4e8a-a606-41c4cc962023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:59.472059 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698f3e6d-6cb1-4e8a-a606-41c4cc962023 admin admin] REQUEST_METHOD: `PUT` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:59.472356 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698f3e6d-6cb1-4e8a-a606-41c4cc962023 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:59.472642 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698f3e6d-6cb1-4e8a-a606-41c4cc962023 admin admin] PATH_INFO: `/v3/projects/65b207054aa74f3494d77b4b406173fc/users/8061b98bd3c94fa19ec36b4f93e444b6/roles/9ee80134743f4c2b88525b04df2facba` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:59.489306 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698f3e6d-6cb1-4e8a-a606-41c4cc962023 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65b207054aa74f3494d77b4b406173fc, user_id=8061b98bd3c94fa19ec36b4f93e444b6, role_id=9ee80134743f4c2b88525b04df2facba)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:59.492077 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698f3e6d-6cb1-4e8a-a606-41c4cc962023 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:59.583479 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1407/2791] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 18:06:59 2022] PUT /identity/v3/projects/65b207054aa74f3494d77b4b406173fc/users/8061b98bd3c94fa19ec36b4f93e444b6/roles/9ee80134743f4c2b88525b04df2facba => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 18:06:59.583856 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1385/2792] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 14 18:06:59 2022] POST /identity/v3/users => generated 286 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:06:59.589886 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698f3e6d-6cb1-4e8a-a606-41c4cc962023 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:59.596864 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b40e192-fb34-4d9a-87ae-0d6ce3708ac1 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:59.597161 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b40e192-fb34-4d9a-87ae-0d6ce3708ac1 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:59.597446 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b40e192-fb34-4d9a-87ae-0d6ce3708ac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:59.628371 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-0b40e192-fb34-4d9a-87ae-0d6ce3708ac1 None None] MFA Rules not processed for user `8061b98bd3c94fa19ec36b4f93e444b6`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:06:59.629658 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-0b40e192-fb34-4d9a-87ae-0d6ce3708ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:59.662655 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698f3e6d-6cb1-4e8a-a606-41c4cc962023 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:59.669665 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1753872-2ac3-44eb-8985-36a3b49efb6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:59.670891 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1753872-2ac3-44eb-8985-36a3b49efb6e admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:59.670891 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1753872-2ac3-44eb-8985-36a3b49efb6e admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:59.671101 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:06:59.671215 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1753872-2ac3-44eb-8985-36a3b49efb6e admin admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:59.671708 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1753872-2ac3-44eb-8985-36a3b49efb6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:59.673609 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1753872-2ac3-44eb-8985-36a3b49efb6e admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:59.686647 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1408/2793] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 18:06:59 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:06:59.691006 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1753872-2ac3-44eb-8985-36a3b49efb6e admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:59.702033 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1753872-2ac3-44eb-8985-36a3b49efb6e admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:59.704715 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:DELETE=1,keystone:SELECT=95,keystone:INSERT=4 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:06:59.709931 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365f5a9f-e877-4287-af5b-6beee5c17757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:59.710619 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365f5a9f-e877-4287-af5b-6beee5c17757 admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:59.710904 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365f5a9f-e877-4287-af5b-6beee5c17757 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:59.712897 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365f5a9f-e877-4287-af5b-6beee5c17757 admin admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:59.713087 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1386/2794] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:06:59 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 18:06:59.713765 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365f5a9f-e877-4287-af5b-6beee5c17757 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:59.714257 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365f5a9f-e877-4287-af5b-6beee5c17757 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:59.723832 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b40e192-fb34-4d9a-87ae-0d6ce3708ac1 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:59.725448 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-0b40e192-fb34-4d9a-87ae-0d6ce3708ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:59.728828 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1409/2795] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 18:06:59 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 14 18:06:59.733414 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365f5a9f-e877-4287-af5b-6beee5c17757 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:59.746422 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365f5a9f-e877-4287-af5b-6beee5c17757 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:59.751749 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a99e347-03d6-44ed-87cb-e816cdaa9c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:59.752688 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a99e347-03d6-44ed-87cb-e816cdaa9c54 admin admin] REQUEST_METHOD: `PUT` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:59.752973 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a99e347-03d6-44ed-87cb-e816cdaa9c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:59.753256 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a99e347-03d6-44ed-87cb-e816cdaa9c54 admin admin] PATH_INFO: `/v3/projects/bab9329cb961497f9923d611541a4d17/users/ad2bc23473c147e4b7ae8dcef1ae58ca/roles/9ee80134743f4c2b88525b04df2facba` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:59.770126 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a99e347-03d6-44ed-87cb-e816cdaa9c54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bab9329cb961497f9923d611541a4d17, user_id=ad2bc23473c147e4b7ae8dcef1ae58ca, role_id=9ee80134743f4c2b88525b04df2facba)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:59.772850 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a99e347-03d6-44ed-87cb-e816cdaa9c54 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:59.793587 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b40e192-fb34-4d9a-87ae-0d6ce3708ac1 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:59.797301 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d912246-2984-4f6d-91fa-1f5daadb1319 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17945e7d72954b8787e0ba09a9903247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:59.797961 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d912246-2984-4f6d-91fa-1f5daadb1319 service cinder] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:59.798250 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d912246-2984-4f6d-91fa-1f5daadb1319 service cinder] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:59.798538 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d912246-2984-4f6d-91fa-1f5daadb1319 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:59.808519 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d912246-2984-4f6d-91fa-1f5daadb1319 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:59.809970 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d912246-2984-4f6d-91fa-1f5daadb1319 service cinder] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:59.819669 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1387/2796] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 18:06:59 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 18:06:59.867215 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1410/2797] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 18:06:59 2022] PUT /identity/v3/projects/bab9329cb961497f9923d611541a4d17/users/ad2bc23473c147e4b7ae8dcef1ae58ca/roles/9ee80134743f4c2b88525b04df2facba => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 18:06:59.878899 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec577ba-2de7-40d2-9637-a521a1721676 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:59.879024 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec577ba-2de7-40d2-9637-a521a1721676 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:59.879462 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec577ba-2de7-40d2-9637-a521a1721676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:59.913148 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-0ec577ba-2de7-40d2-9637-a521a1721676 None None] MFA Rules not processed for user `ad2bc23473c147e4b7ae8dcef1ae58ca`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:06:59.914680 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-0ec577ba-2de7-40d2-9637-a521a1721676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:59.968025 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a99e347-03d6-44ed-87cb-e816cdaa9c54 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:59.969829 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-8a99e347-03d6-44ed-87cb-e816cdaa9c54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:07:00.000896 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1388/2798] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:06:59 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:07:00.012132 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec577ba-2de7-40d2-9637-a521a1721676 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:07:00.017619 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-0ec577ba-2de7-40d2-9637-a521a1721676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:07:00.044121 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a99e347-03d6-44ed-87cb-e816cdaa9c54 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:07:00.050380 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca27c047-435f-4b0b-9238-7641400d9fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:07:00.052057 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca27c047-435f-4b0b-9238-7641400d9fb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:07:00.052057 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca27c047-435f-4b0b-9238-7641400d9fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:07:00.052057 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca27c047-435f-4b0b-9238-7641400d9fb6 admin admin] PATH_INFO: `/v3/users/913f7f379d9849fc99b1e3054ec7c4b1` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:07:00.053313 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca27c047-435f-4b0b-9238-7641400d9fb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=913f7f379d9849fc99b1e3054ec7c4b1)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:07:00.055373 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca27c047-435f-4b0b-9238-7641400d9fb6 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:07:00.061391 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:07:00.085821 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec577ba-2de7-40d2-9637-a521a1721676 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:07:00.090932 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0e2d6a-d7d2-44ca-b0ca-95fa7b1ff8d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17945e7d72954b8787e0ba09a9903247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:07:00.091768 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0e2d6a-d7d2-44ca-b0ca-95fa7b1ff8d2 service cinder] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:07:00.092128 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0e2d6a-d7d2-44ca-b0ca-95fa7b1ff8d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:07:00.092473 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0e2d6a-d7d2-44ca-b0ca-95fa7b1ff8d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:07:00.104258 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0e2d6a-d7d2-44ca-b0ca-95fa7b1ff8d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:07:00.106096 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0e2d6a-d7d2-44ca-b0ca-95fa7b1ff8d2 service cinder] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:07:00.119640 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1389/2799] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 18:07:00 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 18:07:00.190954 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:07:00.236310 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-ca27c047-435f-4b0b-9238-7641400d9fb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '913f7f379d9849fc99b1e3054ec7c4b1'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:07:00.237174 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-ca27c047-435f-4b0b-9238-7641400d9fb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '913f7f379d9849fc99b1e3054ec7c4b1'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:07:00.239021 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-ca27c047-435f-4b0b-9238-7641400d9fb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '913f7f379d9849fc99b1e3054ec7c4b1'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:07:00.343101 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-ca27c047-435f-4b0b-9238-7641400d9fb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '913f7f379d9849fc99b1e3054ec7c4b1'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:07:00.351160 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-ca27c047-435f-4b0b-9238-7641400d9fb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '913f7f379d9849fc99b1e3054ec7c4b1'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:07:00.370250 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1411/2800] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 14 18:06:59 2022] DELETE /identity/v3/users/913f7f379d9849fc99b1e3054ec7c4b1 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 18:07:00.375649 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d359ec-bb02-4f70-9547-c768bf120563 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:07:00.376066 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d359ec-bb02-4f70-9547-c768bf120563 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:07:00.376253 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d359ec-bb02-4f70-9547-c768bf120563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:07:00.394895 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-85d359ec-bb02-4f70-9547-c768bf120563 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:07:00.396186 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-85d359ec-bb02-4f70-9547-c768bf120563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:07:00.474366 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1390/2801] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:07:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:07:00.485709 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca27c047-435f-4b0b-9238-7641400d9fb6 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:07:00.488070 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-ca27c047-435f-4b0b-9238-7641400d9fb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:07:00.577898 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca27c047-435f-4b0b-9238-7641400d9fb6 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:07:00.593692 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d05076-2813-4da7-91ef-c291abebfc06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5652329c71cd431fb579d69cef933b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:07:00.594430 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d05076-2813-4da7-91ef-c291abebfc06 service neutron] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:07:00.594723 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d05076-2813-4da7-91ef-c291abebfc06 service neutron] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:07:00.595085 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d05076-2813-4da7-91ef-c291abebfc06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:07:00.612806 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d05076-2813-4da7-91ef-c291abebfc06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:07:00.612806 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d05076-2813-4da7-91ef-c291abebfc06 service neutron] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:07:00.620641 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1412/2802] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 18:07:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 18:07:01.179292 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d359ec-bb02-4f70-9547-c768bf120563 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:07:01.182223 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-85d359ec-bb02-4f70-9547-c768bf120563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:07:01.206415 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d359ec-bb02-4f70-9547-c768bf120563 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:07:01.220231 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2204fb4f-0c5c-4aa8-8002-564089d16c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:07:01.220231 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2204fb4f-0c5c-4aa8-8002-564089d16c2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:07:01.220231 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2204fb4f-0c5c-4aa8-8002-564089d16c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:07:01.220231 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2204fb4f-0c5c-4aa8-8002-564089d16c2b admin admin] PATH_INFO: `/v3/projects/affad12a6f0c4c8283d108560731de77` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:07:01.221699 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2204fb4f-0c5c-4aa8-8002-564089d16c2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=affad12a6f0c4c8283d108560731de77)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:07:01.225388 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2204fb4f-0c5c-4aa8-8002-564089d16c2b admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:07:01.374846 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-2204fb4f-0c5c-4aa8-8002-564089d16c2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'affad12a6f0c4c8283d108560731de77', 'request_id': 'req-2204fb4f-0c5c-4aa8-8002-564089d16c2b'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:07:01.446424 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-2204fb4f-0c5c-4aa8-8002-564089d16c2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'affad12a6f0c4c8283d108560731de77', 'request_id': 'req-2204fb4f-0c5c-4aa8-8002-564089d16c2b'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:07:01.455470 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-2204fb4f-0c5c-4aa8-8002-564089d16c2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'affad12a6f0c4c8283d108560731de77', 'request_id': 'req-2204fb4f-0c5c-4aa8-8002-564089d16c2b'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:07:01.468920 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-2204fb4f-0c5c-4aa8-8002-564089d16c2b admin admin] The token cache is being invalidate because project affad12a6f0c4c8283d108560731de77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:07:01.469230 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-2204fb4f-0c5c-4aa8-8002-564089d16c2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:07:01.469921 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-2204fb4f-0c5c-4aa8-8002-564089d16c2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:07:01.471579 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1391/2803] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 14 18:07:01 2022] DELETE /identity/v3/projects/affad12a6f0c4c8283d108560731de77 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:07:01.476732 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d05076-2813-4da7-91ef-c291abebfc06 service neutron] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:07:01.487972 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d05076-2813-4da7-91ef-c291abebfc06 service neutron] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:07:01.549705 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8141bc3b-27fa-4e85-b259-acad6f594862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:07:01.550583 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8141bc3b-27fa-4e85-b259-acad6f594862 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:07:01.550866 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8141bc3b-27fa-4e85-b259-acad6f594862 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:07:01.551144 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8141bc3b-27fa-4e85-b259-acad6f594862 admin admin] PATH_INFO: `/v3/users/8c8c2e4efb484366b992a794cef081ba` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:07:01.552367 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8141bc3b-27fa-4e85-b259-acad6f594862 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c8c2e4efb484366b992a794cef081ba)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:07:01.554337 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8141bc3b-27fa-4e85-b259-acad6f594862 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:07:01.680677 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:07:01.824617 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-8141bc3b-27fa-4e85-b259-acad6f594862 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c8c2e4efb484366b992a794cef081ba'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:07:01.825309 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-8141bc3b-27fa-4e85-b259-acad6f594862 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c8c2e4efb484366b992a794cef081ba'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:07:01.825928 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-8141bc3b-27fa-4e85-b259-acad6f594862 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c8c2e4efb484366b992a794cef081ba'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:07:01.908829 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-8141bc3b-27fa-4e85-b259-acad6f594862 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c8c2e4efb484366b992a794cef081ba'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:07:01.922599 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-8141bc3b-27fa-4e85-b259-acad6f594862 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c8c2e4efb484366b992a794cef081ba'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:07:01.947520 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1413/2804] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 14 18:07:01 2022] DELETE /identity/v3/users/8c8c2e4efb484366b992a794cef081ba => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:07:02.163953 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7482737f-9d4e-4bd9-9e74-5b02cdb2f391 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:07:02.164284 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7482737f-9d4e-4bd9-9e74-5b02cdb2f391 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:07:02.164611 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7482737f-9d4e-4bd9-9e74-5b02cdb2f391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:07:02.196084 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-7482737f-9d4e-4bd9-9e74-5b02cdb2f391 None None] MFA Rules not processed for user `ad2bc23473c147e4b7ae8dcef1ae58ca`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:07:02.197787 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-7482737f-9d4e-4bd9-9e74-5b02cdb2f391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:07:02.280665 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1392/2805] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:07:02 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:07:02.494449 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8141bc3b-27fa-4e85-b259-acad6f594862 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:07:02.496189 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-8141bc3b-27fa-4e85-b259-acad6f594862 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:07:02.570269 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8141bc3b-27fa-4e85-b259-acad6f594862 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:07:02.577935 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4c6a0d-cca1-41e0-9be5-148aee3efe3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:07:02.578751 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c6a0d-cca1-41e0-9be5-148aee3efe3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:07:02.579011 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c6a0d-cca1-41e0-9be5-148aee3efe3b admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:07:02.579320 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c6a0d-cca1-41e0-9be5-148aee3efe3b admin admin] PATH_INFO: `/v3/projects/ecc7a9136d3c480287267725c3cff354` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:07:02.581022 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4c6a0d-cca1-41e0-9be5-148aee3efe3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecc7a9136d3c480287267725c3cff354)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:07:02.582961 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4c6a0d-cca1-41e0-9be5-148aee3efe3b admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:07:02.753821 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-bd4c6a0d-cca1-41e0-9be5-148aee3efe3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecc7a9136d3c480287267725c3cff354', 'request_id': 'req-bd4c6a0d-cca1-41e0-9be5-148aee3efe3b'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:07:02.873508 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-bd4c6a0d-cca1-41e0-9be5-148aee3efe3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecc7a9136d3c480287267725c3cff354', 'request_id': 'req-bd4c6a0d-cca1-41e0-9be5-148aee3efe3b'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:07:02.881274 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-bd4c6a0d-cca1-41e0-9be5-148aee3efe3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecc7a9136d3c480287267725c3cff354', 'request_id': 'req-bd4c6a0d-cca1-41e0-9be5-148aee3efe3b'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:07:02.900618 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-bd4c6a0d-cca1-41e0-9be5-148aee3efe3b admin admin] The token cache is being invalidate because project ecc7a9136d3c480287267725c3cff354 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87019) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:07:02.901261 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-bd4c6a0d-cca1-41e0-9be5-148aee3efe3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:07:02.902228 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-bd4c6a0d-cca1-41e0-9be5-148aee3efe3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:07:02.907313 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1414/2806] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 14 18:07:02 2022] DELETE /identity/v3/projects/ecc7a9136d3c480287267725c3cff354 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:07:02.909777 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7482737f-9d4e-4bd9-9e74-5b02cdb2f391 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:07:02.920407 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7482737f-9d4e-4bd9-9e74-5b02cdb2f391 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:07:02.924266 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:07:03.008122 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28faef64-0a8f-4025-90e0-6dba801821f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:07:03.009025 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28faef64-0a8f-4025-90e0-6dba801821f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:07:03.009314 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28faef64-0a8f-4025-90e0-6dba801821f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:07:03.010251 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28faef64-0a8f-4025-90e0-6dba801821f0 admin admin] PATH_INFO: `/v3/users/448a3e9e9a7b4f5a9f045f9f185a9865` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:07:03.011593 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28faef64-0a8f-4025-90e0-6dba801821f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=448a3e9e9a7b4f5a9f045f9f185a9865)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:07:03.013553 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28faef64-0a8f-4025-90e0-6dba801821f0 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:07:03.248841 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-28faef64-0a8f-4025-90e0-6dba801821f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '448a3e9e9a7b4f5a9f045f9f185a9865'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:07:03.249696 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-28faef64-0a8f-4025-90e0-6dba801821f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '448a3e9e9a7b4f5a9f045f9f185a9865'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:07:03.250628 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-28faef64-0a8f-4025-90e0-6dba801821f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '448a3e9e9a7b4f5a9f045f9f185a9865'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:07:03.384909 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-28faef64-0a8f-4025-90e0-6dba801821f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '448a3e9e9a7b4f5a9f045f9f185a9865'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:07:03.397880 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-28faef64-0a8f-4025-90e0-6dba801821f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '448a3e9e9a7b4f5a9f045f9f185a9865'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:07:03.423738 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1393/2807] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 14 18:07:02 2022] DELETE /identity/v3/users/448a3e9e9a7b4f5a9f045f9f185a9865 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:07:04.310968 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4c6a0d-cca1-41e0-9be5-148aee3efe3b admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:07:04.312692 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-bd4c6a0d-cca1-41e0-9be5-148aee3efe3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:07:04.334761 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4c6a0d-cca1-41e0-9be5-148aee3efe3b admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:07:04.405291 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:07:04.444090 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e712406-c194-4a63-b7be-66d1010be6b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:07:04.445709 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e712406-c194-4a63-b7be-66d1010be6b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:07:04.446227 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e712406-c194-4a63-b7be-66d1010be6b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:07:04.446744 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e712406-c194-4a63-b7be-66d1010be6b6 admin admin] PATH_INFO: `/v3/users/8061b98bd3c94fa19ec36b4f93e444b6` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:07:04.449000 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e712406-c194-4a63-b7be-66d1010be6b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8061b98bd3c94fa19ec36b4f93e444b6)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:07:04.455950 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e712406-c194-4a63-b7be-66d1010be6b6 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:07:04.591727 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28faef64-0a8f-4025-90e0-6dba801821f0 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:07:04.593747 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-28faef64-0a8f-4025-90e0-6dba801821f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:07:04.616218 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28faef64-0a8f-4025-90e0-6dba801821f0 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:07:04.621621 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dff41af-9a11-4990-951a-42e83973f1f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:07:04.622762 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dff41af-9a11-4990-951a-42e83973f1f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:07:04.623120 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dff41af-9a11-4990-951a-42e83973f1f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:07:04.623447 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dff41af-9a11-4990-951a-42e83973f1f9 admin admin] PATH_INFO: `/v3/projects/912e6bca0039446c8dbaad6dc521b62e` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:07:04.624736 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dff41af-9a11-4990-951a-42e83973f1f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=912e6bca0039446c8dbaad6dc521b62e)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:07:04.627198 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dff41af-9a11-4990-951a-42e83973f1f9 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:07:04.827107 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-6e712406-c194-4a63-b7be-66d1010be6b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8061b98bd3c94fa19ec36b4f93e444b6'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:07:04.833949 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-8dff41af-9a11-4990-951a-42e83973f1f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '912e6bca0039446c8dbaad6dc521b62e', 'request_id': 'req-8dff41af-9a11-4990-951a-42e83973f1f9'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:07:04.836348 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-6e712406-c194-4a63-b7be-66d1010be6b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8061b98bd3c94fa19ec36b4f93e444b6'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:07:04.837451 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-6e712406-c194-4a63-b7be-66d1010be6b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8061b98bd3c94fa19ec36b4f93e444b6'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:07:04.937679 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-8dff41af-9a11-4990-951a-42e83973f1f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '912e6bca0039446c8dbaad6dc521b62e', 'request_id': 'req-8dff41af-9a11-4990-951a-42e83973f1f9'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:07:04.944909 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-8dff41af-9a11-4990-951a-42e83973f1f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '912e6bca0039446c8dbaad6dc521b62e', 'request_id': 'req-8dff41af-9a11-4990-951a-42e83973f1f9'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:07:04.960254 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-8dff41af-9a11-4990-951a-42e83973f1f9 admin admin] The token cache is being invalidate because project 912e6bca0039446c8dbaad6dc521b62e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:07:04.960556 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-8dff41af-9a11-4990-951a-42e83973f1f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:07:04.961227 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-8dff41af-9a11-4990-951a-42e83973f1f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:07:04.964006 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1394/2808] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 14 18:07:04 2022] DELETE /identity/v3/projects/912e6bca0039446c8dbaad6dc521b62e => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:07:04.968569 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dff41af-9a11-4990-951a-42e83973f1f9 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:07:04.970024 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-8dff41af-9a11-4990-951a-42e83973f1f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:07:04.981759 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:07:05.035629 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-6e712406-c194-4a63-b7be-66d1010be6b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8061b98bd3c94fa19ec36b4f93e444b6'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:07:05.050870 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-6e712406-c194-4a63-b7be-66d1010be6b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8061b98bd3c94fa19ec36b4f93e444b6'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:07:05.064107 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dff41af-9a11-4990-951a-42e83973f1f9 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:07:05.070614 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dfeeac-53e7-47ff-b52a-edbffbbfc55a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a8049f9c66b4b5185c26084fd8239ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:07:05.071404 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dfeeac-53e7-47ff-b52a-edbffbbfc55a service placement] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:07:05.071770 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dfeeac-53e7-47ff-b52a-edbffbbfc55a service placement] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:07:05.072657 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dfeeac-53e7-47ff-b52a-edbffbbfc55a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:07:05.076034 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-50dfeeac-53e7-47ff-b52a-edbffbbfc55a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:07:05.081432 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1415/2809] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 14 18:07:04 2022] DELETE /identity/v3/users/8061b98bd3c94fa19ec36b4f93e444b6 => generated 0 bytes in 771 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 18:07:05.083553 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a533d6d-83a7-41f3-a1e3-dc3c2bc7a0c9 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:07:05.083982 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a533d6d-83a7-41f3-a1e3-dc3c2bc7a0c9 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:07:05.084489 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a533d6d-83a7-41f3-a1e3-dc3c2bc7a0c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:07:05.096821 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dfeeac-53e7-47ff-b52a-edbffbbfc55a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:07:05.098447 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dfeeac-53e7-47ff-b52a-edbffbbfc55a service placement] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:07:05.107151 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-5a533d6d-83a7-41f3-a1e3-dc3c2bc7a0c9 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:07:05.108911 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-5a533d6d-83a7-41f3-a1e3-dc3c2bc7a0c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:07:05.110481 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1395/2810] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 18:07:04 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:07:05.111919 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be500903-82ef-4fd9-9f37-c789b50cdeaa None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:07:05.112286 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be500903-82ef-4fd9-9f37-c789b50cdeaa None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:07:05.112701 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be500903-82ef-4fd9-9f37-c789b50cdeaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:07:05.142794 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-be500903-82ef-4fd9-9f37-c789b50cdeaa None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:07:05.145732 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-be500903-82ef-4fd9-9f37-c789b50cdeaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:07:05.218292 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1416/2811] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:07:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:07:05.226689 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28f8028-405b-46a0-b25c-f38914ed335c None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:07:05.226961 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28f8028-405b-46a0-b25c-f38914ed335c None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:07:05.227257 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28f8028-405b-46a0-b25c-f38914ed335c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:07:05.266343 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-d28f8028-405b-46a0-b25c-f38914ed335c None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:07:05.268456 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-d28f8028-405b-46a0-b25c-f38914ed335c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:07:05.269020 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1396/2812] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:07:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:07:05.284017 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be500903-82ef-4fd9-9f37-c789b50cdeaa None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:07:05.286212 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-be500903-82ef-4fd9-9f37-c789b50cdeaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:07:05.292196 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1417/2813] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:07:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:07:05.296804 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28f8028-405b-46a0-b25c-f38914ed335c None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:07:05.311116 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28f8028-405b-46a0-b25c-f38914ed335c None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:07:05.316384 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e797efaf-c17d-4a7b-a17c-e03a58b415b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:07:05.317117 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e797efaf-c17d-4a7b-a17c-e03a58b415b0 admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:07:05.317432 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e797efaf-c17d-4a7b-a17c-e03a58b415b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:07:05.317721 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e797efaf-c17d-4a7b-a17c-e03a58b415b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:07:05.318470 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e797efaf-c17d-4a7b-a17c-e03a58b415b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 18:07:05.318830 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e797efaf-c17d-4a7b-a17c-e03a58b415b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:07:05.320505 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e797efaf-c17d-4a7b-a17c-e03a58b415b0 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:07:05.334801 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1418/2814] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 14 18:07:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 18:07:05.340382 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e797efaf-c17d-4a7b-a17c-e03a58b415b0 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:07:05.357742 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e797efaf-c17d-4a7b-a17c-e03a58b415b0 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:07:05.363604 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99363c8-09ca-4230-b262-7e98b4352a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:07:05.364583 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99363c8-09ca-4230-b262-7e98b4352a8c admin admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:07:05.365183 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99363c8-09ca-4230-b262-7e98b4352a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:07:05.365630 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99363c8-09ca-4230-b262-7e98b4352a8c admin admin] PATH_INFO: `/v3/projects` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:07:05.366516 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99363c8-09ca-4230-b262-7e98b4352a8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:07:05.368536 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99363c8-09ca-4230-b262-7e98b4352a8c admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:07:05.401405 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be500903-82ef-4fd9-9f37-c789b50cdeaa None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:07:05.408241 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e214a8cd-9580-49c9-8f3b-30072a8d9007 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5652329c71cd431fb579d69cef933b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:07:05.408757 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e214a8cd-9580-49c9-8f3b-30072a8d9007 service neutron] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:07:05.409043 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e214a8cd-9580-49c9-8f3b-30072a8d9007 service neutron] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:07:05.409323 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e214a8cd-9580-49c9-8f3b-30072a8d9007 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:07:05.428441 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e214a8cd-9580-49c9-8f3b-30072a8d9007 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:07:05.431406 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e214a8cd-9580-49c9-8f3b-30072a8d9007 service neutron] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:07:05.449140 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1397/2815] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 18:07:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 18:07:05.520301 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1419/2816] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 14 18:07:05 2022] POST /identity/v3/projects => generated 389 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:07:05.526024 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e214a8cd-9580-49c9-8f3b-30072a8d9007 service neutron] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:07:05.548343 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e214a8cd-9580-49c9-8f3b-30072a8d9007 service neutron] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:07:05.633104 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:07:05.651903 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb2838c-d306-4a98-8c6d-8175e5ea96e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:07:05.652874 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb2838c-d306-4a98-8c6d-8175e5ea96e7 admin admin] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:07:05.653166 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb2838c-d306-4a98-8c6d-8175e5ea96e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:07:05.653407 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb2838c-d306-4a98-8c6d-8175e5ea96e7 admin admin] PATH_INFO: `/v3/users` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:07:05.654218 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb2838c-d306-4a98-8c6d-8175e5ea96e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:07:05.659354 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb2838c-d306-4a98-8c6d-8175e5ea96e7 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:07:05.761269 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1398/2817] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 14 18:07:05 2022] POST /identity/v3/users => generated 295 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:07:05.762696 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99363c8-09ca-4230-b262-7e98b4352a8c admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:07:05.777053 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99363c8-09ca-4230-b262-7e98b4352a8c admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:07:05.788074 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9735e76-d2bd-4619-a2ac-ef6bd35fe766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:07:05.788834 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9735e76-d2bd-4619-a2ac-ef6bd35fe766 admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:07:05.789162 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9735e76-d2bd-4619-a2ac-ef6bd35fe766 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:07:05.789449 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9735e76-d2bd-4619-a2ac-ef6bd35fe766 admin admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:07:05.790750 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9735e76-d2bd-4619-a2ac-ef6bd35fe766 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:07:05.794866 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9735e76-d2bd-4619-a2ac-ef6bd35fe766 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:07:05.826600 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1420/2818] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 18:07:05 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:07:05.832835 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb2838c-d306-4a98-8c6d-8175e5ea96e7 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:07:05.859120 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb2838c-d306-4a98-8c6d-8175e5ea96e7 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:07:05.874602 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0865bbe3-ca69-4e24-b433-9fb6cef6315f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:07:05.875811 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0865bbe3-ca69-4e24-b433-9fb6cef6315f admin admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:07:05.876382 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0865bbe3-ca69-4e24-b433-9fb6cef6315f admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:07:05.876974 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0865bbe3-ca69-4e24-b433-9fb6cef6315f admin admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:07:05.878378 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0865bbe3-ca69-4e24-b433-9fb6cef6315f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:07:05.881473 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0865bbe3-ca69-4e24-b433-9fb6cef6315f admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:07:05.914421 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1399/2819] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 18:07:05 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 14 18:07:05.921902 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9735e76-d2bd-4619-a2ac-ef6bd35fe766 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:07:05.940810 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:07:05.960280 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9735e76-d2bd-4619-a2ac-ef6bd35fe766 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:07:05.973773 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0772cd5f-3140-41e4-99b5-cd119a1b266e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:07:05.975703 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0772cd5f-3140-41e4-99b5-cd119a1b266e admin admin] REQUEST_METHOD: `PUT` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:07:05.977747 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0772cd5f-3140-41e4-99b5-cd119a1b266e admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:07:05.982865 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0772cd5f-3140-41e4-99b5-cd119a1b266e admin admin] PATH_INFO: `/v3/projects/77f06487f0c64a9c9bd58c5832bb3262/users/43856ec0ea2e44a6bd0af652f37a8e56/roles/9ee80134743f4c2b88525b04df2facba` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:07:06.016001 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0772cd5f-3140-41e4-99b5-cd119a1b266e admin admin] RBAC: Authorizing `identity:create_grant(project_id=77f06487f0c64a9c9bd58c5832bb3262, user_id=43856ec0ea2e44a6bd0af652f37a8e56, role_id=9ee80134743f4c2b88525b04df2facba)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:07:06.018760 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0772cd5f-3140-41e4-99b5-cd119a1b266e admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:07:06.135718 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0865bbe3-ca69-4e24-b433-9fb6cef6315f admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:07:06.138381 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-0865bbe3-ca69-4e24-b433-9fb6cef6315f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:07:06.142757 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1421/2820] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 18:07:05 2022] PUT /identity/v3/projects/77f06487f0c64a9c9bd58c5832bb3262/users/43856ec0ea2e44a6bd0af652f37a8e56/roles/9ee80134743f4c2b88525b04df2facba => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 18:07:06.160565 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93648792-ff3e-4d54-a75b-1b53818b1daa None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:07:06.165247 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93648792-ff3e-4d54-a75b-1b53818b1daa None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:07:06.165247 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93648792-ff3e-4d54-a75b-1b53818b1daa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:07:06.189166 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0865bbe3-ca69-4e24-b433-9fb6cef6315f admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:07:06.226028 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-93648792-ff3e-4d54-a75b-1b53818b1daa None None] MFA Rules not processed for user `43856ec0ea2e44a6bd0af652f37a8e56`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:07:06.227872 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-93648792-ff3e-4d54-a75b-1b53818b1daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:07:06.317591 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d682ce-3ee6-4636-95d7-bcbcaa023e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:07:06.319409 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d682ce-3ee6-4636-95d7-bcbcaa023e49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:07:06.320271 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d682ce-3ee6-4636-95d7-bcbcaa023e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:07:06.325172 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d682ce-3ee6-4636-95d7-bcbcaa023e49 admin admin] PATH_INFO: `/v3/projects/65b207054aa74f3494d77b4b406173fc` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:07:06.325172 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d682ce-3ee6-4636-95d7-bcbcaa023e49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65b207054aa74f3494d77b4b406173fc)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:07:06.327457 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d682ce-3ee6-4636-95d7-bcbcaa023e49 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:07:06.379000 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1422/2821] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:07:06 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:07:06.398880 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93648792-ff3e-4d54-a75b-1b53818b1daa None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:07:06.401390 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-93648792-ff3e-4d54-a75b-1b53818b1daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:07:06.499411 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93648792-ff3e-4d54-a75b-1b53818b1daa None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:07:06.505904 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329939b1-da92-4f88-aca9-fa3c2227cc74 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17945e7d72954b8787e0ba09a9903247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:07:06.529164 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329939b1-da92-4f88-aca9-fa3c2227cc74 service cinder] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:07:06.529164 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329939b1-da92-4f88-aca9-fa3c2227cc74 service cinder] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:07:06.529164 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329939b1-da92-4f88-aca9-fa3c2227cc74 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:07:06.529164 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329939b1-da92-4f88-aca9-fa3c2227cc74 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:07:06.529164 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329939b1-da92-4f88-aca9-fa3c2227cc74 service cinder] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:07:06.539290 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1423/2822] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 18:07:06 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:07:06.649466 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-11d682ce-3ee6-4636-95d7-bcbcaa023e49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65b207054aa74f3494d77b4b406173fc', 'request_id': 'req-11d682ce-3ee6-4636-95d7-bcbcaa023e49'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:07:06.749133 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-11d682ce-3ee6-4636-95d7-bcbcaa023e49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65b207054aa74f3494d77b4b406173fc', 'request_id': 'req-11d682ce-3ee6-4636-95d7-bcbcaa023e49'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:07:06.758296 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-11d682ce-3ee6-4636-95d7-bcbcaa023e49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65b207054aa74f3494d77b4b406173fc', 'request_id': 'req-11d682ce-3ee6-4636-95d7-bcbcaa023e49'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:07:06.783011 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-11d682ce-3ee6-4636-95d7-bcbcaa023e49 admin admin] The token cache is being invalidate because project 65b207054aa74f3494d77b4b406173fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:07:06.783571 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-11d682ce-3ee6-4636-95d7-bcbcaa023e49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:07:06.784710 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-11d682ce-3ee6-4636-95d7-bcbcaa023e49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:07:06.787569 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1400/2823] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 14 18:07:06 2022] DELETE /identity/v3/projects/65b207054aa74f3494d77b4b406173fc => generated 0 bytes in 654 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 18:07:06.808062 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f94be21-45a2-4a70-add0-56ba98ec1f3d None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:07:06.808062 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f94be21-45a2-4a70-add0-56ba98ec1f3d None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:07:06.808062 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f94be21-45a2-4a70-add0-56ba98ec1f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:07:06.827923 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-2f94be21-45a2-4a70-add0-56ba98ec1f3d None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:07:06.829207 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-2f94be21-45a2-4a70-add0-56ba98ec1f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:07:06.917559 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1424/2824] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:07:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:07:06.926421 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1723ab-aed2-4561-8dd9-63a9c9d75d05 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:07:06.926900 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1723ab-aed2-4561-8dd9-63a9c9d75d05 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:07:06.927283 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1723ab-aed2-4561-8dd9-63a9c9d75d05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:07:06.954040 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-5c1723ab-aed2-4561-8dd9-63a9c9d75d05 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:07:06.955441 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-5c1723ab-aed2-4561-8dd9-63a9c9d75d05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:07:06.965662 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1401/2825] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:07:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:07:06.971123 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f94be21-45a2-4a70-add0-56ba98ec1f3d None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:07:06.986482 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f94be21-45a2-4a70-add0-56ba98ec1f3d None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:07:06.991875 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c824382-2233-4f2f-86be-5dce94fed133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:07:06.992668 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c824382-2233-4f2f-86be-5dce94fed133 admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:07:06.992943 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c824382-2233-4f2f-86be-5dce94fed133 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:07:06.993226 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c824382-2233-4f2f-86be-5dce94fed133 admin admin] PATH_INFO: `/v3/domains` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:07:06.994601 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c824382-2233-4f2f-86be-5dce94fed133 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 18:07:06.994919 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c824382-2233-4f2f-86be-5dce94fed133 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:07:06.996586 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c824382-2233-4f2f-86be-5dce94fed133 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:07:07.004832 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:07:07.012088 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1425/2826] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 14 18:07:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 18:07:07.021179 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1723ab-aed2-4561-8dd9-63a9c9d75d05 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:07:07.033583 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1723ab-aed2-4561-8dd9-63a9c9d75d05 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:07:07.044109 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8c6316-5de0-4906-8a2c-290198a2c077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:07:07.063362 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8c6316-5de0-4906-8a2c-290198a2c077 admin admin] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:07:07.063362 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8c6316-5de0-4906-8a2c-290198a2c077 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:07:07.063362 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8c6316-5de0-4906-8a2c-290198a2c077 admin admin] PATH_INFO: `/v3/projects` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:07:07.063362 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8c6316-5de0-4906-8a2c-290198a2c077 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:07:07.063362 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8c6316-5de0-4906-8a2c-290198a2c077 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:07:07.068651 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6338c44-5e57-4982-abd4-9c6ef8036c5b None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:07:07.068651 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6338c44-5e57-4982-abd4-9c6ef8036c5b None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:07:07.068651 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6338c44-5e57-4982-abd4-9c6ef8036c5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:07:07.087713 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-b6338c44-5e57-4982-abd4-9c6ef8036c5b None None] MFA Rules not processed for user `da59091825d44440887d6ef9c542b1ce`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:07:07.089758 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-b6338c44-5e57-4982-abd4-9c6ef8036c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:07:07.174330 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1402/2827] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 14 18:07:07 2022] POST /identity/v3/projects => generated 363 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:07:07.175770 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8c6316-5de0-4906-8a2c-290198a2c077 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:07:07.185097 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1426/2828] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:07:07 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:07:07.232523 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:07:07.283272 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8c6316-5de0-4906-8a2c-290198a2c077 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:07:07.297747 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac09573-f249-4703-a864-cedb141377d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:07:07.298763 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac09573-f249-4703-a864-cedb141377d6 admin admin] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:07:07.299193 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac09573-f249-4703-a864-cedb141377d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:07:07.299765 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac09573-f249-4703-a864-cedb141377d6 admin admin] PATH_INFO: `/v3/users` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:07:07.300650 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac09573-f249-4703-a864-cedb141377d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:07:07.303586 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac09573-f249-4703-a864-cedb141377d6 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:07:07.394429 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1403/2829] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 14 18:07:07 2022] POST /identity/v3/users => generated 282 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:07:07.395817 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6338c44-5e57-4982-abd4-9c6ef8036c5b None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:07:07.408486 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6338c44-5e57-4982-abd4-9c6ef8036c5b None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:07:07.414277 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bd4e18-3543-400e-86a4-b9a6101c783b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:07:07.415099 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bd4e18-3543-400e-86a4-b9a6101c783b admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:07:07.416007 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bd4e18-3543-400e-86a4-b9a6101c783b admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:07:07.416600 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bd4e18-3543-400e-86a4-b9a6101c783b admin admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:07:07.417456 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bd4e18-3543-400e-86a4-b9a6101c783b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:07:07.419386 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bd4e18-3543-400e-86a4-b9a6101c783b admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:07:07.438910 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1427/2830] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 18:07:07 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:07:07.444378 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac09573-f249-4703-a864-cedb141377d6 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:07:07.463195 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac09573-f249-4703-a864-cedb141377d6 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:07:07.471993 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd0d5a5-60e3-4610-bfb5-6ae2891a19a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:07:07.473450 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd0d5a5-60e3-4610-bfb5-6ae2891a19a1 admin admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:07:07.473934 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd0d5a5-60e3-4610-bfb5-6ae2891a19a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:07:07.474491 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd0d5a5-60e3-4610-bfb5-6ae2891a19a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:07:07.475907 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd0d5a5-60e3-4610-bfb5-6ae2891a19a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:07:07.479462 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd0d5a5-60e3-4610-bfb5-6ae2891a19a1 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:07:07.499065 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1404/2831] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 18:07:07 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:07:07.505849 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bd4e18-3543-400e-86a4-b9a6101c783b admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:07:07.527244 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bd4e18-3543-400e-86a4-b9a6101c783b admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:07:07.532729 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d90ba85-ae68-4757-8a0b-799888c276c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:07:07.533757 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d90ba85-ae68-4757-8a0b-799888c276c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:07:07.534113 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d90ba85-ae68-4757-8a0b-799888c276c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:07:07.534502 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d90ba85-ae68-4757-8a0b-799888c276c3 admin admin] PATH_INFO: `/v3/projects/6dfe3f1ad75e4457b6ffe2ecb94c19a5/users/deae3262397548b78e4287a351f31107/roles/9ee80134743f4c2b88525b04df2facba` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:07:07.553960 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d90ba85-ae68-4757-8a0b-799888c276c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6dfe3f1ad75e4457b6ffe2ecb94c19a5, user_id=deae3262397548b78e4287a351f31107, role_id=9ee80134743f4c2b88525b04df2facba)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:07:07.557487 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d90ba85-ae68-4757-8a0b-799888c276c3 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:07:07.696180 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1428/2832] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 18:07:07 2022] PUT /identity/v3/projects/6dfe3f1ad75e4457b6ffe2ecb94c19a5/users/deae3262397548b78e4287a351f31107/roles/9ee80134743f4c2b88525b04df2facba => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:07:07.707394 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbea4ce7-0fce-4e23-b8c7-9d24f87e6af3 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:07:07.708227 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbea4ce7-0fce-4e23-b8c7-9d24f87e6af3 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:07:07.708227 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbea4ce7-0fce-4e23-b8c7-9d24f87e6af3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:07:07.749159 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-cbea4ce7-0fce-4e23-b8c7-9d24f87e6af3 None None] MFA Rules not processed for user `deae3262397548b78e4287a351f31107`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:07:07.749883 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-cbea4ce7-0fce-4e23-b8c7-9d24f87e6af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:07:07.863762 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1405/2833] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:07:07 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 18:07:07.873906 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d90ba85-ae68-4757-8a0b-799888c276c3 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:07:07.876465 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-1d90ba85-ae68-4757-8a0b-799888c276c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:07:07.956227 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d90ba85-ae68-4757-8a0b-799888c276c3 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:07:07.966021 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6693352-2401-4a9c-99ae-6bf44e7d8e41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17945e7d72954b8787e0ba09a9903247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:07:07.967017 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6693352-2401-4a9c-99ae-6bf44e7d8e41 service cinder] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:07:07.967565 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6693352-2401-4a9c-99ae-6bf44e7d8e41 service cinder] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:07:07.968533 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6693352-2401-4a9c-99ae-6bf44e7d8e41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:07:07.982460 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6693352-2401-4a9c-99ae-6bf44e7d8e41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:07:07.984015 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6693352-2401-4a9c-99ae-6bf44e7d8e41 service cinder] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:07:07.999698 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1429/2834] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 18:07:07 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:07:17.850860 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=56,keystone:INSERT=3 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:07:17.990821 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=67,keystone:INSERT=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:07:29.424586 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450e3126-0b2d-4227-b1b4-d33aa41ea405 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:07:29.425146 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450e3126-0b2d-4227-b1b4-d33aa41ea405 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:07:29.425146 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450e3126-0b2d-4227-b1b4-d33aa41ea405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:07:29.445534 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-450e3126-0b2d-4227-b1b4-d33aa41ea405 None None] MFA Rules not processed for user `f1e32638fe5c4d2d8d3e2e4ea8250aaa`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:07:29.446866 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-450e3126-0b2d-4227-b1b4-d33aa41ea405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:07:29.514492 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1406/2835] 10.222.0.36 () {58 vars in 1009 bytes} [Tue Jun 14 18:07:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:07:29.702787 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6693352-2401-4a9c-99ae-6bf44e7d8e41 service cinder] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:07:29.704438 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-a6693352-2401-4a9c-99ae-6bf44e7d8e41 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:07:29.788579 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6693352-2401-4a9c-99ae-6bf44e7d8e41 service cinder] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:07:29.794604 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30722e8f-237e-417e-9d8d-1a4944cddf92 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba38b47a31b14526be0aa2054841881b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:07:29.795402 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30722e8f-237e-417e-9d8d-1a4944cddf92 service swift] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:07:29.795652 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30722e8f-237e-417e-9d8d-1a4944cddf92 service swift] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:07:29.795881 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30722e8f-237e-417e-9d8d-1a4944cddf92 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:07:29.806719 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30722e8f-237e-417e-9d8d-1a4944cddf92 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:07:29.810732 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30722e8f-237e-417e-9d8d-1a4944cddf92 service swift] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:07:29.820109 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1430/2836] 10.222.0.36 () {60 vars in 1384 bytes} [Tue Jun 14 18:07:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 14 18:07:30.016162 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450e3126-0b2d-4227-b1b4-d33aa41ea405 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:07:30.017908 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-450e3126-0b2d-4227-b1b4-d33aa41ea405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:07:30.093472 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450e3126-0b2d-4227-b1b4-d33aa41ea405 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:07:30.098156 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5368072-6378-4356-81b2-49f197531a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:07:30.099034 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5368072-6378-4356-81b2-49f197531a4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:07:30.099357 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5368072-6378-4356-81b2-49f197531a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:07:30.099646 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5368072-6378-4356-81b2-49f197531a4e admin admin] PATH_INFO: `/v3/users/43856ec0ea2e44a6bd0af652f37a8e56` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:07:30.100955 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5368072-6378-4356-81b2-49f197531a4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=43856ec0ea2e44a6bd0af652f37a8e56)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:07:30.102888 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5368072-6378-4356-81b2-49f197531a4e admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:07:30.295814 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-f5368072-6378-4356-81b2-49f197531a4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43856ec0ea2e44a6bd0af652f37a8e56'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:07:30.296476 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-f5368072-6378-4356-81b2-49f197531a4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43856ec0ea2e44a6bd0af652f37a8e56'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:07:30.297086 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-f5368072-6378-4356-81b2-49f197531a4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43856ec0ea2e44a6bd0af652f37a8e56'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:07:30.382629 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-f5368072-6378-4356-81b2-49f197531a4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43856ec0ea2e44a6bd0af652f37a8e56'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:07:30.395077 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-f5368072-6378-4356-81b2-49f197531a4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43856ec0ea2e44a6bd0af652f37a8e56'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:07:30.420854 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1407/2837] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 14 18:07:30 2022] DELETE /identity/v3/users/43856ec0ea2e44a6bd0af652f37a8e56 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:07:30.422711 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1e56c5-509c-4156-84c8-9a84e09416cd None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:07:30.423008 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1e56c5-509c-4156-84c8-9a84e09416cd None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:07:30.423321 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1e56c5-509c-4156-84c8-9a84e09416cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:07:30.442531 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-4d1e56c5-509c-4156-84c8-9a84e09416cd None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:07:30.443752 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-4d1e56c5-509c-4156-84c8-9a84e09416cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:07:30.512546 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1431/2838] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:07:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:07:30.524198 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5368072-6378-4356-81b2-49f197531a4e admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:07:30.524198 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-f5368072-6378-4356-81b2-49f197531a4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:07:30.554545 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:07:30.585373 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5368072-6378-4356-81b2-49f197531a4e admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:07:30.590872 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6f2ed1-e8b5-41c2-b38f-2ed3a67eb997 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5652329c71cd431fb579d69cef933b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:07:30.591584 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6f2ed1-e8b5-41c2-b38f-2ed3a67eb997 service neutron] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:07:30.591876 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6f2ed1-e8b5-41c2-b38f-2ed3a67eb997 service neutron] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:07:30.592159 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6f2ed1-e8b5-41c2-b38f-2ed3a67eb997 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:07:30.607242 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6f2ed1-e8b5-41c2-b38f-2ed3a67eb997 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:07:30.607242 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6f2ed1-e8b5-41c2-b38f-2ed3a67eb997 service neutron] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:07:30.616328 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1408/2839] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 18:07:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:07:30.832646 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dd908d-7885-469d-a1e5-d5949396a73f None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:07:30.832646 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dd908d-7885-469d-a1e5-d5949396a73f None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:07:30.832646 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dd908d-7885-469d-a1e5-d5949396a73f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:07:30.848027 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-00dd908d-7885-469d-a1e5-d5949396a73f None None] MFA Rules not processed for user `f1e32638fe5c4d2d8d3e2e4ea8250aaa`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:07:30.849271 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-00dd908d-7885-469d-a1e5-d5949396a73f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:07:30.921920 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1432/2840] 10.222.0.36 () {58 vars in 967 bytes} [Tue Jun 14 18:07:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:07:30.937849 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6f2ed1-e8b5-41c2-b38f-2ed3a67eb997 service neutron] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:07:30.940012 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-4e6f2ed1-e8b5-41c2-b38f-2ed3a67eb997 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:07:31.031076 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6f2ed1-e8b5-41c2-b38f-2ed3a67eb997 service neutron] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:07:31.037980 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cd9615-bd7e-4081-9174-39c27703caae service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba38b47a31b14526be0aa2054841881b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:07:31.038669 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd9615-bd7e-4081-9174-39c27703caae service swift] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:07:31.038959 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd9615-bd7e-4081-9174-39c27703caae service swift] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:07:31.039246 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd9615-bd7e-4081-9174-39c27703caae service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:07:31.053092 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cd9615-bd7e-4081-9174-39c27703caae service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:07:31.054991 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cd9615-bd7e-4081-9174-39c27703caae service swift] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:07:31.066761 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1409/2841] 10.222.0.36 () {60 vars in 1384 bytes} [Tue Jun 14 18:07:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 14 18:07:31.104669 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dd908d-7885-469d-a1e5-d5949396a73f None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:07:31.106955 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-00dd908d-7885-469d-a1e5-d5949396a73f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:07:31.129404 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dd908d-7885-469d-a1e5-d5949396a73f None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:07:31.141430 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03660c52-c42b-4299-af21-215785398c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:07:31.142348 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03660c52-c42b-4299-af21-215785398c30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:07:31.142640 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03660c52-c42b-4299-af21-215785398c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:07:31.142927 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03660c52-c42b-4299-af21-215785398c30 admin admin] PATH_INFO: `/v3/projects/77f06487f0c64a9c9bd58c5832bb3262` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:07:31.144188 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03660c52-c42b-4299-af21-215785398c30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77f06487f0c64a9c9bd58c5832bb3262)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:07:31.146138 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03660c52-c42b-4299-af21-215785398c30 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:07:31.279600 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:07:31.292794 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-03660c52-c42b-4299-af21-215785398c30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77f06487f0c64a9c9bd58c5832bb3262', 'request_id': 'req-03660c52-c42b-4299-af21-215785398c30'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:07:31.387504 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-03660c52-c42b-4299-af21-215785398c30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77f06487f0c64a9c9bd58c5832bb3262', 'request_id': 'req-03660c52-c42b-4299-af21-215785398c30'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:07:31.396298 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-03660c52-c42b-4299-af21-215785398c30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77f06487f0c64a9c9bd58c5832bb3262', 'request_id': 'req-03660c52-c42b-4299-af21-215785398c30'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:07:31.431398 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-03660c52-c42b-4299-af21-215785398c30 admin admin] The token cache is being invalidate because project 77f06487f0c64a9c9bd58c5832bb3262 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87019) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:07:31.431398 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-03660c52-c42b-4299-af21-215785398c30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:07:31.431398 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-03660c52-c42b-4299-af21-215785398c30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:07:31.431398 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1433/2842] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 14 18:07:31 2022] DELETE /identity/v3/projects/77f06487f0c64a9c9bd58c5832bb3262 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:07:31.786702 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4cdb38-bfdc-4306-a81b-47604786b930 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:07:31.787182 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4cdb38-bfdc-4306-a81b-47604786b930 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:07:31.787350 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4cdb38-bfdc-4306-a81b-47604786b930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:07:31.805326 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-aa4cdb38-bfdc-4306-a81b-47604786b930 None None] MFA Rules not processed for user `f1e32638fe5c4d2d8d3e2e4ea8250aaa`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:07:31.807179 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-aa4cdb38-bfdc-4306-a81b-47604786b930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:07:31.864967 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1410/2843] 10.222.0.36 () {58 vars in 1009 bytes} [Tue Jun 14 18:07:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:07:31.878521 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03660c52-c42b-4299-af21-215785398c30 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:07:31.880031 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-03660c52-c42b-4299-af21-215785398c30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:07:31.952667 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03660c52-c42b-4299-af21-215785398c30 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:07:31.957756 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb62928-6acf-4a80-b020-e74531fc8260 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba38b47a31b14526be0aa2054841881b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:07:31.958413 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb62928-6acf-4a80-b020-e74531fc8260 service swift] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:07:31.958830 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb62928-6acf-4a80-b020-e74531fc8260 service swift] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:07:31.959123 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb62928-6acf-4a80-b020-e74531fc8260 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:07:31.967863 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb62928-6acf-4a80-b020-e74531fc8260 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:07:31.969499 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb62928-6acf-4a80-b020-e74531fc8260 service swift] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:07:31.978722 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1434/2844] 10.222.0.36 () {60 vars in 1384 bytes} [Tue Jun 14 18:07:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 14 18:07:32.635688 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f274e9-7785-4a5e-bcc9-fce15df9830d None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:07:32.635983 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f274e9-7785-4a5e-bcc9-fce15df9830d None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:07:32.636703 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f274e9-7785-4a5e-bcc9-fce15df9830d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:07:32.660041 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-f0f274e9-7785-4a5e-bcc9-fce15df9830d None None] MFA Rules not processed for user `f1e32638fe5c4d2d8d3e2e4ea8250aaa`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:07:32.662087 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-f0f274e9-7785-4a5e-bcc9-fce15df9830d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:07:32.670411 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1411/2845] 10.222.0.36 () {58 vars in 967 bytes} [Tue Jun 14 18:07:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:07:32.685228 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb62928-6acf-4a80-b020-e74531fc8260 service swift] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:07:32.697561 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb62928-6acf-4a80-b020-e74531fc8260 service swift] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:07:32.704079 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb877a3-db9d-43d8-9ff7-9452c3febd98 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba38b47a31b14526be0aa2054841881b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:07:32.704665 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb877a3-db9d-43d8-9ff7-9452c3febd98 service swift] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:07:32.705289 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb877a3-db9d-43d8-9ff7-9452c3febd98 service swift] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:07:32.705581 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb877a3-db9d-43d8-9ff7-9452c3febd98 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:07:32.716684 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb877a3-db9d-43d8-9ff7-9452c3febd98 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:07:32.718447 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb877a3-db9d-43d8-9ff7-9452c3febd98 service swift] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:07:32.729310 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1435/2846] 10.222.0.36 () {60 vars in 1384 bytes} [Tue Jun 14 18:07:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 14 18:07:35.512711 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f274e9-7785-4a5e-bcc9-fce15df9830d None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:07:35.516989 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-f0f274e9-7785-4a5e-bcc9-fce15df9830d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:07:35.578831 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:07:35.585928 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f274e9-7785-4a5e-bcc9-fce15df9830d None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:07:35.593660 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec32df3f-6ef1-449f-b9f7-891ba4269c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:07:35.594567 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec32df3f-6ef1-449f-b9f7-891ba4269c4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:07:35.594859 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec32df3f-6ef1-449f-b9f7-891ba4269c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:07:35.595144 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec32df3f-6ef1-449f-b9f7-891ba4269c4e admin admin] PATH_INFO: `/v3/users/ad2bc23473c147e4b7ae8dcef1ae58ca` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:07:35.596411 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec32df3f-6ef1-449f-b9f7-891ba4269c4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad2bc23473c147e4b7ae8dcef1ae58ca)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:07:35.598393 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec32df3f-6ef1-449f-b9f7-891ba4269c4e admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:07:35.829762 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-ec32df3f-6ef1-449f-b9f7-891ba4269c4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad2bc23473c147e4b7ae8dcef1ae58ca'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:07:35.830336 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-ec32df3f-6ef1-449f-b9f7-891ba4269c4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad2bc23473c147e4b7ae8dcef1ae58ca'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:07:35.830948 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-ec32df3f-6ef1-449f-b9f7-891ba4269c4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad2bc23473c147e4b7ae8dcef1ae58ca'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:07:35.897562 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-ec32df3f-6ef1-449f-b9f7-891ba4269c4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad2bc23473c147e4b7ae8dcef1ae58ca'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:07:35.912964 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-ec32df3f-6ef1-449f-b9f7-891ba4269c4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad2bc23473c147e4b7ae8dcef1ae58ca'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:07:35.934576 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1412/2847] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 14 18:07:35 2022] DELETE /identity/v3/users/ad2bc23473c147e4b7ae8dcef1ae58ca => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:07:35.939916 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380c9d7e-54ea-4496-b712-49c43368edf0 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:07:35.940403 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380c9d7e-54ea-4496-b712-49c43368edf0 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:07:35.940514 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380c9d7e-54ea-4496-b712-49c43368edf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:07:35.960016 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-380c9d7e-54ea-4496-b712-49c43368edf0 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:07:35.961958 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-380c9d7e-54ea-4496-b712-49c43368edf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:07:36.041007 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1436/2848] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:07:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 18:07:36.051798 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec32df3f-6ef1-449f-b9f7-891ba4269c4e admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:07:36.053216 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-ec32df3f-6ef1-449f-b9f7-891ba4269c4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:07:36.124871 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec32df3f-6ef1-449f-b9f7-891ba4269c4e admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:07:36.128766 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f80314a-dcb9-4020-8b8f-49336d192caa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5652329c71cd431fb579d69cef933b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:07:36.129429 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f80314a-dcb9-4020-8b8f-49336d192caa service neutron] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:07:36.129717 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f80314a-dcb9-4020-8b8f-49336d192caa service neutron] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:07:36.130000 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f80314a-dcb9-4020-8b8f-49336d192caa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:07:36.140073 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f80314a-dcb9-4020-8b8f-49336d192caa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:07:36.143789 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f80314a-dcb9-4020-8b8f-49336d192caa service neutron] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:07:36.164035 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1413/2849] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 18:07:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:07:36.429888 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380c9d7e-54ea-4496-b712-49c43368edf0 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:07:36.433736 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-380c9d7e-54ea-4496-b712-49c43368edf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:07:36.453209 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380c9d7e-54ea-4496-b712-49c43368edf0 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:07:36.460085 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d612a23-46e8-47e6-974e-2da2901c6c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:07:36.461003 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d612a23-46e8-47e6-974e-2da2901c6c03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:07:36.461269 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d612a23-46e8-47e6-974e-2da2901c6c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:07:36.461693 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d612a23-46e8-47e6-974e-2da2901c6c03 admin admin] PATH_INFO: `/v3/projects/bab9329cb961497f9923d611541a4d17` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:07:36.462875 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d612a23-46e8-47e6-974e-2da2901c6c03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bab9329cb961497f9923d611541a4d17)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:07:36.466661 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d612a23-46e8-47e6-974e-2da2901c6c03 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:07:36.586651 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:07:36.601850 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-2d612a23-46e8-47e6-974e-2da2901c6c03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bab9329cb961497f9923d611541a4d17', 'request_id': 'req-2d612a23-46e8-47e6-974e-2da2901c6c03'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:07:36.690988 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-2d612a23-46e8-47e6-974e-2da2901c6c03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bab9329cb961497f9923d611541a4d17', 'request_id': 'req-2d612a23-46e8-47e6-974e-2da2901c6c03'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:07:36.700178 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-2d612a23-46e8-47e6-974e-2da2901c6c03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bab9329cb961497f9923d611541a4d17', 'request_id': 'req-2d612a23-46e8-47e6-974e-2da2901c6c03'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:07:36.712595 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-2d612a23-46e8-47e6-974e-2da2901c6c03 admin admin] The token cache is being invalidate because project bab9329cb961497f9923d611541a4d17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87019) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:07:36.712893 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-2d612a23-46e8-47e6-974e-2da2901c6c03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:07:36.713624 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-2d612a23-46e8-47e6-974e-2da2901c6c03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:07:36.716039 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1437/2850] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 14 18:07:36 2022] DELETE /identity/v3/projects/bab9329cb961497f9923d611541a4d17 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:07:36.722640 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73a8ca3-8492-41d5-b19d-092c50f445ff None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:07:36.723554 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73a8ca3-8492-41d5-b19d-092c50f445ff None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:07:36.724019 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73a8ca3-8492-41d5-b19d-092c50f445ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:07:36.748463 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-c73a8ca3-8492-41d5-b19d-092c50f445ff None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:07:36.749734 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-c73a8ca3-8492-41d5-b19d-092c50f445ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:07:36.820925 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1414/2851] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:07:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:07:36.829524 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7f4435-30ac-4204-a085-b0024348f0ee None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:07:36.829811 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7f4435-30ac-4204-a085-b0024348f0ee None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:07:36.830088 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7f4435-30ac-4204-a085-b0024348f0ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:07:36.849916 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-ff7f4435-30ac-4204-a085-b0024348f0ee None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:07:36.851139 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-ff7f4435-30ac-4204-a085-b0024348f0ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:07:36.862636 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1438/2852] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:07:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:07:36.867544 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73a8ca3-8492-41d5-b19d-092c50f445ff None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:07:36.878003 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73a8ca3-8492-41d5-b19d-092c50f445ff None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:07:36.882683 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ddc801-8343-4e0c-8eca-31e0390ca035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:07:36.883456 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ddc801-8343-4e0c-8eca-31e0390ca035 admin admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:07:36.884026 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ddc801-8343-4e0c-8eca-31e0390ca035 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:07:36.884026 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ddc801-8343-4e0c-8eca-31e0390ca035 admin admin] PATH_INFO: `/v3/domains` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:07:36.884858 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ddc801-8343-4e0c-8eca-31e0390ca035 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 18:07:36.885185 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ddc801-8343-4e0c-8eca-31e0390ca035 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:07:36.887816 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ddc801-8343-4e0c-8eca-31e0390ca035 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:07:36.903564 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1415/2853] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 14 18:07:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 18:07:36.908584 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7f4435-30ac-4204-a085-b0024348f0ee None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:07:36.918716 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7f4435-30ac-4204-a085-b0024348f0ee None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:07:36.923864 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3919a60c-3252-4982-99fc-1f1e303d04d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:07:36.924476 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3919a60c-3252-4982-99fc-1f1e303d04d4 admin admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:07:36.924762 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3919a60c-3252-4982-99fc-1f1e303d04d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:07:36.925040 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3919a60c-3252-4982-99fc-1f1e303d04d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:07:36.925744 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3919a60c-3252-4982-99fc-1f1e303d04d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:07:36.927693 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3919a60c-3252-4982-99fc-1f1e303d04d4 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:07:37.013456 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1439/2854] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 14 18:07:36 2022] POST /identity/v3/projects => generated 383 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:07:37.018278 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ddc801-8343-4e0c-8eca-31e0390ca035 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:07:37.025399 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:07:37.029994 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ddc801-8343-4e0c-8eca-31e0390ca035 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:07:37.102558 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa53f627-fe50-4510-b5fd-45bc808a8da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:07:37.103253 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa53f627-fe50-4510-b5fd-45bc808a8da2 admin admin] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:07:37.111494 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa53f627-fe50-4510-b5fd-45bc808a8da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:07:37.111494 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa53f627-fe50-4510-b5fd-45bc808a8da2 admin admin] PATH_INFO: `/v3/users` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:07:37.111494 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa53f627-fe50-4510-b5fd-45bc808a8da2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:07:37.111494 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa53f627-fe50-4510-b5fd-45bc808a8da2 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:07:37.190150 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1416/2855] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 14 18:07:37 2022] POST /identity/v3/users => generated 292 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:07:37.194312 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3919a60c-3252-4982-99fc-1f1e303d04d4 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:07:37.206758 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3919a60c-3252-4982-99fc-1f1e303d04d4 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:07:37.211961 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a989f90-d679-4bd9-be54-acadd76b6c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:07:37.212631 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a989f90-d679-4bd9-be54-acadd76b6c91 admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:07:37.212919 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a989f90-d679-4bd9-be54-acadd76b6c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:07:37.213203 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a989f90-d679-4bd9-be54-acadd76b6c91 admin admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:07:37.215332 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a989f90-d679-4bd9-be54-acadd76b6c91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:07:37.217925 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a989f90-d679-4bd9-be54-acadd76b6c91 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:07:37.229096 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1440/2856] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 18:07:37 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:07:37.233463 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa53f627-fe50-4510-b5fd-45bc808a8da2 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:07:37.244336 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa53f627-fe50-4510-b5fd-45bc808a8da2 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:07:37.249434 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a96d8a-9936-4a63-937d-20c841010eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:07:37.250114 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a96d8a-9936-4a63-937d-20c841010eda admin admin] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:07:37.250399 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a96d8a-9936-4a63-937d-20c841010eda admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:07:37.250680 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a96d8a-9936-4a63-937d-20c841010eda admin admin] PATH_INFO: `/v3/roles` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:07:37.251450 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a96d8a-9936-4a63-937d-20c841010eda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:07:37.253050 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a96d8a-9936-4a63-937d-20c841010eda admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:07:37.270618 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1417/2857] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 18:07:37 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:07:37.272290 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a989f90-d679-4bd9-be54-acadd76b6c91 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:07:37.283725 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a989f90-d679-4bd9-be54-acadd76b6c91 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:07:37.288619 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92265fa9-8568-4979-86db-ce96946b6c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:07:37.289558 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92265fa9-8568-4979-86db-ce96946b6c53 admin admin] REQUEST_METHOD: `PUT` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:07:37.290034 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92265fa9-8568-4979-86db-ce96946b6c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:07:37.290331 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92265fa9-8568-4979-86db-ce96946b6c53 admin admin] PATH_INFO: `/v3/projects/1ca62d7c1e1c4d61a1b3c94f0068b5c8/users/b2686c4f76544b0c996c15d619b702ba/roles/9ee80134743f4c2b88525b04df2facba` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:07:37.307810 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92265fa9-8568-4979-86db-ce96946b6c53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ca62d7c1e1c4d61a1b3c94f0068b5c8, user_id=b2686c4f76544b0c996c15d619b702ba, role_id=9ee80134743f4c2b88525b04df2facba)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:07:37.310724 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92265fa9-8568-4979-86db-ce96946b6c53 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:07:37.389165 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1441/2858] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 18:07:37 2022] PUT /identity/v3/projects/1ca62d7c1e1c4d61a1b3c94f0068b5c8/users/b2686c4f76544b0c996c15d619b702ba/roles/9ee80134743f4c2b88525b04df2facba => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:07:37.394461 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e0f8ef-7ec5-48d6-8fc2-e3a82dc26588 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:07:37.394826 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e0f8ef-7ec5-48d6-8fc2-e3a82dc26588 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:07:37.394997 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e0f8ef-7ec5-48d6-8fc2-e3a82dc26588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:07:37.415552 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-d7e0f8ef-7ec5-48d6-8fc2-e3a82dc26588 None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:07:37.416763 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-d7e0f8ef-7ec5-48d6-8fc2-e3a82dc26588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:07:37.495024 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1418/2859] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:07:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:07:37.506284 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92265fa9-8568-4979-86db-ce96946b6c53 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:07:37.508296 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-92265fa9-8568-4979-86db-ce96946b6c53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:07:37.592991 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92265fa9-8568-4979-86db-ce96946b6c53 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:07:37.597517 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41e8786-7008-4f4d-8d7f-383a4fb0f7ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5652329c71cd431fb579d69cef933b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:07:37.598214 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41e8786-7008-4f4d-8d7f-383a4fb0f7ca service neutron] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:07:37.598506 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41e8786-7008-4f4d-8d7f-383a4fb0f7ca service neutron] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:07:37.598791 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41e8786-7008-4f4d-8d7f-383a4fb0f7ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:07:37.610151 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41e8786-7008-4f4d-8d7f-383a4fb0f7ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:07:37.611808 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41e8786-7008-4f4d-8d7f-383a4fb0f7ca service neutron] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:07:37.625564 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1442/2860] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 18:07:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:07:43.707019 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4028cb58-bfac-4685-9418-30774cc35fef None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:07:43.711853 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4028cb58-bfac-4685-9418-30774cc35fef None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:07:43.711853 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4028cb58-bfac-4685-9418-30774cc35fef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:07:43.737556 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-4028cb58-bfac-4685-9418-30774cc35fef None None] MFA Rules not processed for user `b2686c4f76544b0c996c15d619b702ba`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:07:43.745628 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-4028cb58-bfac-4685-9418-30774cc35fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:07:43.824724 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1419/2861] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:07:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:07:43.829774 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41e8786-7008-4f4d-8d7f-383a4fb0f7ca service neutron] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:07:43.841083 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41e8786-7008-4f4d-8d7f-383a4fb0f7ca service neutron] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:07:43.845987 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed908842-39b0-48e5-8185-a266bdf564f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:07:43.846549 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed908842-39b0-48e5-8185-a266bdf564f1 admin admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:07:43.846836 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed908842-39b0-48e5-8185-a266bdf564f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:07:43.847119 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed908842-39b0-48e5-8185-a266bdf564f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:07:43.847977 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed908842-39b0-48e5-8185-a266bdf564f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:07:43.849807 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed908842-39b0-48e5-8185-a266bdf564f1 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:07:43.961494 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1443/2862] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 14 18:07:43 2022] POST /identity/v3/projects => generated 385 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:07:43.967328 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4028cb58-bfac-4685-9418-30774cc35fef None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:07:43.985847 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4028cb58-bfac-4685-9418-30774cc35fef None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:07:43.995994 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:07:44.050699 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313add89-f71c-4625-9e84-2af2328a3619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:07:44.051427 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313add89-f71c-4625-9e84-2af2328a3619 admin admin] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:07:44.051714 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313add89-f71c-4625-9e84-2af2328a3619 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:07:44.051997 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313add89-f71c-4625-9e84-2af2328a3619 admin admin] PATH_INFO: `/v3/users` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:07:44.052691 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313add89-f71c-4625-9e84-2af2328a3619 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:07:44.054605 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313add89-f71c-4625-9e84-2af2328a3619 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:07:44.131920 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1420/2863] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 14 18:07:43 2022] POST /identity/v3/users => generated 299 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:07:44.135576 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed908842-39b0-48e5-8185-a266bdf564f1 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:07:44.147624 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed908842-39b0-48e5-8185-a266bdf564f1 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:07:44.153874 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b6c30d-a1d0-416f-97dd-8c151aa5933d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:07:44.154813 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b6c30d-a1d0-416f-97dd-8c151aa5933d admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:07:44.155104 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b6c30d-a1d0-416f-97dd-8c151aa5933d admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:07:44.155411 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b6c30d-a1d0-416f-97dd-8c151aa5933d admin admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:07:44.156144 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b6c30d-a1d0-416f-97dd-8c151aa5933d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:07:44.157755 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b6c30d-a1d0-416f-97dd-8c151aa5933d admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:07:44.170136 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1444/2864] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 18:07:44 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:07:44.174302 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313add89-f71c-4625-9e84-2af2328a3619 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:07:44.184767 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313add89-f71c-4625-9e84-2af2328a3619 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:07:44.189522 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d26a698-b853-4b2f-b496-eba72cf33809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:07:44.190435 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d26a698-b853-4b2f-b496-eba72cf33809 admin admin] REQUEST_METHOD: `PUT` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:07:44.190726 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d26a698-b853-4b2f-b496-eba72cf33809 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:07:44.191012 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d26a698-b853-4b2f-b496-eba72cf33809 admin admin] PATH_INFO: `/v3/projects/6615d42a60864feeb2873cc01eddcf4b/users/271bc67b63db42db905fa1b8215f53da/roles/1348580877d04014bfdec4d866b98a74` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:07:44.207835 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d26a698-b853-4b2f-b496-eba72cf33809 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6615d42a60864feeb2873cc01eddcf4b, user_id=271bc67b63db42db905fa1b8215f53da, role_id=1348580877d04014bfdec4d866b98a74)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:07:44.210561 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d26a698-b853-4b2f-b496-eba72cf33809 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:07:44.281043 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1421/2865] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 18:07:44 2022] PUT /identity/v3/projects/6615d42a60864feeb2873cc01eddcf4b/users/271bc67b63db42db905fa1b8215f53da/roles/1348580877d04014bfdec4d866b98a74 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:07:44.285241 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b6c30d-a1d0-416f-97dd-8c151aa5933d admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:07:44.296816 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b6c30d-a1d0-416f-97dd-8c151aa5933d admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:07:44.320193 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:07:44.360196 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25cb212-368f-4bba-b559-9481fbb575d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:07:44.360907 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25cb212-368f-4bba-b559-9481fbb575d5 admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:07:44.361205 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25cb212-368f-4bba-b559-9481fbb575d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:07:44.361470 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25cb212-368f-4bba-b559-9481fbb575d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:07:44.362210 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25cb212-368f-4bba-b559-9481fbb575d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:07:44.363866 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25cb212-368f-4bba-b559-9481fbb575d5 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:07:44.374841 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1445/2866] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 14 18:07:44 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:07:44.379025 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d26a698-b853-4b2f-b496-eba72cf33809 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:07:44.392091 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d26a698-b853-4b2f-b496-eba72cf33809 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:07:44.398471 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2194891f-063c-4504-927a-48e082611211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:07:44.399571 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2194891f-063c-4504-927a-48e082611211 admin admin] REQUEST_METHOD: `PUT` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:07:44.410205 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2194891f-063c-4504-927a-48e082611211 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:07:44.410205 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2194891f-063c-4504-927a-48e082611211 admin admin] PATH_INFO: `/v3/projects/6615d42a60864feeb2873cc01eddcf4b/users/271bc67b63db42db905fa1b8215f53da/roles/1348580877d04014bfdec4d866b98a74` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:07:44.410205 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2194891f-063c-4504-927a-48e082611211 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6615d42a60864feeb2873cc01eddcf4b, user_id=271bc67b63db42db905fa1b8215f53da, role_id=1348580877d04014bfdec4d866b98a74)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:07:44.410205 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2194891f-063c-4504-927a-48e082611211 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:07:44.421307 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1422/2867] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 14 18:07:44 2022] PUT /identity/v3/projects/6615d42a60864feeb2873cc01eddcf4b/users/271bc67b63db42db905fa1b8215f53da/roles/1348580877d04014bfdec4d866b98a74 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:07:49.838766 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f084371-f5b5-4c9b-ba8d-16985ffd1def None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:07:49.839374 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f084371-f5b5-4c9b-ba8d-16985ffd1def None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:07:49.839475 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f084371-f5b5-4c9b-ba8d-16985ffd1def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:07:49.868867 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-7f084371-f5b5-4c9b-ba8d-16985ffd1def None None] MFA Rules not processed for user `271bc67b63db42db905fa1b8215f53da`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:07:49.870011 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-7f084371-f5b5-4c9b-ba8d-16985ffd1def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:07:49.949412 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1446/2868] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:07:49 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:07:49.961412 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2194891f-063c-4504-927a-48e082611211 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:07:49.963411 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-2194891f-063c-4504-927a-48e082611211 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:07:50.034188 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2194891f-063c-4504-927a-48e082611211 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:07:50.038139 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250d68ce-bdcd-4cd3-ab2f-0b7e89edb5d3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359f5ed4eb684e769f552484ca9a34c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:07:50.038837 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250d68ce-bdcd-4cd3-ab2f-0b7e89edb5d3 service glance] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:07:50.039147 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250d68ce-bdcd-4cd3-ab2f-0b7e89edb5d3 service glance] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:07:50.039455 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250d68ce-bdcd-4cd3-ab2f-0b7e89edb5d3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:07:50.103688 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250d68ce-bdcd-4cd3-ab2f-0b7e89edb5d3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:07:50.105396 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250d68ce-bdcd-4cd3-ab2f-0b7e89edb5d3 service glance] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:07:50.115020 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1423/2869] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 18:07:49 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:07:50.429792 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca55e5c1-9f3e-4bf2-b05e-7815f2bdb7c1 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:07:50.430262 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca55e5c1-9f3e-4bf2-b05e-7815f2bdb7c1 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:07:50.430651 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca55e5c1-9f3e-4bf2-b05e-7815f2bdb7c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:07:50.451853 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-ca55e5c1-9f3e-4bf2-b05e-7815f2bdb7c1 None None] MFA Rules not processed for user `f1e32638fe5c4d2d8d3e2e4ea8250aaa`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:07:50.453013 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-ca55e5c1-9f3e-4bf2-b05e-7815f2bdb7c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:07:50.529298 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1447/2870] 10.222.0.36 () {58 vars in 1009 bytes} [Tue Jun 14 18:07:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:07:50.543166 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250d68ce-bdcd-4cd3-ab2f-0b7e89edb5d3 service glance] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:07:50.544905 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-250d68ce-bdcd-4cd3-ab2f-0b7e89edb5d3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:07:50.572007 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:07:50.640797 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250d68ce-bdcd-4cd3-ab2f-0b7e89edb5d3 service glance] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:07:50.647111 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1932b4db-bcee-4d9d-b44f-d15cb1e31cc4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba38b47a31b14526be0aa2054841881b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:07:50.647827 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1932b4db-bcee-4d9d-b44f-d15cb1e31cc4 service swift] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:07:50.648117 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1932b4db-bcee-4d9d-b44f-d15cb1e31cc4 service swift] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:07:50.648405 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1932b4db-bcee-4d9d-b44f-d15cb1e31cc4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:07:50.663625 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1932b4db-bcee-4d9d-b44f-d15cb1e31cc4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:07:50.666095 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1932b4db-bcee-4d9d-b44f-d15cb1e31cc4 service swift] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:07:50.679848 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1424/2871] 10.222.0.36 () {60 vars in 1384 bytes} [Tue Jun 14 18:07:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 14 18:07:54.320965 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca55e5c1-9f3e-4bf2-b05e-7815f2bdb7c1 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:07:54.323283 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-ca55e5c1-9f3e-4bf2-b05e-7815f2bdb7c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:07:54.414837 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:07:54.437334 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca55e5c1-9f3e-4bf2-b05e-7815f2bdb7c1 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:07:54.443339 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5a5ea4-219e-46ec-b8ad-5f82cf8f68cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:07:54.444620 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5a5ea4-219e-46ec-b8ad-5f82cf8f68cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:07:54.444915 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5a5ea4-219e-46ec-b8ad-5f82cf8f68cf admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:07:54.445230 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5a5ea4-219e-46ec-b8ad-5f82cf8f68cf admin admin] PATH_INFO: `/v3/users/deae3262397548b78e4287a351f31107` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:07:54.447121 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5a5ea4-219e-46ec-b8ad-5f82cf8f68cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=deae3262397548b78e4287a351f31107)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:07:54.449919 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5a5ea4-219e-46ec-b8ad-5f82cf8f68cf admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:07:54.758862 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-7e5a5ea4-219e-46ec-b8ad-5f82cf8f68cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'deae3262397548b78e4287a351f31107'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:07:54.760370 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-7e5a5ea4-219e-46ec-b8ad-5f82cf8f68cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'deae3262397548b78e4287a351f31107'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:07:54.762051 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-7e5a5ea4-219e-46ec-b8ad-5f82cf8f68cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'deae3262397548b78e4287a351f31107'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:07:54.890659 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-7e5a5ea4-219e-46ec-b8ad-5f82cf8f68cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'deae3262397548b78e4287a351f31107'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:07:54.908571 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-7e5a5ea4-219e-46ec-b8ad-5f82cf8f68cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'deae3262397548b78e4287a351f31107'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:07:54.964004 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1448/2872] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 14 18:07:54 2022] DELETE /identity/v3/users/deae3262397548b78e4287a351f31107 => generated 0 bytes in 641 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:07:54.965806 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaa887a-b7f8-4bd3-9b60-3782e991236e None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:07:54.969030 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaa887a-b7f8-4bd3-9b60-3782e991236e None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:07:54.969030 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaa887a-b7f8-4bd3-9b60-3782e991236e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:07:55.004049 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-8aaa887a-b7f8-4bd3-9b60-3782e991236e None None] MFA Rules not processed for user `bdaeb72186c0489e804154d6d26ae21b`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:07:55.005604 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-8aaa887a-b7f8-4bd3-9b60-3782e991236e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:07:55.115374 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1425/2873] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:07:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:07:55.123764 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5a5ea4-219e-46ec-b8ad-5f82cf8f68cf admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:07:55.133225 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-7e5a5ea4-219e-46ec-b8ad-5f82cf8f68cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:07:55.280995 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5a5ea4-219e-46ec-b8ad-5f82cf8f68cf admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:07:55.286625 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d062a8f5-6fa8-472d-9cd0-93002bbf4e1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5652329c71cd431fb579d69cef933b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:07:55.287967 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d062a8f5-6fa8-472d-9cd0-93002bbf4e1a service neutron] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:07:55.288483 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d062a8f5-6fa8-472d-9cd0-93002bbf4e1a service neutron] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:07:55.289068 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d062a8f5-6fa8-472d-9cd0-93002bbf4e1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:07:55.304423 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d062a8f5-6fa8-472d-9cd0-93002bbf4e1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:07:55.309995 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d062a8f5-6fa8-472d-9cd0-93002bbf4e1a service neutron] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:07:55.324868 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1449/2874] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 18:07:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:07:55.842256 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaa887a-b7f8-4bd3-9b60-3782e991236e None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:07:55.845469 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-8aaa887a-b7f8-4bd3-9b60-3782e991236e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:07:55.898209 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaa887a-b7f8-4bd3-9b60-3782e991236e None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:07:55.915496 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef937dc6-a3f7-4609-a2c1-7cbea64695ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:07:55.916490 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef937dc6-a3f7-4609-a2c1-7cbea64695ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:07:55.916849 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef937dc6-a3f7-4609-a2c1-7cbea64695ef admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:07:55.917615 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef937dc6-a3f7-4609-a2c1-7cbea64695ef admin admin] PATH_INFO: `/v3/projects/6dfe3f1ad75e4457b6ffe2ecb94c19a5` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:07:55.918891 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef937dc6-a3f7-4609-a2c1-7cbea64695ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=6dfe3f1ad75e4457b6ffe2ecb94c19a5)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:07:55.921236 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef937dc6-a3f7-4609-a2c1-7cbea64695ef admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:07:56.039021 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-ef937dc6-a3f7-4609-a2c1-7cbea64695ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6dfe3f1ad75e4457b6ffe2ecb94c19a5', 'request_id': 'req-ef937dc6-a3f7-4609-a2c1-7cbea64695ef'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:07:56.109272 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-ef937dc6-a3f7-4609-a2c1-7cbea64695ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6dfe3f1ad75e4457b6ffe2ecb94c19a5', 'request_id': 'req-ef937dc6-a3f7-4609-a2c1-7cbea64695ef'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:07:56.119952 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-ef937dc6-a3f7-4609-a2c1-7cbea64695ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6dfe3f1ad75e4457b6ffe2ecb94c19a5', 'request_id': 'req-ef937dc6-a3f7-4609-a2c1-7cbea64695ef'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:07:56.145696 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-ef937dc6-a3f7-4609-a2c1-7cbea64695ef admin admin] The token cache is being invalidate because project 6dfe3f1ad75e4457b6ffe2ecb94c19a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:07:56.151544 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-ef937dc6-a3f7-4609-a2c1-7cbea64695ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:07:56.151544 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-ef937dc6-a3f7-4609-a2c1-7cbea64695ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:07:56.151544 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1426/2875] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 14 18:07:55 2022] DELETE /identity/v3/projects/6dfe3f1ad75e4457b6ffe2ecb94c19a5 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:08:01.249137 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8717049e-e68a-4c60-8c08-c2ddec9e4d79 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:08:01.249705 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8717049e-e68a-4c60-8c08-c2ddec9e4d79 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:08:01.249829 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8717049e-e68a-4c60-8c08-c2ddec9e4d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:08:01.267452 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-8717049e-e68a-4c60-8c08-c2ddec9e4d79 None None] MFA Rules not processed for user `b2686c4f76544b0c996c15d619b702ba`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:08:01.268661 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-8717049e-e68a-4c60-8c08-c2ddec9e4d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:08:01.324477 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1450/2876] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:08:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:08:04.635192 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043f9185-6aa9-46f1-aeb3-d603379f83b9 None None] REQUEST_METHOD: `POST` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:08:04.643394 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043f9185-6aa9-46f1-aeb3-d603379f83b9 None None] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:08:04.643394 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043f9185-6aa9-46f1-aeb3-d603379f83b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:08:04.657257 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.auth.core [None req-043f9185-6aa9-46f1-aeb3-d603379f83b9 None None] MFA Rules not processed for user `f1e32638fe5c4d2d8d3e2e4ea8250aaa`. Rule list: `[]` (Enabled: `True`). {{(pid=87018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:08:04.658302 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-043f9185-6aa9-46f1-aeb3-d603379f83b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:08:04.689589 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:08:04.722419 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1427/2877] 10.222.0.36 () {58 vars in 1009 bytes} [Tue Jun 14 18:08:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:08:04.732325 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8717049e-e68a-4c60-8c08-c2ddec9e4d79 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:08:04.733898 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-8717049e-e68a-4c60-8c08-c2ddec9e4d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:08:04.755720 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:08:04.808307 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8717049e-e68a-4c60-8c08-c2ddec9e4d79 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:08:04.814929 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3153f36-6643-4178-9b73-d731faf55b2a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba38b47a31b14526be0aa2054841881b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:08:04.815629 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3153f36-6643-4178-9b73-d731faf55b2a service swift] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:08:04.815917 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3153f36-6643-4178-9b73-d731faf55b2a service swift] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:08:04.816196 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3153f36-6643-4178-9b73-d731faf55b2a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:08:04.827065 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3153f36-6643-4178-9b73-d731faf55b2a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:08:04.828820 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3153f36-6643-4178-9b73-d731faf55b2a service swift] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:08:04.838797 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1451/2878] 10.222.0.36 () {60 vars in 1384 bytes} [Tue Jun 14 18:08:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 14 18:08:11.470494 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043f9185-6aa9-46f1-aeb3-d603379f83b9 None None] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:08:11.472174 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-043f9185-6aa9-46f1-aeb3-d603379f83b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:08:11.535572 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043f9185-6aa9-46f1-aeb3-d603379f83b9 None None] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:08:11.539327 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86716d32-5322-40d8-8ef2-0c5cb2ce06e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5652329c71cd431fb579d69cef933b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:08:11.540015 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86716d32-5322-40d8-8ef2-0c5cb2ce06e7 service neutron] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:08:11.540306 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86716d32-5322-40d8-8ef2-0c5cb2ce06e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:08:11.540595 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86716d32-5322-40d8-8ef2-0c5cb2ce06e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:08:11.542508 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-86716d32-5322-40d8-8ef2-0c5cb2ce06e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:08:11.643121 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86716d32-5322-40d8-8ef2-0c5cb2ce06e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:08:11.644605 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86716d32-5322-40d8-8ef2-0c5cb2ce06e7 service neutron] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:08:11.659205 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1428/2879] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 18:08:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:08:12.846843 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3153f36-6643-4178-9b73-d731faf55b2a service swift] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:08:12.849044 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-b3153f36-6643-4178-9b73-d731faf55b2a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:08:12.862625 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3153f36-6643-4178-9b73-d731faf55b2a service swift] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:08:12.866260 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ffe593-1ae5-40f3-ae34-6b0e4bae71d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5652329c71cd431fb579d69cef933b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:08:12.866906 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ffe593-1ae5-40f3-ae34-6b0e4bae71d5 service neutron] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:08:12.867188 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ffe593-1ae5-40f3-ae34-6b0e4bae71d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:08:12.867500 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ffe593-1ae5-40f3-ae34-6b0e4bae71d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:08:12.869253 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-51ffe593-1ae5-40f3-ae34-6b0e4bae71d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:08:12.884838 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ffe593-1ae5-40f3-ae34-6b0e4bae71d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:08:12.887713 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ffe593-1ae5-40f3-ae34-6b0e4bae71d5 service neutron] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:08:12.900705 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1452/2880] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 18:08:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:08:21.653416 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=64 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:08:22.895066 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=30 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:08:33.919914 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86716d32-5322-40d8-8ef2-0c5cb2ce06e7 service neutron] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:08:33.927260 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86716d32-5322-40d8-8ef2-0c5cb2ce06e7 service neutron] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:08:33.930994 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdf503a-3998-402f-8844-ce758fe63385 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5652329c71cd431fb579d69cef933b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:08:33.931679 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdf503a-3998-402f-8844-ce758fe63385 service neutron] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:08:33.931965 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdf503a-3998-402f-8844-ce758fe63385 service neutron] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:08:33.932246 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdf503a-3998-402f-8844-ce758fe63385 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:08:33.934060 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-dbdf503a-3998-402f-8844-ce758fe63385 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:08:34.000109 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdf503a-3998-402f-8844-ce758fe63385 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:08:34.002128 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdf503a-3998-402f-8844-ce758fe63385 service neutron] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:08:34.012418 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1429/2881] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 18:08:33 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 18:08:36.245467 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ffe593-1ae5-40f3-ae34-6b0e4bae71d5 service neutron] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:08:36.255083 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ffe593-1ae5-40f3-ae34-6b0e4bae71d5 service neutron] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:08:36.259439 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5496d40-136f-42c7-bbde-529897eac004 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5652329c71cd431fb579d69cef933b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:08:36.260575 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5496d40-136f-42c7-bbde-529897eac004 service neutron] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:08:36.261178 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5496d40-136f-42c7-bbde-529897eac004 service neutron] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:08:36.261721 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5496d40-136f-42c7-bbde-529897eac004 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:08:36.263851 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-f5496d40-136f-42c7-bbde-529897eac004 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:08:36.274982 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5496d40-136f-42c7-bbde-529897eac004 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:08:36.276524 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5496d40-136f-42c7-bbde-529897eac004 service neutron] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:08:36.286942 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1453/2882] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 18:08:36 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:08:44.007699 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=30 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:08:46.281760 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=6 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:09:07.604674 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdf503a-3998-402f-8844-ce758fe63385 service neutron] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:09:07.606802 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-dbdf503a-3998-402f-8844-ce758fe63385 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:09:07.666385 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdf503a-3998-402f-8844-ce758fe63385 service neutron] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:09:07.670667 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8d8c7a-f13b-4ecc-91c2-662346a58e7d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17945e7d72954b8787e0ba09a9903247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:09:07.671393 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8d8c7a-f13b-4ecc-91c2-662346a58e7d service cinder] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:09:07.671684 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8d8c7a-f13b-4ecc-91c2-662346a58e7d service cinder] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:09:07.671967 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8d8c7a-f13b-4ecc-91c2-662346a58e7d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:09:07.673764 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-6b8d8c7a-f13b-4ecc-91c2-662346a58e7d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:09:07.734922 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8d8c7a-f13b-4ecc-91c2-662346a58e7d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:09:07.736413 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8d8c7a-f13b-4ecc-91c2-662346a58e7d service cinder] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:09:07.752867 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1430/2883] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 18:09:07 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:09:12.725909 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf97b65-735d-4bb7-92f7-62c8c46ac839 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:09:12.726522 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf97b65-735d-4bb7-92f7-62c8c46ac839 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:09:12.726522 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf97b65-735d-4bb7-92f7-62c8c46ac839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:09:12.744496 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-5cf97b65-735d-4bb7-92f7-62c8c46ac839 None None] MFA Rules not processed for user `da59091825d44440887d6ef9c542b1ce`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:09:12.745728 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-5cf97b65-735d-4bb7-92f7-62c8c46ac839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:09:12.753265 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1454/2884] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 14 18:09:12 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:09:13.072379 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8d8c7a-f13b-4ecc-91c2-662346a58e7d service cinder] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:09:13.081861 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8d8c7a-f13b-4ecc-91c2-662346a58e7d service cinder] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:09:13.085459 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe28c50-615b-4d52-a61d-a8c9f8c531ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5652329c71cd431fb579d69cef933b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:09:13.086098 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe28c50-615b-4d52-a61d-a8c9f8c531ae service neutron] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:09:13.086389 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe28c50-615b-4d52-a61d-a8c9f8c531ae service neutron] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:09:13.086672 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe28c50-615b-4d52-a61d-a8c9f8c531ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:09:13.088499 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-ebe28c50-615b-4d52-a61d-a8c9f8c531ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:09:13.098853 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe28c50-615b-4d52-a61d-a8c9f8c531ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:09:13.100317 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe28c50-615b-4d52-a61d-a8c9f8c531ae service neutron] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:09:13.109170 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1431/2885] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 18:09:13 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:09:14.907936 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf97b65-735d-4bb7-92f7-62c8c46ac839 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:09:14.909573 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-5cf97b65-735d-4bb7-92f7-62c8c46ac839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:09:14.992946 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf97b65-735d-4bb7-92f7-62c8c46ac839 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:09:14.999748 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e7a7f0-62e1-4180-b6b7-612cb2159ef9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a8049f9c66b4b5185c26084fd8239ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:09:15.000433 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e7a7f0-62e1-4180-b6b7-612cb2159ef9 service placement] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:09:15.000726 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e7a7f0-62e1-4180-b6b7-612cb2159ef9 service placement] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:09:15.001009 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e7a7f0-62e1-4180-b6b7-612cb2159ef9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:09:15.003037 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-45e7a7f0-62e1-4180-b6b7-612cb2159ef9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:09:15.016186 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e7a7f0-62e1-4180-b6b7-612cb2159ef9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:09:15.017777 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e7a7f0-62e1-4180-b6b7-612cb2159ef9 service placement] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:09:15.027964 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1455/2886] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 18:09:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:09:23.104891 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=54 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:09:25.023561 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=35 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:09:33.692643 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe28c50-615b-4d52-a61d-a8c9f8c531ae service neutron] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:09:33.694134 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-ebe28c50-615b-4d52-a61d-a8c9f8c531ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:09:33.711113 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe28c50-615b-4d52-a61d-a8c9f8c531ae service neutron] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:09:33.717538 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c150c0-2202-4f44-b17c-d108ae9c77d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4696d396adb495ab300a9a5a5727595', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:09:33.718205 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c150c0-2202-4f44-b17c-d108ae9c77d9 service nova] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:09:33.718492 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c150c0-2202-4f44-b17c-d108ae9c77d9 service nova] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:09:33.718785 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c150c0-2202-4f44-b17c-d108ae9c77d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:09:33.720732 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-37c150c0-2202-4f44-b17c-d108ae9c77d9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:09:33.734995 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c150c0-2202-4f44-b17c-d108ae9c77d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:09:33.736717 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c150c0-2202-4f44-b17c-d108ae9c77d9 service nova] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:09:33.748513 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1432/2887] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 18:09:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:09:38.265584 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e7a7f0-62e1-4180-b6b7-612cb2159ef9 service placement] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:09:38.281671 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e7a7f0-62e1-4180-b6b7-612cb2159ef9 service placement] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:09:38.288578 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14094cbf-5352-4db1-acbb-c69a5d83b9eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4696d396adb495ab300a9a5a5727595', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:09:38.289391 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14094cbf-5352-4db1-acbb-c69a5d83b9eb service nova] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:09:38.289866 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14094cbf-5352-4db1-acbb-c69a5d83b9eb service nova] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:09:38.290232 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14094cbf-5352-4db1-acbb-c69a5d83b9eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:09:38.292217 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-14094cbf-5352-4db1-acbb-c69a5d83b9eb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:09:38.307190 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14094cbf-5352-4db1-acbb-c69a5d83b9eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:09:38.308942 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14094cbf-5352-4db1-acbb-c69a5d83b9eb service nova] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:09:38.321921 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1456/2888] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 18:09:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:09:39.552613 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c150c0-2202-4f44-b17c-d108ae9c77d9 service nova] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:09:39.577960 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c150c0-2202-4f44-b17c-d108ae9c77d9 service nova] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:09:39.592598 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838c2691-ec57-4cef-a4a9-3f31efebd832 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4696d396adb495ab300a9a5a5727595', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:09:39.596398 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838c2691-ec57-4cef-a4a9-3f31efebd832 service nova] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:09:39.596398 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838c2691-ec57-4cef-a4a9-3f31efebd832 service nova] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:09:39.596398 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838c2691-ec57-4cef-a4a9-3f31efebd832 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:09:39.596398 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-838c2691-ec57-4cef-a4a9-3f31efebd832 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:09:39.615820 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838c2691-ec57-4cef-a4a9-3f31efebd832 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:09:39.618832 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838c2691-ec57-4cef-a4a9-3f31efebd832 service nova] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:09:39.659500 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1433/2889] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 18:09:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:09:48.141757 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dd3e17-4870-402b-955c-ff49e4590d18 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:09:48.142294 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dd3e17-4870-402b-955c-ff49e4590d18 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:09:48.142294 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dd3e17-4870-402b-955c-ff49e4590d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:09:48.161825 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-53dd3e17-4870-402b-955c-ff49e4590d18 None None] MFA Rules not processed for user `f1e32638fe5c4d2d8d3e2e4ea8250aaa`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:09:48.162935 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-53dd3e17-4870-402b-955c-ff49e4590d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:09:48.170314 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1457/2890] 10.222.0.36 () {58 vars in 967 bytes} [Tue Jun 14 18:09:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:09:48.211438 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838c2691-ec57-4cef-a4a9-3f31efebd832 service nova] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:09:48.224063 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838c2691-ec57-4cef-a4a9-3f31efebd832 service nova] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:09:48.229161 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614c1c3e-a881-410c-bac5-67aa0392f748 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba38b47a31b14526be0aa2054841881b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:09:48.229854 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c1c3e-a881-410c-bac5-67aa0392f748 service swift] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:09:48.230145 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c1c3e-a881-410c-bac5-67aa0392f748 service swift] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:09:48.230431 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c1c3e-a881-410c-bac5-67aa0392f748 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:09:48.239865 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614c1c3e-a881-410c-bac5-67aa0392f748 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:09:48.241737 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614c1c3e-a881-410c-bac5-67aa0392f748 service swift] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:09:48.250281 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1434/2891] 10.222.0.36 () {60 vars in 1384 bytes} [Tue Jun 14 18:09:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 14 18:09:56.777224 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dd3e17-4870-402b-955c-ff49e4590d18 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:09:56.791742 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dd3e17-4870-402b-955c-ff49e4590d18 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:09:56.798624 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246961a5-eb31-40f3-9863-35a9a395669f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a8049f9c66b4b5185c26084fd8239ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:09:56.801763 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246961a5-eb31-40f3-9863-35a9a395669f service placement] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:09:56.801763 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246961a5-eb31-40f3-9863-35a9a395669f service placement] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:09:56.801763 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246961a5-eb31-40f3-9863-35a9a395669f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:09:56.802075 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-246961a5-eb31-40f3-9863-35a9a395669f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:09:56.815149 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246961a5-eb31-40f3-9863-35a9a395669f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:09:56.816803 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246961a5-eb31-40f3-9863-35a9a395669f service placement] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:09:56.827538 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1458/2892] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 18:09:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:09:56.918737 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614c1c3e-a881-410c-bac5-67aa0392f748 service swift] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:09:56.921246 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-614c1c3e-a881-410c-bac5-67aa0392f748 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:09:56.989750 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614c1c3e-a881-410c-bac5-67aa0392f748 service swift] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:09:56.994336 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9c85d6-cf10-42ea-8505-5de161322615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:09:56.995241 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9c85d6-cf10-42ea-8505-5de161322615 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:09:56.999466 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9c85d6-cf10-42ea-8505-5de161322615 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:09:56.999466 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9c85d6-cf10-42ea-8505-5de161322615 admin admin] PATH_INFO: `/v3/users/b2686c4f76544b0c996c15d619b702ba` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:09:56.999466 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9c85d6-cf10-42ea-8505-5de161322615 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2686c4f76544b0c996c15d619b702ba)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:09:56.999466 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9c85d6-cf10-42ea-8505-5de161322615 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:09:57.217439 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-ed9c85d6-cf10-42ea-8505-5de161322615 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2686c4f76544b0c996c15d619b702ba'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:09:57.218140 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-ed9c85d6-cf10-42ea-8505-5de161322615 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2686c4f76544b0c996c15d619b702ba'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:09:57.219157 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-ed9c85d6-cf10-42ea-8505-5de161322615 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2686c4f76544b0c996c15d619b702ba'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:09:57.305258 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-ed9c85d6-cf10-42ea-8505-5de161322615 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2686c4f76544b0c996c15d619b702ba'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:09:57.313414 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-ed9c85d6-cf10-42ea-8505-5de161322615 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2686c4f76544b0c996c15d619b702ba'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:09:57.332345 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1435/2893] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 14 18:09:56 2022] DELETE /identity/v3/users/b2686c4f76544b0c996c15d619b702ba => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:09:57.610088 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246961a5-eb31-40f3-9863-35a9a395669f service placement] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:09:57.627035 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246961a5-eb31-40f3-9863-35a9a395669f service placement] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:09:57.689914 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c52952b-5c8c-47c3-85e9-3a021ea02350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:09:57.690800 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c52952b-5c8c-47c3-85e9-3a021ea02350 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:09:57.691215 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c52952b-5c8c-47c3-85e9-3a021ea02350 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:09:57.691543 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c52952b-5c8c-47c3-85e9-3a021ea02350 admin admin] PATH_INFO: `/v3/projects/1ca62d7c1e1c4d61a1b3c94f0068b5c8` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:09:57.692739 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c52952b-5c8c-47c3-85e9-3a021ea02350 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ca62d7c1e1c4d61a1b3c94f0068b5c8)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:09:57.694634 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c52952b-5c8c-47c3-85e9-3a021ea02350 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:09:57.814996 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-7c52952b-5c8c-47c3-85e9-3a021ea02350 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ca62d7c1e1c4d61a1b3c94f0068b5c8', 'request_id': 'req-7c52952b-5c8c-47c3-85e9-3a021ea02350'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:09:57.888145 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-7c52952b-5c8c-47c3-85e9-3a021ea02350 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ca62d7c1e1c4d61a1b3c94f0068b5c8', 'request_id': 'req-7c52952b-5c8c-47c3-85e9-3a021ea02350'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:09:57.896134 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-7c52952b-5c8c-47c3-85e9-3a021ea02350 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ca62d7c1e1c4d61a1b3c94f0068b5c8', 'request_id': 'req-7c52952b-5c8c-47c3-85e9-3a021ea02350'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:09:57.914066 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-7c52952b-5c8c-47c3-85e9-3a021ea02350 admin admin] The token cache is being invalidate because project 1ca62d7c1e1c4d61a1b3c94f0068b5c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87019) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:09:57.914363 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-7c52952b-5c8c-47c3-85e9-3a021ea02350 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:09:57.915224 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-7c52952b-5c8c-47c3-85e9-3a021ea02350 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:09:57.916781 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1459/2894] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 14 18:09:57 2022] DELETE /identity/v3/projects/1ca62d7c1e1c4d61a1b3c94f0068b5c8 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 18:09:57.921577 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9c85d6-cf10-42ea-8505-5de161322615 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:09:57.925976 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-ed9c85d6-cf10-42ea-8505-5de161322615 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:09:57.938457 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9c85d6-cf10-42ea-8505-5de161322615 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:09:57.982767 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:09:58.003687 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c90960-3205-44f7-bb8f-690526e49e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:09:58.004586 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c90960-3205-44f7-bb8f-690526e49e9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:09:58.004872 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c90960-3205-44f7-bb8f-690526e49e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:09:58.005157 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c90960-3205-44f7-bb8f-690526e49e9e admin admin] PATH_INFO: `/v3/users/271bc67b63db42db905fa1b8215f53da` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:09:58.006521 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c90960-3205-44f7-bb8f-690526e49e9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=271bc67b63db42db905fa1b8215f53da)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:09:58.008562 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c90960-3205-44f7-bb8f-690526e49e9e admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:09:58.211013 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-94c90960-3205-44f7-bb8f-690526e49e9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '271bc67b63db42db905fa1b8215f53da'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:09:58.211838 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-94c90960-3205-44f7-bb8f-690526e49e9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '271bc67b63db42db905fa1b8215f53da'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:09:58.212512 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-94c90960-3205-44f7-bb8f-690526e49e9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '271bc67b63db42db905fa1b8215f53da'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:09:58.299790 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-94c90960-3205-44f7-bb8f-690526e49e9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '271bc67b63db42db905fa1b8215f53da'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:09:58.307167 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-94c90960-3205-44f7-bb8f-690526e49e9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '271bc67b63db42db905fa1b8215f53da'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:09:58.324395 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1436/2895] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 14 18:09:57 2022] DELETE /identity/v3/users/271bc67b63db42db905fa1b8215f53da => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:09:58.599056 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c52952b-5c8c-47c3-85e9-3a021ea02350 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:09:58.600619 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-7c52952b-5c8c-47c3-85e9-3a021ea02350 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:09:58.614896 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c52952b-5c8c-47c3-85e9-3a021ea02350 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:09:58.668444 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:09:58.674540 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df819a53-c106-4f47-aad6-3501d9718f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:09:58.675443 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df819a53-c106-4f47-aad6-3501d9718f59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:09:58.675734 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df819a53-c106-4f47-aad6-3501d9718f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:09:58.676015 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df819a53-c106-4f47-aad6-3501d9718f59 admin admin] PATH_INFO: `/v3/projects/6615d42a60864feeb2873cc01eddcf4b` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:09:58.677205 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df819a53-c106-4f47-aad6-3501d9718f59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6615d42a60864feeb2873cc01eddcf4b)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:09:58.679206 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df819a53-c106-4f47-aad6-3501d9718f59 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:09:58.782709 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-df819a53-c106-4f47-aad6-3501d9718f59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6615d42a60864feeb2873cc01eddcf4b', 'request_id': 'req-df819a53-c106-4f47-aad6-3501d9718f59'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:09:58.853803 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-df819a53-c106-4f47-aad6-3501d9718f59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6615d42a60864feeb2873cc01eddcf4b', 'request_id': 'req-df819a53-c106-4f47-aad6-3501d9718f59'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:09:58.860872 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-df819a53-c106-4f47-aad6-3501d9718f59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6615d42a60864feeb2873cc01eddcf4b', 'request_id': 'req-df819a53-c106-4f47-aad6-3501d9718f59'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:09:58.871328 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-df819a53-c106-4f47-aad6-3501d9718f59 admin admin] The token cache is being invalidate because project 6615d42a60864feeb2873cc01eddcf4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87019) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:09:58.871632 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-df819a53-c106-4f47-aad6-3501d9718f59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:09:58.872274 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-df819a53-c106-4f47-aad6-3501d9718f59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:09:58.874303 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1460/2896] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 14 18:09:58 2022] DELETE /identity/v3/projects/6615d42a60864feeb2873cc01eddcf4b => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:10:08.368600 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=35,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:10:08.868276 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=25,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:11:33.323985 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c90960-3205-44f7-bb8f-690526e49e9e admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:11:33.325486 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-94c90960-3205-44f7-bb8f-690526e49e9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:11:33.436048 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c90960-3205-44f7-bb8f-690526e49e9e admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:11:33.487012 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e492c4-2841-4639-87fb-a7b002144ff5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5652329c71cd431fb579d69cef933b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:11:33.487722 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e492c4-2841-4639-87fb-a7b002144ff5 service neutron] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:11:33.488018 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e492c4-2841-4639-87fb-a7b002144ff5 service neutron] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:11:33.488302 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e492c4-2841-4639-87fb-a7b002144ff5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:11:33.490245 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-42e492c4-2841-4639-87fb-a7b002144ff5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:11:33.589780 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=100 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:11:33.620724 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e492c4-2841-4639-87fb-a7b002144ff5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:11:33.622185 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e492c4-2841-4639-87fb-a7b002144ff5 service neutron] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:11:33.644371 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1437/2897] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 18:11:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:11:37.082062 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df819a53-c106-4f47-aad6-3501d9718f59 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:11:37.083566 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-df819a53-c106-4f47-aad6-3501d9718f59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:11:37.218901 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df819a53-c106-4f47-aad6-3501d9718f59 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:11:37.224250 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6674fac-d855-496f-a6c4-8852658ae1ed service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a8049f9c66b4b5185c26084fd8239ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:11:37.229007 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6674fac-d855-496f-a6c4-8852658ae1ed service placement] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:11:37.229007 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6674fac-d855-496f-a6c4-8852658ae1ed service placement] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:11:37.229007 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6674fac-d855-496f-a6c4-8852658ae1ed service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:11:37.229007 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-b6674fac-d855-496f-a6c4-8852658ae1ed service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:11:37.244687 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6674fac-d855-496f-a6c4-8852658ae1ed service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:11:37.246395 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6674fac-d855-496f-a6c4-8852658ae1ed service placement] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:11:37.258799 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1461/2898] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 18:11:37 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:11:41.073789 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e492c4-2841-4639-87fb-a7b002144ff5 service neutron] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:11:41.073789 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-42e492c4-2841-4639-87fb-a7b002144ff5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:11:41.082565 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e492c4-2841-4639-87fb-a7b002144ff5 service neutron] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:11:41.089474 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52419ba1-921e-4d9b-9628-087db86bb439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:11:41.089474 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52419ba1-921e-4d9b-9628-087db86bb439 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:11:41.089474 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52419ba1-921e-4d9b-9628-087db86bb439 admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:11:41.089474 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52419ba1-921e-4d9b-9628-087db86bb439 admin admin] PATH_INFO: `/v3/users/da59091825d44440887d6ef9c542b1ce` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:11:41.089952 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52419ba1-921e-4d9b-9628-087db86bb439 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da59091825d44440887d6ef9c542b1ce)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:11:41.091946 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52419ba1-921e-4d9b-9628-087db86bb439 admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:11:41.301271 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-52419ba1-921e-4d9b-9628-087db86bb439 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da59091825d44440887d6ef9c542b1ce'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:11:41.302328 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-52419ba1-921e-4d9b-9628-087db86bb439 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da59091825d44440887d6ef9c542b1ce'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:11:41.302981 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-52419ba1-921e-4d9b-9628-087db86bb439 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da59091825d44440887d6ef9c542b1ce'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:11:41.384196 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-52419ba1-921e-4d9b-9628-087db86bb439 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da59091825d44440887d6ef9c542b1ce'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:11:41.393695 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-52419ba1-921e-4d9b-9628-087db86bb439 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da59091825d44440887d6ef9c542b1ce'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:11:41.412200 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1438/2899] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 14 18:11:41 2022] DELETE /identity/v3/users/da59091825d44440887d6ef9c542b1ce => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:11:41.672243 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6674fac-d855-496f-a6c4-8852658ae1ed service placement] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:11:41.685020 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6674fac-d855-496f-a6c4-8852658ae1ed service placement] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:11:41.744841 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87216704-90c8-432a-a68a-1d0fe891a66d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:11:41.745704 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87216704-90c8-432a-a68a-1d0fe891a66d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:11:41.745993 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87216704-90c8-432a-a68a-1d0fe891a66d admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:11:41.746279 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87216704-90c8-432a-a68a-1d0fe891a66d admin admin] PATH_INFO: `/v3/projects/f61370c4497b496487383283e474bc3a` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:11:41.747506 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87216704-90c8-432a-a68a-1d0fe891a66d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f61370c4497b496487383283e474bc3a)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:11:41.749423 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87216704-90c8-432a-a68a-1d0fe891a66d admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:11:41.843881 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:11:41.845095 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-87216704-90c8-432a-a68a-1d0fe891a66d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f61370c4497b496487383283e474bc3a', 'request_id': 'req-87216704-90c8-432a-a68a-1d0fe891a66d'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:11:41.908013 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-87216704-90c8-432a-a68a-1d0fe891a66d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f61370c4497b496487383283e474bc3a', 'request_id': 'req-87216704-90c8-432a-a68a-1d0fe891a66d'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:11:41.916456 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-87216704-90c8-432a-a68a-1d0fe891a66d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f61370c4497b496487383283e474bc3a', 'request_id': 'req-87216704-90c8-432a-a68a-1d0fe891a66d'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:11:41.927813 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-87216704-90c8-432a-a68a-1d0fe891a66d admin admin] The token cache is being invalidate because project f61370c4497b496487383283e474bc3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87019) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:11:41.928117 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-87216704-90c8-432a-a68a-1d0fe891a66d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:11:41.928788 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-87216704-90c8-432a-a68a-1d0fe891a66d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:11:41.930419 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1462/2900] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 14 18:11:41 2022] DELETE /identity/v3/projects/f61370c4497b496487383283e474bc3a => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 18:11:41.934472 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52419ba1-921e-4d9b-9628-087db86bb439 admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:11:41.935908 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-52419ba1-921e-4d9b-9628-087db86bb439 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:11:41.949830 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52419ba1-921e-4d9b-9628-087db86bb439 admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:11:42.009101 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dc841d-ed2a-4c1e-9cbe-6c18d7dc622a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:11:42.010226 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dc841d-ed2a-4c1e-9cbe-6c18d7dc622a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:11:42.010626 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dc841d-ed2a-4c1e-9cbe-6c18d7dc622a admin admin] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:11:42.011014 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dc841d-ed2a-4c1e-9cbe-6c18d7dc622a admin admin] PATH_INFO: `/v3/users/9a5777f1ad7b4befb21a6a107028bbc4` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:11:42.012679 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dc841d-ed2a-4c1e-9cbe-6c18d7dc622a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a5777f1ad7b4befb21a6a107028bbc4)` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:11:42.014760 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dc841d-ed2a-4c1e-9cbe-6c18d7dc622a admin admin] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:11:42.277077 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:11:42.281119 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-e7dc841d-ed2a-4c1e-9cbe-6c18d7dc622a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a5777f1ad7b4befb21a6a107028bbc4'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:11:42.281791 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-e7dc841d-ed2a-4c1e-9cbe-6c18d7dc622a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a5777f1ad7b4befb21a6a107028bbc4'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:11:42.282398 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-e7dc841d-ed2a-4c1e-9cbe-6c18d7dc622a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a5777f1ad7b4befb21a6a107028bbc4'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:11:42.387777 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-e7dc841d-ed2a-4c1e-9cbe-6c18d7dc622a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a5777f1ad7b4befb21a6a107028bbc4'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:11:42.396343 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.notifications [None req-e7dc841d-ed2a-4c1e-9cbe-6c18d7dc622a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a5777f1ad7b4befb21a6a107028bbc4'} {{(pid=87018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:11:42.415994 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1439/2901] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 14 18:11:41 2022] DELETE /identity/v3/users/9a5777f1ad7b4befb21a6a107028bbc4 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:11:42.721319 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87216704-90c8-432a-a68a-1d0fe891a66d admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:11:42.723613 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-87216704-90c8-432a-a68a-1d0fe891a66d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:11:42.737133 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87216704-90c8-432a-a68a-1d0fe891a66d admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:11:42.802290 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe09cf2f-0002-45b3-a8dc-fe65d90683f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaeb72186c0489e804154d6d26ae21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f37a5c2ee2664dafb5a29dda0a1fc6e2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:11:42.803069 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe09cf2f-0002-45b3-a8dc-fe65d90683f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:11:42.803388 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe09cf2f-0002-45b3-a8dc-fe65d90683f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:11:42.803682 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe09cf2f-0002-45b3-a8dc-fe65d90683f8 admin admin] PATH_INFO: `/v3/projects/87147f8df25c43b5a5a7ca1cca722071` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:11:42.804909 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe09cf2f-0002-45b3-a8dc-fe65d90683f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87147f8df25c43b5a5a7ca1cca722071)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:11:42.806822 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe09cf2f-0002-45b3-a8dc-fe65d90683f8 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:11:42.933380 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-fe09cf2f-0002-45b3-a8dc-fe65d90683f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87147f8df25c43b5a5a7ca1cca722071', 'request_id': 'req-fe09cf2f-0002-45b3-a8dc-fe65d90683f8'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:11:43.000822 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-fe09cf2f-0002-45b3-a8dc-fe65d90683f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87147f8df25c43b5a5a7ca1cca722071', 'request_id': 'req-fe09cf2f-0002-45b3-a8dc-fe65d90683f8'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:11:43.009360 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-fe09cf2f-0002-45b3-a8dc-fe65d90683f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87147f8df25c43b5a5a7ca1cca722071', 'request_id': 'req-fe09cf2f-0002-45b3-a8dc-fe65d90683f8'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:11:43.021300 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-fe09cf2f-0002-45b3-a8dc-fe65d90683f8 admin admin] The token cache is being invalidate because project 87147f8df25c43b5a5a7ca1cca722071 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87019) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:11:43.021599 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-fe09cf2f-0002-45b3-a8dc-fe65d90683f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:11:43.022404 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-fe09cf2f-0002-45b3-a8dc-fe65d90683f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:11:43.023887 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1463/2902] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 14 18:11:42 2022] DELETE /identity/v3/projects/87147f8df25c43b5a5a7ca1cca722071 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:11:52.469496 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:DELETE=4,keystone:SELECT=13,keystone:INSERT=1 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:11:53.017102 dv-cinder-826350-5-iscsi devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=58,keystone:INSERT=2,keystone:DELETE=10 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:12:27.230477 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dc841d-ed2a-4c1e-9cbe-6c18d7dc622a admin admin] Authenticating user token {{(pid=87018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:12:27.231959 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-e7dc841d-ed2a-4c1e-9cbe-6c18d7dc622a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:12:27.302614 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dc841d-ed2a-4c1e-9cbe-6c18d7dc622a admin admin] Validating token access rules against request {{(pid=87018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:12:27.362907 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61320bbe-58d4-41a3-af44-2b699110590b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a8049f9c66b4b5185c26084fd8239ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e1d023a52c42b98d018617987ef83c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:12:27.363641 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61320bbe-58d4-41a3-af44-2b699110590b service placement] REQUEST_METHOD: `GET` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:12:27.363933 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61320bbe-58d4-41a3-af44-2b699110590b service placement] SCRIPT_NAME: `/identity` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:12:27.364213 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61320bbe-58d4-41a3-af44-2b699110590b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:12:27.366035 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.fernet_utils [None req-61320bbe-58d4-41a3-af44-2b699110590b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:12:27.377459 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61320bbe-58d4-41a3-af44-2b699110590b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:12:27.379028 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61320bbe-58d4-41a3-af44-2b699110590b service placement] RBAC: Authorization granted {{(pid=87018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:12:27.389740 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: [pid: 87018|app: 0|req: 1440/2903] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 14 18:12:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:12:37.384826 dv-cinder-826350-5-iscsi devstack@keystone.service[87018]: DEBUG dbcounter [-] [87018] Writing DB stats keystone:SELECT=58 {{(pid=87018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}